Information theory |
ter |
|||||
Teaching Staff in Charge |
Prof. MIHOC Ion, Ph.D., imihoc@math.ubbcluj.ro |
Aims |
To pressent to the students the principal notions of the information theory and some important applications of their. |
Content |
1. Information- the secondary concept and the probability - the primary concept. Hartley's formula. Shannon's entropy. The Shannon-Hincin and the Fadeev characterizations of the Shannon entropy. The information characterizations for some probability distributions.
2. Information - the primary concept and the probability - the secondary concept. Axiomatic of J.Kampe de Feriet-Bruno Forte. Information of the type M. 3. Renyi entropies. The information of order $\alpha$ for a ordinary distributions and for the incomplete distributions. 4. Information theory and statistics. Kullback-Leibler information. Properties of information: additivity, convexity. Fisher's information. Information and sufficiency. |
References |
1. Ash, R., Information Theory, John Wiley and Sons, New York. London . Sydney, 1965
2. Guiasu, S., Theodorescu, R., Teoria matematica a informatiei, Ed. Academiei RSR, Bucuresti, 1966. 3. Kullback, S., Information Theory and Statistics, John Wiley and Sons, London, 1959 4. Renyi, A., Probability Theory, Akademiai Kiado, Budapest, 1970. |
Assessment |
Exam. |