Introduction to Information Theory for Mathematics Students

Math 523 - Fall 2017


instructor phone # office e-mail
Renato Feres 5-6752 Cupples I, 17 feres@math.wustl.edu


Section information: Classes meet on Mondays, Wednesdays and Fridays from 3:00PM to 4:00PM at Busch Hall 202. Office hours are on Tu-Th from 12:00PM to 2:00PM. (This may change later.)


Subject: Despite the title, non-math majors are welcome. The course will cover the main mathematical results comprising Shannon's theory of information, with an emphasis on the stochastic processes aspects of the theory. In addition to developing the fundamentals of the classical theory in detail, we'll study the beginnings of quantum probability and coding theorems. Although information theory is an eminently applied topic, our focus will be on the basic mathematical structure rather than on more technical issues that you would learn in an engineering course on the subject.


Text: Coding Theorems of Classical and Quantum Information Theory (Second Edition), by K.R. Parthasarathy. Texts and Readings in Mathematics, 45. Hindustan Book Agency, 2013.


Tentative list of topics:


Coursework: Your work will consist entirely of homework assignments. I expect we'll have approximately 5 assignments. You are welcome to collaborate on them, discuss them with me or others, and bring up homework related questions for discussion in class before turning them in. The method for computing grades will be discussed in class. A presentation on a topic related to subject of the course may substitute for a few of the written assignments.

Grades: Your final grade will be based on your homework assignments and/or class presentation.