Information theory and signal processing in neuroscienceAlexander DimitrovCenter for Computational BiologyMontana State UniversityJanuary, 2003This is a rather brief outline of the topic of information theoryand its applications to neuroscience. If you find this interesting,there are two main books to delve deeper:† Elements of Information Theory. Cover and Thomas ’91A rather complete description of basic information theory.† Entropy and Information Theory. Robert Gray ’90Encompasses less, but more technical and precise.Thereisalsoaslewofpapersonapplications,whichwillbelistedseparately.Signal processing and information theory in neuroscienceThere are two principal uses of information theory in neuro-science:† As an explanatory theory for neural function.Inthissettingoneusuallyadvancesthehypothesisthatneuralsystemsareoptimal under certain information-theoretic measures. This hypothesis iseithertested,oritsvalidityisassumedandneuralstructuresarepredictedbased on that.† As a method for analysis of physiological data.Here a neural system is analyzed as a communication channel. One usu-allyestimatescertaininformation-theoreticquantitiesindifferentoperat-ing modes of the system, and then draws conclusions about the system.A particular problem there is the question of neural coding: how is theactivity of a set of neurons representing their inputs?Example 1 (Neural Function).Barlow (1967) proposed, andAtick (1992) studied the assumption that early ...