Some Results on the Information Loss in Dynamical Systems

TitleSome Results on the Information Loss in Dynamical Systems
Publication TypeConference Paper
Year of Publication2011
AuthorsGeiger, B., & Kubin G.
Conference NameIEEE Int. Sym. on Wireless Communication Systems (ISWCS)
Conference LocationAachen

In this work we investigate the information loss in (nonlinear) dynamical input-output systems and provide some general results. In particular, we present an upper bound on the information loss rate, defined as the (non-negative) difference between the entropy rates of the jointly stationary stochastic processes at the input and output of the system.
We further introduce a family of systems with vanishing information loss rate. It is shown that not only linear filters belong to that family, but - under certain circumstances - also finite-precision implementations of the latter, which typically consist of nonlinear elements.

Citation Key2061
Refereed DesignationRefereed
Full Text

extended version available under arXiv:1106.2404 [cs.IT]

SPSC cross-references
Research Area: 
Geiger_InfoLossDyn.pdf123.47 KB