On the Information Loss in Memoryless Systems: The Multivariate Case

TitleOn the Information Loss in Memoryless Systems: The Multivariate Case
Publication TypeConference Paper
Year of Publication2012
AuthorsGeiger, B., & Kubin G.
Conference NameInt. Zurich Seminar on Communications
Pages32-35
Conference LocationZurich
Abstract

In this work we give a concise definition of information loss from a system-theoretic point of view. Based on this definition, we analyze the information loss in memoryless input-output systems subject to a continuous-valued input. For a certain class of multiple-input, multiple-output systems the information loss is quantified. An interpretation of this loss is accompanied by upper bounds which are simple to evaluate.

Finally, a class of systems is identified for which the information loss is necessarily infinite. Quantizers and limiters are shown to belong to this class.

DOI10.3929/ethz-a-007023900
Citation Key2173
Refereed DesignationRefereed
Full Text

extended version available under arXiv:1109.4856 [cs.IT]

SPSC cross-references
Research Area: 
AttachmentSize
GeigerEtAl_ILMultivariate.pdf401.08 KB