The second law of thermodynamics for communication channels

Ori Shental, Ido Kanter

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

The classical thermodynamic laws fail to capture the behavior of systems with energy Hamiltonian being an explicit function of the temperature. Such Hamiltonian arises, for example, in modeling information processing systems, like communication channels, as thermal systems. Here we generalize the second thermodynamic law to encompass systems with temperature-dependent energy levels, dQ = TdS+ < dε/dT > dT, where <.> denotes averaging over the Boltzmann distribution. It enables to quantitatively bridge between the realm of thermodynamics and information theory in the context of communication channels. In particular, this generalization enables to express information measures (e.g., mutual information) of the popular Gaussian and binary-symmetric channels as a direct consequence of the laws of nature - the laws of thermodynamics.

Original languageEnglish
Title of host publication2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2008
Pages784-788
Number of pages5
DOIs
StatePublished - 2008
Event2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2008 - Eilat, Israel
Duration: 3 Dec 20085 Dec 2008

Publication series

NameIEEE Convention of Electrical and Electronics Engineers in Israel, Proceedings

Conference

Conference2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel, IEEEI 2008
Country/TerritoryIsrael
CityEilat
Period3/12/085/12/08

Keywords

  • Binary-symmetric channel
  • Gaussian channel
  • Mutual information
  • Shannon entropy
  • Thermodynamics

Fingerprint

Dive into the research topics of 'The second law of thermodynamics for communication channels'. Together they form a unique fingerprint.

Cite this