information theory: connection to statistical mechanics

5
Information Theory: Connection to Statistical Mechanics

Upload: brandon-reeves

Post on 20-Jan-2018

214 views

Category:

Documents


0 download

DESCRIPTION

The Connection Between Information Theory & Statistical Mechanics Was first discussed by American Mathematical Physicist Edwin T. Jaynes in his paper “Information Theory and Statistical Mechanics” published in “The Physical Review” May, 1957.

TRANSCRIPT

Page 1: Information Theory: Connection to Statistical Mechanics

Information Theory: Connection to

Statistical Mechanics

Page 2: Information Theory: Connection to Statistical Mechanics

Information TheoryFirst discussed by the American mathematician,

electrical engineer, and computer scientist

Claude E. Shannonin his paper

“A Mathematical Theory of Communication”published in

“The Bell System Technical Journal”October, 1948.

Page 3: Information Theory: Connection to Statistical Mechanics

The Connection Between Information Theory & Statistical Mechanics

Was first discussed by American Mathematical Physicist

Edwin T. Jaynesin his paper

“Information Theory and Statistical Mechanics”

published in “The Physical Review”

May, 1957.

Page 4: Information Theory: Connection to Statistical Mechanics

Edwin T. Jaynes (1922-1998)

1946 1976 1996Some of his many research areas:

Non-Equilibrium Statistical Mechanics“Neo-Classical Electrodynamics”

Quantum MechanicsProbability Theory: “Maximum Entropy” Methods

Trained as a theorist, but ALWAYS did experiment also!!Career: Stanford University (1950-1960)

Washington University in St. Louis (1960-1998)

Page 5: Information Theory: Connection to Statistical Mechanics

First Publication to Make a Connection BetweenStatistical Mechanics & Information Theory

Almost 5,000 Citationssince the 1957 publication date!!

Almost 10 Million hits on Google!

A Personal Note: E.T. Jaynes was the professor who taught me graduate statistical mechanics! (At Washington University in St. Louis)