Entropy and Information Theory [Hardcover]

Robert M. Gray (Author)

Book Description

Publication Date: September 4, 1990 | ISBN-10: 0387973710 | ISBN-13: 978-0387973715 | Edition: 1

This book is devoted to the theory of probabilistic information measures and their application to coding theorems for information sources and noisy channels. The eventual goal is a general development of Shannon's mathematical theory of communication, but much of the space is devoted to the tools and methods required to prove the Shannon coding theorems. These tools form an area common to ergodic theory and information theory and comprise several quantitative notions of the information in random variables, random processes, and dynamical systems. Examples are entropy, mutual information, conditional entropy, conditional information, and discrimination or relative entropy, along with the limiting normalized versions of these quantities such as entropy rate and information rate. Much of the book is concerned with their properties, especially the long term asymptotic behavior of sample information and expected information. This is the only up-to-date treatment of traditional information theory emphasizing ergodic theory.

Editorial Reviews

From the Back Cover

None --This text refers to an alternate Hardcover edition.

About the Author

Robert M. Gray is the Alcatel-Lucent Technologies Professor of Communications and Networking in the School of Engineering and Professor of Electrical Engineering at Stanford University. For over four decades he has done research, taught, and published in the areas of information theory and statistical signal processing. He is a Fellow of the IEEE and the Institute for Mathematical Statistics. He has won several professional awards, including a Guggenheim Fellowship, the Society Award and Education Award of the IEEE Signal Processing Society, the Claude E. Shannon Award from the IEEE Information Theory Society, the Jack S. Kilby Signal Processing Medal, Centennial Medal, and Third Millennium Medal from the IEEE, and a Presidential Award for Excellence in Science, Mathematics and Engineering Mentoring (PAESMEM). He is a member of the National Academy of Engineering. --This text refers to an alternate Hardcover edition.

Product Details

• Hardcover: 332 pages
• Publisher: Springer; 1 edition (September 4, 1990)
• Language: English
• ISBN-10: 0387973710
• ISBN-13: 978-0387973715
• Product Dimensions: 9.3 x 6.3 x 0.9 inches
• Shipping Weight: 1.5 pounds
• Amazon Best Sellers Rank: #4,526,059 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.