Engineering & Transportation
Elements of Information Theory and over one million other books are available for Amazon Kindle. Learn more

Sorry, this item is not available in
Image not available for
Color:
Image not available

To view this video download Flash Player

 


or
Sign in to turn on 1-Click ordering
Sell Us Your Item
For a $35.53 Gift Card
Trade in
More Buying Choices
Have one to sell? Sell yours here
Start reading Elements of Information Theory on your Kindle in under a minute.

Don't have a Kindle? Get your Kindle here, or download a FREE Kindle Reading App.

Elements of Information Theory 2nd Edition (Wiley Series in Telecommunications and Signal Processing) [Hardcover]

Thomas M. Cover , Joy A. Thomas
4.1 out of 5 stars  See all reviews (21 customer reviews)

Buy New
$85.16 & FREE Shipping. Details
Rent
$33.98
Only 10 left in stock (more on the way).
Ships from and sold by Amazon.com. Gift-wrap available.
In Stock.
Rented by RentU and Fulfilled by Amazon.
Want it Tuesday, July 15? Choose One-Day Shipping at checkout. Details
Free Two-Day Shipping for College Students with Amazon Student

Formats

Amazon Price New from Used from
Kindle Edition $68.49  
Hardcover $85.16  
Paperback --  
Shop the new tech.book(store)
New! Introducing the tech.book(store), a hub for Software Developers and Architects, Networking Administrators, TPMs, and other technology professionals to find highly-rated and highly-relevant career resources. Shop books on programming and big data, or read this week's blog posts by authors and thought-leaders in the tech industry. > Shop now

Book Description

July 18, 2006 0471241954 978-0471241959 2
The latest edition of this classic is updated with new problem sets and material

The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.

All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points.

The Second Edition features:
* Chapters reorganized to improve teaching
* 200 new problems
* New material on source coding, portfolio theory, and feedback capacity
* Updated references

Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.

An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.


Frequently Bought Together

Elements of Information Theory 2nd Edition (Wiley Series in Telecommunications and Signal Processing) + Information Theory, Inference and Learning Algorithms + An Introduction to Information Theory: Symbols, Signals and Noise (Dover Books on Mathematics)
Price for all three: $163.92

Buy the selected items together


Editorial Reviews

Review

"As expected, the quality of exposition continues to be a high point of the book. Clear explanations, nice graphical illustrations, and illuminating mathematical derivations make the book particularly useful as a textbook on information theory." (Journal of the American Statistical Association, March 2008)

"This book is recommended reading, both as a textbook and as a reference." (Computing Reviews.com, December 28, 2006)

From the Back Cover

The latest edition of this classic is updated with new problem sets and material

The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.

All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points.

The Second Edition features:

  • Chapters reorganized to improve teaching
  • 200 new problems
  • New material on source coding, portfolio theory, and feedback capacity
  • Updated references

Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.


Product Details

  • Hardcover: 776 pages
  • Publisher: Wiley-Interscience; 2 edition (July 18, 2006)
  • Language: English
  • ISBN-10: 0471241954
  • ISBN-13: 978-0471241959
  • Product Dimensions: 9.4 x 6.3 x 1.6 inches
  • Shipping Weight: 2.6 pounds (View shipping rates and policies)
  • Average Customer Review: 4.1 out of 5 stars  See all reviews (21 customer reviews)
  • Amazon Best Sellers Rank: #65,023 in Books (See Top 100 in Books)

More About the Authors

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews
89 of 90 people found the following review helpful
5.0 out of 5 stars An Excellent Introduction to Information Theory May 16, 2008
Format:Hardcover|Verified Purchase
I am writing this review in response to some confusion and unfairness I see in other reviews. Cover and Thomas have written a unique and ambitious introduction to a fascinating and complex subject; their book must be judged fairly and not compared to other books that have entirely different goals.

Claude Shannon provided a working definition of "information" in his seminal 1948 paper, A Mathematical Theory of Communication. Shannon's interest in that and subsequent papers was the attainment of reliable communication in noisy channels. The definition of information that Shannon gave was perfectly fitted to this task; indeed, it is easily shown that in the context studied by Shannon, the only meaningful measure of information content that will apply to random variables with known distribution must be (up to a multiplicative constant) of the now-familiar form h(p) = log(1/p).

However, Shannon freely admitted that his definition of information was limited in scope and was never envisioned as being universal. Shannon deliberately avoided the "murkier" aspects of human communication in framing his definitions; problematic themes such as knowledge, semantics, motivations and intentions of the sender and/or receiver, etc., were avoided altogether.

For several decades, Information Theory continued to exist as a subset of the theory of reliable communication. Some classical and highly regarded texts on the subject are Gallager, Ash, Viterbi and Omura, and McEliece.
Read more ›
Was this review helpful to you?
10 of 10 people found the following review helpful
5.0 out of 5 stars Updated, reorganized, expanded Second Edition March 24, 2007
Format:Hardcover
The preface of this book says, 'This is intended to be a simple and accessible book on information theory.' That's true, but it is aimed at the senior year or early graduate level where a theoretical background is needed for computer science, communications engineering, applied mathematics or similar fields. The mathematical nature of the book says that the student should at least have a background through calculus and a couple of upper level courses in statistics/probability. After all, Information Theory is generally considered to be a branch of applied mathematics.

On the whole, the writing style of the book (other than the equasions) is rather light and entertaining. For instance his discussion on the similarities between gambling and data compression brings a rather complex notion down something we can identify - that's before he gets into the math of course.

One complaint about the first edition of the book was that it didn't have enough problems for the student. This has been solved by the addition of a couple of hundred additional problems. There is also a dedicated web site for this book with more material, including solutions to selected problems.
Comment | 
Was this review helpful to you?
14 of 16 people found the following review helpful
3.0 out of 5 stars A good survey of Information Theory February 7, 2007
Format:Hardcover
Elements of Information Theory was the book I used in graduate school. It takes a topical approach to the subject from standard topics like source and channel coding, esoteric concepts like Kolmogorov complexity, to applied topics like how to get rich by applying Information theory to horse racing and the stock market. Overall I thought it was a good book. It is well written and exposes the grandure of subject. However what it provides in bredth it takes away in depth. Several topics, including fundemental ones like entropy, while well illustrated are not at all motivated - they are just given as definitions. In this I feel Galleghers book is superior. Also there is a real dearth of problems, its unusual to do all the problems in a book and feel you have not done enough to understand the material. Many a time I found myself scouring the web for more problems to augment the ones provided. So if you are looking for a broad view of the subject of information theory, this is the book to buy. If you are looking for a deeper understanding of the fundamental topics get Gallegher.
Comment | 
Was this review helpful to you?
2 of 2 people found the following review helpful
5.0 out of 5 stars Very solid introductory book on information theory April 21, 2008
Format:Hardcover|Verified Purchase
I give this book five stars for its outstanding clarity, thoroughness, and choice of topics. The writing is excellent, and most topics are easy to understand, although I have a few isolated quibbles about how certain topics are presented.

I feel like the chapters on continuous channels are much tougher to understand and less intuitive than the chapters on discrete channels.

The exercises are very useful, but in my opinion, a bit too easy. There are lots of exercises at the end of each chapter, but there are very few that require deep thinking or creative insight. Most of the exercises are fairly routine. I think a few more involved ones would be welcome.

The one thing that is most lacking in this book are examples. The bulk of the text is made up in exposition of new ideas and proofs of theorems. While the exercises give lots of examples, I still feel that something is missing--especially in the chapters on continuous channels.

As a supplement, I would recommend "Information Theory, Inference, and Learning Algorithms" by MacKay. The two books are very different from each other and have less overlap than one might expect; I think everyone would do well to study both books. That book is much more suitable for self-study, has more concrete examples, and is in my opinion more fun and interesting (which says a lot, because this book is itself quite fun and interesting). It also has some more involved exercises. Also, it covers coding theory in more depth than this book (something that one might not realize from its name), and it integrates a Bayesian perspective into things more deeply.
Comment | 
Was this review helpful to you?
Most Recent Customer Reviews
5.0 out of 5 stars Exceeds Expectations
I recommend this product to anyone studying Information Theory. It is very clear and uses modern nomenclature. Read more
Published 4 months ago by Victor P. Allard
5.0 out of 5 stars Jedota
The book is very ínteresting and clear!!
El libro es muy bueno e interesante!!!
Lo recomiendo 100 % !! .
Published 6 months ago by juan tapia farias
3.0 out of 5 stars Not the best book on the subject
It may be the only book on the subject. good luck finding another. Material is covered very loosley with no examples at all.
Published 6 months ago by Biff
3.0 out of 5 stars Good book, but not instructive and intuitive
This book is a classic material for studying information theory, and it is a good book in general. However, there are many places in this book where you will find the... Read more
Published 8 months ago by hip
5.0 out of 5 stars Supurb account of a subject of growing importance
Authoritative, comprehensive, clearly written, nicely produced. Valuable bibliography (608 entries). Serves needs both of non-expert readers as well as specialists.
Published 9 months ago by Nicholas Wheeler
4.0 out of 5 stars Great reference on the topic
The authors are the main reference in information theory and present it in a good paced book. Really liked it.
Published 16 months ago by Rafael G. C. Pinto
5.0 out of 5 stars excellent service
The book came quickly, in two layers of bubble wrap and a layer of paper. Looking at the book, the only way you can tell it's used is that the outside of the book has the... Read more
Published on May 4, 2012 by mkurtz
5.0 out of 5 stars Inspiring Introduction to an Inspiring Subject
This classic text on Information Theory is one of the best scientific book I have read to date. If I have to be completely honest, part of the book's success is well due to the... Read more
Published on March 23, 2012 by const
2.0 out of 5 stars Frustrating
They often use (or overload) notation without first defining it, leaving the reader to guess at what they mean. Read more
Published on December 10, 2011 by D. J. Peacock
5.0 out of 5 stars Information theory
The book is nice! It goes through the information theory contents with significant and easy-to-handle examples. Read it!
Published on October 21, 2010 by Yuchen
Search Customer Reviews
Search these reviews only





Forums

There are no discussions about this product yet.
Be the first to discuss this product with the community.
Start a new discussion
Topic:
First post:
Prompts for sign-in
 



Look for Similar Items by Category