The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition (Springer Series in Statistics) [Hardcover]

Trevor Hastie (Author), Robert Tibshirani (Author), Jerome Friedman (Author)

Book Description

ISBN-10: 0387848576 | ISBN-13: 978-0387848570 | Publication Date: February 9, 2009 | Edition: 2nd ed. 2009. Corr. 3rd printing 5th Printing.

During the past decade there has been an explosion in computation and information technology. With it have come vast amounts of data in a variety of fields such as medicine, biology, finance, and marketing. The challenge of understanding these data has led to the development of new tools in the field of statistics, and spawned new areas such as data mining, machine learning, and bioinformatics. Many of these tools have common underpinnings but are often expressed with different terminology. This book describes the important ideas in these areas in a common conceptual framework. While the approach is statistical, the emphasis is on concepts rather than mathematics. Many examples are given, with a liberal use of color graphics. It is a valuable resource for statisticians and anyone interested in data mining in science or industry. The book's coverage is broad, from supervised learning (prediction) to unsupervised learning. The many topics include neural networks, support vector machines, classification trees and boosting---the first comprehensive treatment of this topic in any book. This major new edition features many topics not covered in the original, including graphical models, random forests, ensemble methods, least angle regression & path algorithms for the lasso, non-negative matrix factorization, and spectral clustering. There is also a chapter on methods for ``wide'' data (p bigger than n), including multiple testing and false discovery rates.

Editorial Reviews

Review

From the reviews: "Like the first edition, the current one is a welcome edition to researchers and academicians equally…. Almost all of the chapters are revised.… The Material is nicely reorganized and repackaged, with the general layout being the same as that of the first edition.… If you bought the first edition, I suggest that you buy the second editon for maximum effect, and if you haven’t, then I still strongly recommend you have this book at your desk. Is it a good investment, statistically speaking!" (Book Review Editor, Technometrics, August 2009, VOL. 51, NO. 3) From the reviews of the second edition: "This second edition pays tribute to the many developments in recent years in this field, and new material was added to several existing chapters as well as four new chapters … were included. … These additions make this book worthwhile to obtain … . In general this is a well written book which gives a good overview on statistical learning and can be recommended to everyone interested in this field. The book is so comprehensive that it offers material for several courses." (Klaus Nordhausen, International Statistical Review, Vol. 77 (3), 2009)

From the Back Cover

During the past decade there has been an explosion in computation and information technology. With it have come vast amounts of data in a variety of fields such as medicine, biology, finance, and marketing. The challenge of understanding these data has led to the development of new tools in the field of statistics, and spawned new areas such as data mining, machine learning, and bioinformatics. Many of these tools have common underpinnings but are often expressed with different terminology. This book describes the important ideas in these areas in a common conceptual framework. While the approach is statistical, the emphasis is on concepts rather than mathematics. Many examples are given, with a liberal use of color graphics. It is a valuable resource for statisticians and anyone interested in data mining in science or industry. The book's coverage is broad, from supervised learning (prediction) to unsupervised learning. The many topics include neural networks, support vector machines, classification trees and boosting---the first comprehensive treatment of this topic in any book. This major new edition features many topics not covered in the original, including graphical models, random forests, ensemble methods, least angle regression and path algorithms for the lasso, non-negative matrix factorization, and spectral clustering. There is also a chapter on methods for ``wide'' data (p bigger than n), including multiple testing and false discovery rates. Trevor Hastie, Robert Tibshirani, and Jerome Friedman are professors of statistics at Stanford University. They are prominent researchers in this area: Hastie and Tibshirani developed generalized additive models and wrote a popular book of that title. Hastie co-developed much of the statistical modeling software and environment in R/S-PLUS and invented principal curves and surfaces. Tibshirani proposed the lasso and is co-author of the very successful An Introduction to the Bootstrap. Friedman is the co-inventor of many data-mining tools including CART, MARS, projection pursuit and gradient boosting.

See all Editorial Reviews

Product Details

• Hardcover: 768 pages
• Publisher: Springer; 2nd ed. 2009. Corr. 3rd printing 5th Printing. edition (February 9, 2009)
• Language: English
• ISBN-10: 0387848576
• ISBN-13: 978-0387848570
• Product Dimensions: 9.2 x 6.2 x 1.5 inches
• Shipping Weight: 3.1 pounds (View shipping rates and policies)
• Average Customer Review: 4.0 out of 5 stars  See all reviews (45 customer reviews)
• Amazon Best Sellers Rank: #10,708 in Books (See Top 100 in Books)
  • #2 in Books > Professional & Technical > Professional Science > Biological Sciences > Bioinformatics
  • #2 in Books > Crafts, Hobbies & Home > How-to & Home Improvements > Plumbing & Household Automation
  • #2 in Books > Computers & Technology > Databases > Data Mining

Customer Reviews

Most Helpful Customer Reviews

66 of 67 people found the following review helpful:

4.0 out of 5 stars The Elements of Statistical Learning, November 12, 2004

By 

R. Krause (Tempe, AZ) - See all my reviews
(REAL NAME)   

This review is from: The Elements of Statistical Learning (Hardcover)

The book is written by some of the biggest names currently in the field, and thus is written at a certain level, this isn't a fault of the book or the authers, but rather it was written for a specific audience. However I did find it odd when they would occassionally explain basic readily known notation, but later on assume the reader is familiar with what I would regard as advanced notation, or leave out quite a few steps in their mathematics assuming the reader understands what they did. This book covers a wide range of techniques ranging from the more traditional to the current, and for each topic presents an overview of the technique and provides adequate references for further exploration.

The reader should have a good underlying understanding of linear algebra, statistics and probability theory and also be familiar with the techniques presented here. This book was used in a graduate engineering data mining class, and most of us struggled greatly with the book. This book probably would have been more appropriate if this was a book to augment another text, or if this had not been the first time we had seen topics such as those presented, this being the book to explain neural networks, support vector machines and whatnot when you've never seen them before makes for a very bewildering experience, but once you find a few journal articles the techniques actually are fairly easy to understand.

The book does not explain how to implement using software any of the techniques, this is a topic left up to other books, such as Modern Applied Statistics with S by Ripley and Venerables, and only in their discussion about apriori for association rules did I see that they state a software package. It would have been nice if they would have given some insight into how they created some of the great graphics that punctuate the book, perhaps as additional material on the website.

A book that is more down to earth for engineers, albeit different in scope, would be Duda and Hart's Pattern Classification, which I believe are electrical engineers and written more from an engineering standpoint. In addition the Duda and Hard book gives a lot of applications-based problems and has an associated MATLAB handbook to walk readers through building many types of learners, while this book the end-of-chapter excercises are almost exclusively proofs and theoretical excercises. Not a fault of the book, but rather just a difference and depends on what the reader wants to get out of it.

Ultimately, even though it did prove to be a rather confusing book, I have learned a lot from it and will continue to go through it to learn even more from it as it does tend to become more lucid the more I go through it.

100 of 106 people found the following review helpful:

5.0 out of 5 stars Useful book on data mining, February 6, 2002

By 

frank lindemann - See all my reviews
(REAL NAME)   

Amazon Verified Purchase

This review is from: The Elements of Statistical Learning (Hardcover)

I use data mining tools in my financial engineering and financial modeling work and I have found this book to be very useful. This book provides two crucial types of information. First, it provides enough theory to allow a potential user to understand the essential insights that motivate specific techniques and to evaluate the situations in which those technique are appropriate. Second, the book gives the exact algorithms to implement the various techniques.
While no book I have seen covers every data mining methodology available, this one has the strongest coverage I have seen in additive models, non-linear regression, and CART/MART (regression/classification trees). It also has very strong coverage in many other areas. I highly recommend it.

53 of 56 people found the following review helpful:

4.0 out of 5 stars The Elements of Statistical Learning, December 18, 2001

By A Customer

This review is from: The Elements of Statistical Learning (Hardcover)

The book by Hastie, Tibshirani and Friedman is a welcome
addition to the quickly growing area of machine learning
and data mining. This is a well written book, laid out
nicely with excellent examples by 3 well established
researchers in the field. It will be helpful to those
who are interested in learning about this field, as well
as experts who want to know more

My only complaint is that although the authors do
make an honest attempt to clearly highlight methods
that are based on their own research,
often this distinction becomes cloudy and the reader
is left with the impression that the methods
advocated are often the best and represent
the standard in the industry. In fact many of
their ideas are only heuristic and it is more than
conceivable that these will eventually be superseeded
with better methods.

A good book, which gets you up to speed in the literature
but it will only be relevant for a few years.