The Nature of Statistical Learning Theory (Hardcover)

~ Vladimir N. Vapnik (Author) "More than thirty five years ago F. Rosenblatt suggested the first model of a learning machine, called the perceptron; this is when the mathematical analysis..." (more)
Key Phrases: generalized growth function, local learning approach, linear indicator functions, Postal Service, New York (more...)

Editorial Reviews

Review

"This interesting book helps a reader to understand the interconnections between various streams in the empirical modeling realm and may be recommended to any reader who feels lost in modern terminology." V.V. Fedorov, Oak Ridge National Laboratory, USA

Product Description

The aim of this book is to discuss the fundamental ideas which lie behind the statistical theory of learning and generalization. It considers learning from the general point of view of function estimation based on empirical data. Omitting proofs and technical details, the author concentrates on discussing the main results of learning theory and their connections to fundamental problems in statistics. These include: - the general setting of learning problems and the general model of minimizing the risk functional from empirical data - a comprehensive analysis of the empirical risk minimization principle and shows how this allows for the construction of necessary and sufficient conditions for consistency - non-asymptotic bounds for the risk achieved using the empirical risk minimization principle - principles for controlling the generalization ability of learning machines using small sample sizes - introducing a new type of universal learning machine that controls the generalization ability.

Product Details

• Hardcover: 188 pages
• Publisher: Springer; 1st ed. 1995. Corr. 2nd printing edition (December 14, 1998)
• Language: English
• ISBN-10: 0387945598
• ISBN-13: 978-0387945590
• Product Dimensions: 9.8 x 6.8 x 0.8 inches
• Shipping Weight: 1.1 pounds
• Average Customer Review: 4.2 out of 5 stars  See all reviews (5 customer reviews)
• Amazon.com Sales Rank: #2,457,983 in Books (See Bestsellers in Books)

  Popular in this category: (What's this?)

  #21 in

  Books > Computers & Internet > Computer Science > Artificial Intelligence > Cybernetics

Customer Reviews

Most Helpful Customer Reviews

14 of 14 people found the following review helpful:

5.0 out of 5 stars A very nice book to get ideas on support vector machines, August 27, 2000

By	DataGuru (DC) - See all my reviews

This review is from: The Nature of Statistical Learning Theory (Information Science and Statistics) (Hardcover)

This is a very readable book by an authority on this subject. The book starts with the statistical learning theory, pioneered by the author and co-worker's work, and gradually leads to the path of discovery of support vector machines. An excellent and distinctive property of support vector machines is that they are robust to small data perturbation and have good generalization ability with function complexity being controlled by VC dimension. The treatment of nonlinear kernel classification and regression is given for the first time in the first edition. The 2nd edition includes significant updates including a separate chapter on support vector regression as well as a section on logistic regression using the support vector approach. Most computations involved in this book can be implemented using a quadratic programming package. The connections of support vector machines to traditional statistical modeling such as kernel density and regression and model selection are also discussed. Thus, this book will be an excellent starting point for learning support vector machines.

19 of 22 people found the following review helpful:

3.0 out of 5 stars worth reading, September 21, 2001

By	a reather presumptous reader (NY) - See all my reviews

This review is from: The Nature of Statistical Learning Theory (Information Science and Statistics) (Hardcover)

A good, albeit highly idiosyncratic, guide to Statistical Learning. The highly personal account of the theory is both the strong point and the drawback of the treatise. On one side, Vapnick never loses sight of the big picture, and gives illuminating insights and formulations of the "basic problems" (as he calls them), that are not found in any other book. The lack of proofs and the slightly erratic organization of the topic make for a brisk, enjoyable reading. On the minus side, the choice of the topics is very biased. In this respect, the book is a self-congratulatory tribute by the author to himself: it appears that the foundations of statistical learning were single-handedly laid by him and his collaborators. This is not really the case. Consistency of the Empircal Risk Measure is rather trivial from the viewpoint of a personal trained in asymptotic statistics, and interval estimators for finite data sets are the subject of much advanced statistical literature. Finally, SVMs and neural nets are just a part of the story, and probably not the most interesting.
In a nutshell, what Vapnick shows, he shows very well, and is able to provide the "why" of things as no one else. What he doesn't show... you'll have to find somewhere else (the recent Book of Friedman Hastie & Tibs is an excellent starting point).
A last remark. The book is rich in grammatical errors and typos. They could have been corrected in the second edition, but do not detract from the book's readability.

16 of 23 people found the following review helpful:

5.0 out of 5 stars A research field described by the man who invented it, February 24, 2000

By	"bernhard_schoelkopf" (Tuebingen Germany) - See all my reviews

This review is from: The Nature of Statistical Learning Theory (Information Science and Statistics) (Hardcover)

Vapnik and collaborators have developed the field of statistical learning theory underlying recent advances in machine learning and artificial intelligence (e.g. support vector machines). This book almost accomplishes the formidable task of comprehensibly describing the essential ideas of learning theory to non-statisticians. It contains ample theorems but almost no proofs.