Statistical Methods for Speech Recognition (Language, Speech, and Communication) [Hardcover]

Frederick Jelinek (Author)

Book Description

ISBN-10: 0262100665 | ISBN-13: 978-0262100663 | Publication Date: January 16, 1998

This book reflects decades of important research on the mathematical foundations of speech recognition. It focuses on underlying statistical techniques such as hidden Markov models, decision trees, the expectation-maximization algorithm, information theoretic goodness criteria, maximum entropy probability estimation, parameter and data clustering, and smoothing of probability distributions. The author's goal is to present these principles clearly in the simplest setting, to show the advantages of self-organization from real data, and to enable the reader to apply the techniques.

Editorial Reviews

Review

"For the first time, researchers in this field will have a bookthat will serve as the bible' for many aspects of language andspeech processing. Frankly, I can't imagine a person working in thisfield not wanting to have a personal copy." Victor Zue , MIT Laboratory for Computer Science

About the Author

Frederick Jelinek is Professor of Electrical and Computer Engineering and Director of the Center for Language and Speech Processing at Johns Hopkins University. For over twenty years he led the IBM Continuous Speech Recognition Group.

Product Details

• Hardcover: 305 pages
• Publisher: A Bradford Book (January 16, 1998)
• Language: English
• ISBN-10: 0262100665
• ISBN-13: 978-0262100663
• Product Dimensions: 9.2 x 6.4 x 0.8 inches
• Shipping Weight: 1.2 pounds (View shipping rates and policies)
• Average Customer Review: 4.9 out of 5 stars  See all reviews (7 customer reviews)
• Amazon Best Sellers Rank: #843,800 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

22 of 22 people found the following review helpful:

5.0 out of 5 stars Thorough Overview of Stats and Algorithms for Speech Rec, December 12, 2001

By 

Bob Carpenter (New York, NY) - See all my reviews

This review is from: Statistical Methods for Speech Recognition (Language, Speech, and Communication) (Hardcover)

This book provides a comprehensive introduction to the statistical models and algorithms used for speech recognition. Jelinek sets up the speech recognition problem in the traditional way as the decoding half of Shannon's noisy channel model. While Jelinek glosses over signal processing, he provides an excellent overview of the symbolic stages of processing involved in speech recognition.

After a quick introduction, Jelinek digs into the statistics behind Hidden Markov Models (HMMs), the foundation of almost all of today's speech recognizers. This is followed by chapters devoted to acoustic modeling (probability of acoustics given words) and language modeling (probability of a given sequence of words), and the algorithmic search induced by this model. There are also advanced chapters on fast match (widely used heuristics for pruning search), the Expectation-Maximization (EM) algorithm for training, and the use of decision trees, maximum entropy and backoff for language models. He covers several auxiliary topics including information theory and perplexity, the spelling to phoneme mapping, and the use of triphones for cross-phoneme modeling. Each chapter is a worthy introduction to an important topic.

This book does not presuppose much in the way of mathematical, computational, or linguistic background. A simple intro to probability and some experience with search problems would be of help, but isn't necessary -- you'll learn a lot about these topics reading the book.

All in all, this is the best thorough introduction to speech recognition that you can find. Read it along with Manning and Schuetze's "Foundations of Statistical Natural Language Processing" from the same series; there's a little overlap in language modeling, but not much. You might want to start with the gentler book by Jurafsky and Martin, "Speech and Language Processing", before tackling either Jelinek or Manning and Schuetze.

15 of 15 people found the following review helpful:

5.0 out of 5 stars Best speech math book yet!, March 27, 1999

By 

James Salsman ([e-mail]) (Mountain View, California) - See all my reviews

This review is from: Statistical Methods for Speech Recognition (Language, Speech, and Communication) (Hardcover)

This book is simply, as of 1999, the best of its kind, and I expect it will remain a core speech math text for a decade at least. It covers the construction, utilization and refinement of Markov speech models, but doesn't include any accoustic signal processing.

9 of 9 people found the following review helpful:

5.0 out of 5 stars Excellent,Unique Book - Destined to be a Classic, May 15, 2001

By 

Optimistix (New York City) - See all my reviews

This review is from: Statistical Methods for Speech Recognition (Language, Speech, and Communication) (Hardcover)

This book is possibly the first of its kind - exclusively devoted to Statistical Speech Recognition. The author is a pioneer in the area - one of the 'fathers' of the field,as it were. Thus one expects the text to be authoritative, and it is. The 'information density' is very high - it's a small book, but absolutely packed with information. You'll learn a lot about Hidden Markov Models and their use in Speech Recognition, but it also addresses many other issues, like language modelling and grammar, making it much more than a mere 'speech maths' book.

However, this is definitely not meant for absolute newcomers to the field of speech processing, and it does assume some background in advaced mathematics as well, especially in probability.

If you're looking for other aspects of Speech Recognition or code, you've come to the wrong place - but please don't spoil the rating of an excellent book by complaining that it doesn't have what it never promised to :-) - if you want a solid introduction to the field as a whole, i'd suggest 'Fundamentals of Speech Recognition' by Rabiner & Juang, and if it's code that you're looking for, there's lots of excellent open source stuff available on the net, notably from CMU and Cambridge, and there are some recent books in the market exclusively devoted to implementation of speech recognition systems.

To sum up, if you have some exposure to speech recognition and want to learn the maths & concepts behind the Statistical approach to Speech Recognition, this is your book.