Parallel and Distributed Computation: Numerical Methods (Optimization and Neural Computation) [Paperback]

Dimitri P. Bertsekas (Author), Dimitri P Bertsekas (Author), John Tsitsiklis (Author), Dimitri P Bertsekas (Author), John Tsitsiklis (Author)

Book Description

Series: Optimization and Neural Computation | Publication Date: January 1, 1997

This highly acclaimed work, first published by Prentice Hall in 1989, is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the fundamental convergence, rate of convergence, communication, and synchronization issues associated with such algorithms. This is an extensive book, which aside from its focus on parallel and distributed algorithms, contains a wealth of material on a broad variety of computation and optimization topics. Among its special features, the book: 1) Quantifies the performance of parallel algorithms, including the limitations imposed by the communication and synchronization penalties. 2) Describes communication algorithms for a variety of system architectures including tree, mesh, and hypercube. 3) Provides a comprehensive convergence analysis of asynchronous methods and a comparison with their asynchronous counterparts. 4) Covers direct and iterative algorithms for linear and nonlinear systems of equations and variational inequalities. 5) Describes optimization methods for nonlinear programming, shortest paths, dynamic programming, network flows, and large-scale decomposition. 6) Includes extensive research material on optimization methods, asynchronous algorithm convergence, rollback synchronization, asynchronous communication network protocols, and others. 7) Supplements the text material with many exercises, whose complete solutions are posted on the internet. 8) Contains a lot of material not found in any other book.

Editorial Reviews

Review

This book marks an important landmark in the theory of distributed systems and I highly recommend it to students and practicing engineers in the fields of operations research and computer science, as well as to mathematicians interested in numerical methods. --L. Mason, IEEE Communications Magazine

This major contribution to the literature belongs on the bookshelf of every scientist with an interest in computational science, directly beside Knuth's three volumes and Numerical Recipes... --A. Nagurney, Int. J. of Supercomputer Appl

This major work of exceptional scholarship summarizes more than three decades of research into general-purpose algorithms for solving systems of equations and optimization problems --W. F. Smyth, Computing Reviews

About the Author

The authors are Professors of Electrical Engineering and Computer Science at the Massachusetts Institute of Technology, and are members of the National Academy of Engineering.

Product Details

• Paperback: 718 pages
• Publisher: Athena Scientific; 1 edition (January 1, 1997)
• Language: English
• ISBN-10: 1886529019
• ISBN-13: 978-1886529014
• Product Dimensions: 9.2 x 7 x 1.9 inches
• Shipping Weight: 3 pounds (View shipping rates and policies)
• Average Customer Review: 5.0 out of 5 stars  See all reviews (1 customer review)
• Amazon Best Sellers Rank: #1,156,087 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

2 of 4 people found the following review helpful:

5.0 out of 5 stars Great Book, April 2, 2000

By A Customer

Amazon Verified Purchase

This review is from: Parallel and Distributed Computation: Numerical Methods (Optimization and Neural Computation) (Paperback)

Excellent book. I agree with much of the editorial review. I have found this book very useful for my work in distributed computation. The authors are thorough and exact in their work and rely heavily on matrix and probabilistic methods for their results. If you are into parallel and distributed algorithms, then this is a must have book.