Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation [Hardcover]

George Em Karniadakis (Author), Robert M. Kirby II (Author)

Book Description

Publication Date: June 16, 2003

This book provides a seamless approach to numerical algorithms, modern programming techniques and parallel computing. These concepts and tools are usually taught serially across different courses and different textbooks, thus observing the connection between them. The necessity of integrating these subjects usually comes after such courses are concluded (e.g., during a first job or a thesis project), thus forcing the student to synthesize what is perceived to be three independent subfields into one in order to produce a solution. The book includes both basic and advanced topics and places equal emphasis on the discretization of partial differential equations and on solvers. Advanced topics include wavelets, high-order methods, non-symmetric systems and parallelization of sparse systems. A CD-ROM accompanies the text.

Editorial Reviews

Review

'This book is a valuable addition to the literature on numerical algorithms.' Numerical Algorithms

'There is plenty of material for a two-semester sequence, or selected chapters could be used for a one-semester course on numerical linear algebra. The presentation is clear, practical, and lively ... this text would be a very useful reference for statistics students and professionals) seeking to take their statistical computing skills into the parallel realm.' Journal of the American Statistical Association

Book Description

This book provides a seamless approach to numerical algorithms, modern programming techniques, and parallel computing. Such concepts and tools are often taught serially across different courses and different textbooks, and hence the interconnection between them is not immediately apparent.The book includes both basic as well as advanced topics and places equal emphasis on the discretization of partial differential equations and on solvers. Some of the advanced topics include wavelets, high-order methods, non-symmetric systems, and parallelization of sparse systems.

Product Details

• Hardcover: 628 pages
• Publisher: Cambridge University Press (June 16, 2003)
• Language: English
• ISBN-10: 0521817544
• ISBN-13: 978-0521817547
• Product Dimensions: 9.2 x 8 x 1.3 inches
• Shipping Weight: 2.8 pounds
• Average Customer Review: 4.0 out of 5 stars  See all reviews (3 customer reviews)
• Amazon Best Sellers Rank: #4,278,493 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

14 of 14 people found the following review helpful:

3.0 out of 5 stars Should be improved., February 19, 2006

By 

Bojan Niceno (Switzerland) - See all my reviews
(REAL NAME)   

This review is from: Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation (Paperback)

The authors attempted to combine introductory material in C++, numerical methods and parallel computing. That is quite a brave endevaour. They certainly break the new ground writing an introductory material for a "simulation scientist", but I believe they have achieved mixed success.

On the one hand, the material they present on all subjects is really top quality, packed with 100% usefull information. Bibliography is also very good and usefull. But the organisation of the book is quite confusing. They introduce all the topics toogether - throughtout the book. Hence each chapter introduces some numerical algorithms, few new concepts in C++ and eventually MPI. I beleive a novice would experience serious difficulties following it. For example, authors introduce objects before introducing curly braces "{}" as scope delimiters and before semicolon ";" as statement delimiters.

Further, very soon after introducung the very basic concepts in C++, the authors move on to BLAS. BLAS is usefull, of course, but a novice in C++ may wonder why does he needs libraries written in Fortran, if C++ is a language of the choice for numerical computations. (At least it is claimed so by the authors).

Another confusing example is the one of memory memory access. In section 2.2.6 Memory Management, (pg. 41) the authors introduce basic concepts of memory management and how can loop constructs influence the efficiency of the code. Very usefull indeed, no question about it. But very soon bellow, in section 2.2.8 Exploiting the Structure of the Sparse Matrices, they come up with the claim (pg. 58): "... optimization-savy individuals, as the old saying goes, often miss the forest for the threes" :-( Hence, a novice reader might think: "Well, why do I need to worry about the memory management explained just 17 pages above?".

My most serious critic of this book by far (and I hope the authors will read this) are the contents pages. The contents list only chapters and first level sub-chapters. Secind level chapters are not present!!! That makes the book very hard to use as a reference material. That is really a pitty, since there is some good material in it which is hard to find and might stay hidden. (For example, the chapter I mentioned above: 2.2.6 Memory management is NOT in the contents, so I had to browse slowly throught the book to find it and refer it here). I suggest the authors introduce: "Contents at a glance" (the present one) and a "Detailed Contents", where one could find references to all the chapters in the book. The contents is THE reason why I gave this book 3 stars instead of 4. One it lost on the confusing organisation of the book.

I think the authors should have organised the book in four parts: 1 - Numerical algorithms, 2 - C++ and 3 - Parallel computing with MPI, 4 - Advanced topics. Part 1 could introduce numerical algorithms and have pointers to their implementations in Part 2 and corresponding parallel implementations in Part 3. Part 2 and 3 could have started with introductions, which a reader already familiar with those subjects, could skip. Part 4, could bring advanced topics, such as optimisation, BLAS, etc.

Bottom line, it is:

- brave and usefull endevaour,
- full of excellent material,
- organized confusingly,
- and has a very poor contents.

Buy it if you are simulation scientist or teacher, but prepare to struggle with its organisation and contents.

10 of 10 people found the following review helpful:

4.0 out of 5 stars Great book to get acquainted with numerical analysis, June 1, 2005

By 

Andy R. Terrel (Chicago, IL) - See all my reviews
(REAL NAME)   

This review is from: Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation (Paperback)

This book is great in describing some of the most important concepts and algorithms needed for the beginning numerical analyst. The book claims that it can be picked up by a complete novice and teach C++, MPI, and scientfic computing. I would say that the math goes very quickly and not quite as rigorous as necessary for the typical novice. The C++ is pretty basic but still the book leaves the reader a sense of confusion. This is largely because the book treats a large amount of the library functions as black boxes. The MPI starts very basic and gradually introduces the major concepts.

My recommendation for anyone reading the book is to supplement it with a good linear algebra book (such as Demmel) and book on C++ (The C++ programming language). For further study on MPI, Using MPI would be a good supplement. That way whenever you have a concept that isn't fully described, you have a source to get it from.

The book gets a high rating for going over the right content and doing so in a applied manner that gives the reader the skills to become a numerical analyst.

3 of 3 people found the following review helpful:

5.0 out of 5 stars Combining mathematics with modern computing, September 29, 2005

By 

Janusz S. Kowalik - See all my reviews
(REAL NAME)   

This review is from: Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation (Paperback)

The book contains advanced numerical mathematics algorithms and
fundamental elements of parallel computation.
It will be useful for those academic instructors who believe that students should be shown the entire solution process
from mathematical problem definition to computer implementation. It has been used as a textbook at several leading American and European universities.
The authors professors Karniadakis and Kilby are innovators who demonstrate that combining education of applied mathematics with computer science is possible and extremely useful for students and their future employers.