Building Linux Clusters [Paperback]

David HM Spector (Author)

Book Description

Publication Date: July 2000

One approach to building supercomputers is to interconnect any number of common PCs using an interface like Ethernet. This method, called clustering or "Beowulf" clustering, produces very inexpensive powerful computers whose capabilities would previously have cost millions of dollars. Now for a few tens of thousands of dollars, very powerful computers can be built for any number of computing solutions. From scientific applications to transaction processing, clustering technology provides an affordable, scalable computing solution.

Building Linux Clusters introduces the reader to the basics of cluster installation and configuration, and comes complete with a CD full of cluster installation programs and tools for parallel programming. Focusing on the "how to" of building a Linux cluster, this book is a hands-on guide for people new to clustering. It is the definitive guide to scaling Linux for scientific and enterprise applications.

Editorial Reviews

Amazon.com Review

Given that computers are a creation/projection of the human spirit, it is no surprise that they work against each other more often than not. Clients compete for the attention of servers, networks drain each other's bandwidth, and firewalls repel packet storms. But, just as system design mirrors our own greed, so too can it capture our Utopian dream that the whole is greater than the sum of the parts. Enter clusters, computer networks whose interconnectivity and communication protocols are interwoven so closely that the network can be used to solve single problems.

Author David Spector and the editors at O'Reilly achieve rare hacker-text synergy in recounting the adventure and in teaching the methods of networked hardware/software clusters in Building Linux Clusters, an extended how-to on coupling Linux boxes of all flavors (Alphas, Suns, 486 Intels, Pentiums) to work synchronously to compete with a multimillion-dollar supercomputer. Currently, the 62nd-fastest computer in the world is CPlant, a Linux cluster at Sandia National Labs (www.top500.org). The CPlant cluster is the equivalent of 1890 Intel-based Linux boxes that are running an expanded version of Don Becker's freely redistributable Beowulf platform for cluster operation.

The review of cluster building begins on hands and knees with an overview of networking basics: IP addressing and routing. Bandwidth and CPU-CPU timing requirements can be limiting factors; and, because interdependency is essential, proper design requires a weak-link analysis that establishes the compatibility of CPUs, buses, hard drives, Ethernet cards, hubs, switches, and routers. Strategies for cluster sizes from a few to several hundred are discussed.

In the book's second half, Spector turns his attention to cluster programming and applications, and describes tools, languages (where FORTRAN is still well regarded), libraries, and environments for parallel programming. Also, he gives examples of parallel virtual machines that serve MP3, persistence-of-vision graphics, and Web data to other devices or applications. Four brief appendices provide the essential technical details: an annotated Webography, a message-passing application programming interface, installation scripts for starting up the cluster of nodes at boot time, and a database to administer the activity of the nodes.

The fast pace and light pedantic touch in this book illuminate complexities and engender an excitement in the idea that new capabilities are yet to be found, if we all could just get along. --Peter Leopold

About the Author

David HM Spector is an independent software developer and computer-networking specialist. He has been in the information service and delivery business for more than 13 years specializing in network design, electronic mail and firewall/network security systems. His work has earned him profiles in numerous publications, including Fortune Magazine, Information Week, Communications Week, and Business Week.

Product Details

• Paperback: 360 pages
• Publisher: O'Reilly Media; Pap/Cdr edition (July 2000)
• Language: English
• ISBN-10: 1565926250
• ISBN-13: 978-1565926257
• Product Dimensions: 9.1 x 7 x 0.9 inches
• Shipping Weight: 1.3 pounds
• Average Customer Review: 2.6 out of 5 stars  See all reviews (13 customer reviews)
• Amazon Best Sellers Rank: #1,809,363 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

14 of 14 people found the following review helpful:

1.0 out of 5 stars Deception or Incompetence?, November 17, 2000

By 

"neilradicic" (Seoul, Korea) - See all my reviews

This review is from: Building Linux Clusters (Paperback)

Buyer Beware! Having tried to actually build a linux cluster using David Spector's book - I am disappointed and concerned. I wish to add to the other negative reviews (has there been a positive review?) and submit the proposal that either the author is only out to sell books under the false pretense that his "How To" book can actually lead the reader to success, knowing that the instructions and software enclosed don't work; or that he has attempted to publish a book based on limited subject matter understanding of building linux clusters. Deception or Incompetence...or maybe just poor editing? I do want to try and make this linux cluster thing actually work so if anyone out there has encountered problems and has overcome them, please send me an email. This invitation also extends to the author, David Spector, of course.

11 of 11 people found the following review helpful:

3.0 out of 5 stars Perhaps a good Intro, September 5, 2000

By 

D. Whiting (Carlsbad, CA USA) - See all my reviews
(REAL NAME)   

This review is from: Building Linux Clusters (Paperback)

The beginning of this book is a great introduction to clustering of various types but slowly declinced in usefulness the further I read.

Let me back up a step or two.. My work wanted me to build a Beowulf cluster to have on hand for a possible product down the line. At the time this book was not available so I resorted to reading all I could online in the form of FAQ's, HOW-TO's and general information sites. They were very informative and gave me a good base and reference when it came to building the cluster.

While I was building the cluster, I finally received this book and was rather disappointed. The beginning was great, but the chapters regarding software to run the cluster were terrible. Too many pages were spent talking about cluster administration using -one- software package and installation instructions were too rudimentary. I figure, if you don't know how to install RedHat, you shouldn't be building a Beowulf cluster. There was also very little info about creating applications for the cluster. The book -is- titled Building Linux Clusters, but what good is a cluster without any software to run on it.

I guess I make it sound worse than it really is but the previous reviews make it sound better than it is. It's a great introduction to Beowulf clusters but coming from someone that built one, read as much as you can about clusters online, read this book, then just build one from the ground up. Don't use the included software the first time around. It may be a pain to setup at first, but once it works and comes time to building applications or using it for something useful, you'll be glad.

10 of 10 people found the following review helpful:

5.0 out of 5 stars The Author Responds, April 19, 2004

By 

David HM Spector (Huntington, NY USA) - See all my reviews
(REAL NAME)   

This review is from: Building Linux Clusters (Paperback)

While I can sympathize with some readers who may have been expecting a different book that covered the topic of cluster building in a different way, I would like to respond with several facts to clarify issues surrounding "Building Linux Clusters":

1) The book, as published, is not the final draft given to the editors at O'Reilly. When the book was ready to be put into O'Reilly's publishing system the then-editor of this series left to pursue a career at VALinux; the copy of the book put into the system is missing was over 2 months old and missing 50-100 pages of changes/additions/updates and other corrections that are not reflected in the printed book. This was discovered by me only when the book was delivered to stores -- at which time (obviously) it was too late to do anything about it.

2) Despite the issues surrounding which version of the book went into production, the book sold over 10,000 copies out of a printing of 12,000: O'Reilly decided not to issue a 2nd edition for a number of reasons, including the fact that many of the facilities I documented in the book (such as MPI, PVM and tools for cluster management, parallel rendering, etc.) were subsequently available pre-installed in many major Linux distributions which obviated the need for a dedicated book on cluster building.

3) Many, many readers have had great success with the book and have written to tell me so, including several readers who were able to build 100+ node clusters in a matters of a few hours using the software provided with the book.

4) A large number of software-related problems experienced by readers came about as readers attempted to build new distributions (RedHat7, RedHat8, etc.) based on the original software (based on RedHat6.2) provided with the book. Where possible I proved many hundred of hours of assistance to such readers.

5) Updated software and other tools were made available both at O'Reilly's web site as well as my own to help readers who found that certain tools would not work on their configurations and have been downloaded and successfully used thousands of times.