Peer-to-Peer : Harnessing the Power of Disruptive Technologies [Hardcover]

Andy Oram (Author)

Book Description

Series: Peer to Peer | Publication Date: March 15, 2001

The term "peer-to-peer" has come to be applied to networks that expect end users to contribute their own files, computing time, or other resources to some shared project. Even more interesting than the systems' technical underpinnings are their socially disruptive potential: in various ways they return content, choice, and control to ordinary users.

While this book is mostly about the technical promise of peer-to-peer, we also talk about its exciting social promise. Communities have been forming on the Internet for a long time, but they have been limited by the flat interactive qualities of email and Network newsgroups. People can exchange recommendations and ideas over these media, but have great difficulty commenting on each other's postings, structuring information, performing searches, or creating summaries. If tools provided ways to organize information intelligently, and if each person could serve up his or her own data and retrieve others' data, the possibilities for collaboration would take off. Peer-to-peer technologies along with metadata could enhance almost any group of people who share an interest--technical, cultural, political, medical, you name it.

This book presents the goals that drive the developers of the best-known peer-to-peer systems, the problems they've faced, and the technical solutions they've found. Learn here the essentials of peer-to-peer from leaders of the field:

• Nelson Minar and Marc Hedlund of target="new">Popular Power, on a history of peer-to-peer
• Clay Shirky of acceleratorgroup, on where peer-to-peer is likely to be headed
• Tim O'Reilly of O'Reilly & Associates, on redefining the public's perceptions
• Dan Bricklin, cocreator of Visicalc, on harvesting information from end-users
• David Anderson of SETI@home, on how SETI@Home created the world's largest computer
• Jeremie Miller of Jabber, on the Internet as a collection of conversations
• Gene Kan of Gnutella and GoneSilent.com, on lessons from Gnutella for peer-to-peer technologies
• Adam Langley of Freenet, on Freenet's present and upcoming architecture
• Alan Brown of Red Rover, on a deliberately low-tech content distribution system
• Marc Waldman, Lorrie Cranor, and Avi Rubin of AT&T Labs, on the Publius project and trust in distributed systems
• Roger Dingledine, Michael J. Freedman, and David Molnar of Free Haven, on resource allocation and accountability in distributed systems
• Rael Dornfest of O'Reilly Network and Dan Brickley of ILRT/RDF Web, on metadata
• Theodore Hong of Freenet, on performance
• Richard Lethin of Reputation Technologies, on how reputation can be built online
• Jon Udell of BYTE and Nimisha Asthagiri and Walter Tuvell of Groove Networks, on security
• Brandon Wiley of Freenet, on gateways between peer-to-peer systems

You'll find information on the latest and greatest systems as well as upcoming efforts in this book.

Editorial Reviews

Amazon.com Review

Peer-to-Peer is a book about an emerging idea. That idea is that the traditional model of participating in the Internet, in which a small computer operated by an everyday user (a "client") asks for and receives information from a big computer administered by a corporation or other large entity (a "server"), is beginning to give some ground to a new (new to the fringes of the Internet, anyway) model called peer-to-peer networking. In peer-to-peer networking, all participants in a network are approximately equal. Furthermore, the participants are usually ordinary computers run by everyday people. The ICQ chat service and the Napster music-sharing community are examples of what this book is about.

The chief advantage of peer-to-peer networks is that large numbers of people share the burden of providing computing resources (processor time and disk space), administration effort, creativity, and--in more than a few cases--legal liability. Furthermore, it's relatively easy to be anonymous in such an environment, and it's harder for opponents of your peer-to-peer service to bring it down. The primary disadvantage of peer-to-peer systems, as anyone will attest who's had an MP3 download prematurely terminated when a dialup user went offline will attest, is the tendency of computers at the edge of the network to fade in and out of availability. Accountability for the actions of network participants is a potential problem, too.

This is a book about the idea of equipping ordinary Internet users' computers with mechanisms that enable them to connect, more or less automatically and without human attention, to other everyday Internet users' machines. By forming networks of computers at the so-called "edge" of the Internet, it's possible to offer valuable services without the burden of building and administering large, centralized computer systems of the sort that host traditional Web sites. Napster is the most successful example to date, though nerds will note that it's not a completely peer-to-peer system because users register their file libraries with a central server when they log on to the service.

Don't approach this book expecting to learn how to build the next Napster system. It's not a how-to book. It's not even much of a why-to book. Rather, it's a book that aims to get its readers thinking about what happens when information systems shift away from the client-server model and toward the peer-to-peer model (that's one of the book's points, by the way, that this is not a one-or-the-other architectural decision).

Mostly, Peer-to-Peer makes its point by letting experts in peer-to-peer take turns in the spotlight. Any other approach would be kind of ironic, wouldn't it? In any case, David Anderson explains how SETI@home puts space buffs' idle computing cycles to use in analyzing radio noise from outer space. Gene Kan explains how Gnutella (a truly serverless environment) works. The architects of Publius explain how distributed computing is especially resistant to censorship and denial-of-service attacks. Other contributors discuss peer-to-peer chat software, anonymous remailing services, and other applications of peer-to-peer design.

There's no one from Napster represented as an author in this collection of essays, but Clay Shirky presents an essay called "Listening to Napster." In that essay, Shirky gives an opinion on why Napster has succeeded: It focused on providing something consumers wanted, and bypassed Internet conventions (like the Domain Naming System) because they weren't the best way to provide the service. This is not an earth-shattering revelation, but it's true, and it's something developers of any new service (Internet-based or otherwise) need to keep in mind.

Some of the technical proposals presented here will get readers thinking. An example: Require that senders of e-mail solve a moderately complex math problem before recipients' mailboxes will accept their mail. The problem would be no big deal for a mailer to solve if he or she were sending messages one at a time, but the processor load would really add up for spammers who blast tens of thousands of unwanted emails onto the Internet in a single session. Another idea: mechanizing the concept of reputation so people know whose thoughts and whose creative works (like software) are worth using or believing.

More business-oriented readers might want to read more about the more subtle ways of incorporating peer-to-peer components into business models. Lots of traditional Web services--Amazon.com is an example--are supplementing their client-server activities with others that have peer-to-peer characteristics. Amazon.com, for example, lets operators of small Web sites promote goods and rely on the centralized resources for billing and fulfillment. There's no distributed software (other than a few links), but the company takes advantage of creativity and marketing efforts outside of its official core. Coverage of that sort of "soft" distributed computing might be a good supplement for the second edition of this book.

Peer-to-Peer is a thought-provoking book that will help its readers understand an exciting, still-emerging application architecture for the Internet. --David Wall

Topics covered: Peer-to-peer applications that run at the edges of the Internet, usually on home computers run by ordinary people. Much of this book comprises case studies on SETI@home, Gnutella, Freenet, Jabber, and other peer-to-peer services. Later chapters address technical issues, such as accountability, security, efficient use of limited bandwidth, and data cataloging.

Review

'Provides an interesting insight in to the world of P2P;, the projects currently tearing up the ;net and the future of the technology. Initial repetition aside, this is a well thought out and useful book which is definitely worth reading.- Linux Format, October 2001 'All in all a typical well-presented O'Reilly package - nice paper, good hardback binding and excellent content.' - Lindsay Marshall, news@UK, June 2001 'Essential reading for budding computer scientists and leaders of oppressive regimes' Computer Shopper, June 2001 'I have used this much space on this particular book because it is currently the best text I have seen that gives a wide introduction to P2P technologies and trends, and there is absolutely no question that infosec practitioners will have to understand this subject.' Information Security Bulletin, May 2001 (2 page review)

See all Editorial Reviews

Product Details

• Hardcover: 448 pages
• Publisher: O'Reilly Media; 1st edition (March 15, 2001)
• Language: English
• ISBN-10: 059600110X
• ISBN-13: 978-0596001100
• Product Dimensions: 9.3 x 6.4 x 1.2 inches
• Shipping Weight: 1.7 pounds (View shipping rates and policies)
• Average Customer Review: 4.6 out of 5 stars  See all reviews (21 customer reviews)
• Amazon Best Sellers Rank: #223,722 in Books (See Top 100 in Books)
  • #50 in Books > Computers & Technology > Computer Science > Information Theory
  • #95 in Books > Computers & Technology > Computer Science > Human-Computer Interaction

More About the Author

Andy Oram is an editor at O'Reilly Media, a highly respected book
publisher and technology information provider. An employee of the
company since 1992, Andy currently specializes in open source,
networking, and software engineering, but his editorial output has
ranged from a legal guide covering intellectual property to a graphic
novel about teenage hackers. His work for O'Reilly includes the
influential 2001 title Peer-to-Peer, the 2005 ground-breaking book
Running Linux, and the 2007 best-seller Beautiful Code.

Andy also writes often for O'Reilly's Radar site
(http://radar.oreilly.com/) and other publications on policy issues
related to the Internet and on trends affecting technical innovation
and its effects on society. Print publications where his work has
appeared include The Economist, Communications of the ACM, Copyright
World, and Internet Law and Business. His web site is
http://www.praxagora.com/andyo/.

Customer Reviews

Most Helpful Customer Reviews

14 of 14 people found the following review helpful:

5.0 out of 5 stars The avalanche is coming ..., March 9, 2001

By 

[e-mail] (Cambridge, England) - See all my reviews

This review is from: Peer-to-Peer : Harnessing the Power of Disruptive Technologies (Hardcover)

I expect this will be one of the really important computing books published this year.

Five years ago, I proposed a filestore that would be impossible to censor because it was too widely distributed across the Internet. I called this `The Eternity Service' after the `Eternity circuits' described by Arthur C. Clarke in `The City and the Stars'. I had been alarmed by the Scientologists' success at closing down the Penet remailer in Finland; this showed that electronic publishing can make it easy for rich people with ruthless lawyers to suppress publications.

Gutenberg's invention of print publishing made it impossible for princes and bishops to censor troublesome books, but might electronic publishing not make it possible once more? If there are only half a dozen servers containing a controversial document, then court orders can be purchased to close them down. Might not electronic publishing compromise the enormous gift that he gave mankind?

I could never have imagined the effect my paper would have. Rather than sedition, blasphemy or pornography, the battle is being fought over music copyright. Thanks to the Recording Industry Association of America, and its lawsuit against Napster, the Eternity Service has spawned a host of peer-to-peer systems such as Gnutella, Mojonation and Publius that have become front page news. There are also less-well-known systems, such as Red Rover, whose goal is to enable dissidents in places like China remain in contact with each other and with the rest of us. Sometimes, I have felt a bit like a skier who sets off an avalanche, and can only watch in fascination as it thunders down the valley.

So I eagerly awaited my advance copy of this book, and I have certainly not been disappointed. Although it has been put together rapidly by a number of different authors, this is not just a list of what systems X, Y and Z do, and how they work.

The first chapters place the peer-to-peer movement in a broader context: the early Internet was peer-to-peer, as was usenet. More recently, IP address congestion has led the builders of systems such as ICQ to design their own namespaces; alternatives to DNS are one of the emerging features of peer-to-peer.

After the introduction, there are chapters on a number of different systems: SETI@home, Jabber, Mixmaster, Gnutella, Freenet, Red Rover, Publius and Free Haven. Although many of these systems are relatively young and evolving quickly, their successes and failures to date help sketch a map of the peer-ro-peer space as of the beginning of 2001. They teach us what has worked, what hasn't, and what just might.

The lessons learned are distilled in the last seven chapters of the book. The themes brought out here have mostly to do with how these services can be made predictably dependable. Performance and trust are intricately intertwined; only by having means to protect against a wide variety of flooding and other attacks can service be maintained in the face of hostile action. However, technical mechanisms alone are not enough; there will probably have to be economic and social incentives for users to behave in apropriate ways. This is very timely, as people have recently come to recognise the major role played by perverse economic incentives in creating and maintaining information security vulnerabilities.

I believe that this book will become essential reading for a surprisingly broad range of people. Peer-to-peer issues do not merely affect designers of systems such as freenet, but potentially any system that has to deal with large scale and intermittent connectivity. If you believe that within ten years we will see all sorts of devices from burglar alarms to fridges and heart monitors able to establish ad-hoc communication with each other using mechanisms such as Bluetooth, then the next thing to consider is how these ad-hoc networks can be defined and protected. Here, the lessons from peer-to-peer may be invaluable.

If you need to understand the peer-to-peer movement - where it came from, where it's going, and what it can teach those of us who are working in related fields - then this book is a must-read. I also think it deserves a place on the shelves of everyone doing serious research in computer science.

Ross Anderson, Cambridge University Computer Laboratory

14 of 15 people found the following review helpful:

5.0 out of 5 stars Excellent Overview of the Technology and Policy of P-2-P, December 12, 2001

By 

Hans Klein (ATLANTA, GA United States) - See all my reviews
(REAL NAME)   

This review is from: Peer-to-Peer : Harnessing the Power of Disruptive Technologies (Hardcover)

I consider Peer-to-Peer to be one of the finest books on Internet issues that I have read. I highly recommend it to business and policy professionals, teachers, social scientists, and engineers.

When I first picked up the book, I had modest expectations. I have been disappointed by technical experts treating topics from the social sciences -- and this book does just that. Different chapters focus on such issues as: incentives on users to cooperate, the vulnerability of computer networks to social control, strategies for reliable communications, and censorship. Yet in this volume each topic is treated clearly, intelligently, and insightfully.

The authors not only summarize their topics well, they regularly offer sparkling insights. For example, in the chapter "The Cornucopia of the Commons," Dan Bricklin explains how certain peer-to-peer applications are enriched by consumption. The more that users consume from the electronic commons, the larger that electronic commons becomes. In the case of Napster, as users download files those files become part of the overall archive available to others. This turns the tragedy of the commons on its head: well-designed peer-to-peer applications can create explosive processes of value generation - an insight I find both provocative and profound.

The book sits squarely at that most difficult spot on the intellectual spectrum: the place where technology and policy overlap. Is this a policy book? Yes, it is. The topics above are all policy-relevant, and for a technical expert many of them would be new. Is this a technology book? Yes, it is that, too. It talks about network architecture design, technical implementations of trust and reputation, name spaces, and searching. For social scientists, the book is an excellent introduction to computer networking.

Peer-to-Peer is nearly 400 pages long and has 19 chapters. Amazingly, every chapter is worth reading. I can't say that about many edited volumes that I know! The editor also did a good job of integrating the different chapters so that the book has overall coherence.

This book is perfect for a university-level class about the Internet. The chapters on name spaces are useful to study of ICANN and global governance. Chapters on Napster help when studying intellectual property, those on FreeNet are useful when studying free speech. In my Internet policy class, I sprinkle chapters from the book throughout the semester.

Aside from teaching, the book is useful for anyone who wants to understand computer networking. It is accessible and readable, yet surveys a wide range of technical topics.

Considering the importance of the Internet and of peer-to-peer networks, it can be surprising difficult to find good explanations of the issues. This book does just that.

###

10 of 10 people found the following review helpful:

5.0 out of 5 stars Groundbreaking, March 19, 2001

By 

Cees van Barneveldt (Webster, NY USA) - See all my reviews

This review is from: Peer-to-Peer : Harnessing the Power of Disruptive Technologies (Hardcover)

Peer-to-peer technology is a buzzword today., mainly because of all the publicity about Napster. The picture people get about this technology is not pretty; the main benefits seem to be free music and anonimity, and the core competencies seem to be superdistribution and the lack of any control.

On September 2000 O'Reilly organized a peer-to-peer summit with a number of experts (computer scientists from MIT and AT&T Labs, CTO's, architects, human rights activists). This book is basically an offspring of this summit, with contributions from many of those experts.

One of the goals of this summit was to answer the question what peer-to-peer really is, and about what technologies we should think when we hear the term. There are also a lot of lessons to be learned from well known applications as Napster, Gnutella and Freenet. One of the outcomes is peer-to-peer is much more than file sharing; we also can think of projects regarding Web Services (Bluetooth, .NET, JINI), instant messaging, Web hyperlinking and networked devices. Core benefits include "more effective use of Internet resources through edge services" and "overcoming barriers to formation of ad-hoc communities and working groups". Peer-to-peer should be positioned as a natural next step in the development of the Internet.

After setting the context the book continues with chapters about a number of systems (already developed or still on the drawing table): SETI@home , Jabber, Mixmaster Remailers, Gnutella, Freenet, Red Rover, Publius and Free Haven. The focus of these chapters is on high level requirements and design choices: what works, what does not work and why?

The last part of the book contains descriptions of core technologies and research areas. These chapters deal with questions as performance and scalability, search strategies, accountability, trust, reputation and security. The approach of these topics is scientific: performances issues in Gnutella and Freenet are illustrated mathematically via graph theory. In the chapter about accountability several techniques for digital payments are described for ensuring accountable behavior amongst peers. These chapters also show that peer-to-peer is not an isolated area, many of the requirements also apply to other Internet related areas: think about encrypting e-mail or authentication of users by a server ("How do I make sure that only persons above 21 years old can look at my Website" or "How can I trust the person I am dealing with at an auction site").

This book is clearly not meant for developers. This is a book for people who want to be up to date about developments in computer science. Hereby I am thinking about CTOs, architects and researchers. In my opinion this is a groundbreaking work about a new and important topic that has many people's attention. The level is high and academic, and many of the technologies actually would require a separate book. All the articles are well written and of good quality.

I want to place one critical remark however. One of Tim O'Reilly's goals was to show the world that peer-to-peer is much more than violation of copyrights, or other activities that might be viewed as subversive in one way. However, in this book applications for file-sharing and censorship resistant publishing are overrepresented. There are many categories of worthy projects not included, such as "Servers/Services as Peers", "Devices as Peers" and "Writable Web". In order to get peer-to-peer on the map as more than a fringe technology , we also need attention for applications that are more garden variety, affecting our daily live or useful within a business context. Hereby I am also thinking about UDDI, JINI, Bluetooth, .NET and WebDAV.