Truck Month Textbook Trade In Amazon Fashion Learn more Discover it $5 Albums Tile Wearable Technology Fire TV with 4k Ultra HD Grocery Mother's Day Gifts Shop now Amazon Gift Card Offer starwars starwars starwars  Amazon Echo  Echo Dot  Amazon Tap  Echo Dot  Amazon Tap  Amazon Echo Fire, Only $39.99 Kindle Paperwhite UniOrlando Spring Arrivals in Outdoor Clothing May4th
Customer Review

27 of 27 people found the following review helpful
4.0 out of 5 stars Not a Classic, But a Worthwhile Read, July 19, 2010
This review is from: Building Web Reputation Systems (Paperback)
By Eric Goldman

For the past couple of years, I have been researching how we regulate reputation systems. As part of researching other disciplines' approaches to reputation systems, I was pleasantly surprised to find this book, which discusses web reputation systems from a technical/product development standpoint. I'm not aware of other books directly on point, so that alone makes the book noteworthy.

The word "reputation" is a complex and nuanced word. This book defines reputation as "information used to make a value judgment about an object or a person." Notice how this definition treats reputation as actionable information (i.e., making a "judgment"). I favor that approach; my work also uses an actionable definition of reputation.

Their definition equally treats both objects and people as having "reputation," and this does not work. In general, people are dynamic, i.e., they can change behavior; while content is static, i.e., an item of content does not change its character unless subsequently edited. This single definition of "reputation" created significant tension throughout the book. Recognizing this, the authors often bifurcated the discussion to separately address the process of establishing a person's "reputation" (which they confusingly called "karma"). However, the book primarily focuses on grading and sorting content items, especially user-generated content, and I personally would not describe content items as having a "reputation." As a result, I think the book is mistitled. It principally addresses content filtering, not "reputation" as I use the term.

Although this analytical tension pervades the book, the book nevertheless contained a lot of useful insights about both content filtering and establishing user trustworthiness. The authors have a lot of experience building filtering systems for different websites, so the book is packed with the kind of first-hand observations that only an insider can offer. There's no substitute for the voice of experience when designing Web 2.0 UGC systems, and this book provides an easy and accessible way to learn some of these tips and tricks.

The book emphasizes the authors' contributions to the reputation system at Yahoo Answers, and rightly so. Yahoo Answers has emerged into a bona fide success story and recently trumpeted its billionth answer. In my opinion, the book's high point is Chapter 10, a case study of how Yahoo Answers developed a new filtering and reputation system that helped turbocharge the Yahoo Answers community.

Although the book doesn't say this directly, two key lessons from Yahoo Answers' evolution are:

1) UGC websites should let users vote on content, but not all user votes should be weighted equally.

2) UGC websites do not need to publish all user-supplied content items in an equally prominent manner. Perhaps some content should be obscure/hard-to-find until other users validate it.

The book pitches these conclusions as novel, but they seemed fairly intuitive to me. We implemented a very similar system embodying these two points back in 2000-01 at Epinions. Epinions allowed users to grade each others' content; we weighted votes differentially based on users' credibility; and we displayed ungraded and poorly graded content only to registered users (a small fraction of our readers). The fact that the authors "discovered" these conclusions at Yahoo Answers shows the dire need for books like this to help websites implement best UGC management practices without reinventing the wheel.

The fact that the authors didn't acknowledge the Epinions precedent (and other systems like it) highlights another weakness of the book. There is a deep academic literature addressing the book's topics (especially on content filtering and user incentive systems), but the book barely acknowledges this literature. For example, several times the authors cite Dan Ariely's Predictably Irrational for descriptions of human psychology and foibles. That's a perfectly credible citation, but it should be one of many literature citations, not the only citation. Instead of dipping into the rich academic literature, the book almost exclusively relies on the authors' experience-based impressions. These impressions are a valuable information source that makes the book worth reading. However, because those impressions aren't tempered with more rigorous academic findings, it's not clear to me at all that the authors' conclusions represent true best practices...or even state-of-the-art.

Because of its many structural flaws, this edition will not become a classic. Nevertheless, I have enthusiastically recommended the book to several UGC start-ups because the book provides a good repository of high-value experience-based perspectives that are not readily available elsewhere. Even if the book's recommendations are debatable, it's a debate worth having.
Help other customers find the most helpful reviews 
Was this review helpful to you? Yes No

[Add comment]
Post a comment
To insert a product link use the format: [[ASIN:ASIN product-title]] (What's this?)
Amazon will display this name with all your submissions, including reviews and discussion posts. (Learn more)
This badge will be assigned to you and will appear along with your name.
There was an error. Please try again.
Please see the full guidelines here.

Official Comment

As a representative of this product you can post one Official Comment on this review. It will appear immediately below the review wherever it is displayed.   Learn more
The following name and badge will be shown with this comment:
 (edit name)
After clicking the Post button you will be asked to create your public name, which will be shown with all your contributions.

Is this your product?

If you are the author, artist, manufacturer or an official representative of this product, you can post an Official Comment on this review. It will appear immediately below the review wherever it is displayed.  Learn more
Otherwise, you can still post a regular comment on this review.

Is this your product?

If you are the author, artist, manufacturer or an official representative of this product, you can post an Official Comment on this review. It will appear immediately below the review wherever it is displayed.   Learn more
System timed out

We were unable to verify whether you represent the product. Please try again later, or retry now. Otherwise you can post a regular comment.

Since you previously posted an Official Comment, this comment will appear in the comment section below. You also have the option to edit your Official Comment.   Learn more
The maximum number of Official Comments have been posted. This comment will appear in the comment section below.   Learn more
Prompts for sign-in


Track comments by e-mail

Sort: Oldest first | Newest first
Showing 1-1 of 1 posts in this discussion
Initial post: Aug 20, 2010 11:16:14 AM PDT
The authors have written a response to this thoughtful review at
‹ Previous 1 Next ›

Review Details



Location: Mountain View, CA

Top Reviewer Ranking: 6,029,998