Super Crunchers: Why Thinking-by-Numbers Is the New Way to Be Smart [Hardcover]

Ian Ayres (Author)

Book Description

Release date: August 28, 2007 | ISBN-10: 0553805401 | ISBN-13: 978-0553805406 | Edition: 1

Why would a casino try and stop you from losing? How can a mathematical formula find your future spouse? Would you know if a statistical analysis blackballed you from a job you wanted?

Today, number crunching affects your life in ways you might never imagine. In this lively and groundbreaking new book, economist Ian Ayres shows how today's best and brightest organizations are analyzing massive databases at lightening speed to provide greater insights into human behavior. They are the Super Crunchers. From internet sites like Google and Amazon that know your tastes better than you do, to a physician's diagnosis and your child's education, to boardrooms and government agencies, this new breed of decision makers are calling the shots. And they are delivering staggeringly accurate results. How can a football coach evaluate a player without ever seeing him play? Want to know whether the price of an airline ticket will go up or down before you buy? How can a formula outpredict wine experts in determining the best vintages? Super crunchers have the answers. In this brave new world of equation versus expertise, Ayres shows us the benefits and risks, who loses and who wins, and how super crunching can be used to help, not manipulate us.

Gone are the days of solely relying on intuition to make decisions. No businessperson, consumer, or student who wants to stay ahead of the curve should make another keystroke without reading Super Crunchers.

Editorial Reviews

From Publishers Weekly

Yale Law School professor and econometrician Ayres argues in this lively and enjoyable book that the recent creation of huge data sets allows knowledgeable individuals to make previously impossible predictions. He calls the data set analysts super crunchers and discusses the changes they're making to industries like medical diagnostics, air travel pricing, screenwriting and online dating services. Although Ayres presents both sides of this revolution, explaining how the corporate world tries to manipulate consumer behavior and telling consumers how to fight back, his real mission is to educate readers about the basics of statistics and hypothesis testing, spending most of his time in an edifying and entertaining discussion of the use of regression and randomization trials. He frequently asks whether statistical methods are more accurate than the more intuitive conclusions drawn by experts, and consistently concludes that they are. Ayres skillfully demonstrates the importance that statistical literacy can play in our lives, especially now that technology permits it to occur on a scale never before imagined. (Sept. 4)
Copyright © Reed Business Information, a division of Reed Elsevier Inc. All rights reserved.

Review

"In the past, one could get by on intuition and experience. Times have changed. Today, the name of the game is data. Ian Ayres shows us how and why in this groundbreaking book Super Crunchers. Not only is it fun to read, it just may change the way you think."—Steven D. Levitt, author of Freakonomics

"Data-mining and statistical analysis have suddenly become cool.... Dissecting marketing, politics, and even sports, stuff this complex and important shouldn't be this much fun to read."—Wired

"[Ayres's] thesis is provocative: Complex statistical models could be used to market products more intelligently, craft better movies, and solve health-care problems—if only we could get past our statistics phobia."—Portfolio

"When statistics conflict with expert opinion, bet on statistics....Businesses, consumers, and governments are waking up to the power of analyzing enormous tracts of information."—Discover

"Super Crunchers shows that data-driven decisionmaking is not just revolutionizing baseball and business; it's changing the way that education policy, health care reimbursements, even tax regulations are crafted.  Super Crunching is truly reinventing government.  Politicians love to tout policy proposals, but they rarely come back and tell you which ones succeeded and which ones failed.  Data-driven policy making forces government to ask the bottom line question of 'What works.'  That's an approach we can all support."—John Podesta, President of the Center for American Progress

"A lively and yet rigorously careful account of the use of quantitative methods for analysis and decision-making.... Both social scientists and businessmen can profit from this book, while enjoying themselves in the process."—Dr. Kenneth Arrow, Nobel Prize winning economist, and Professor Emeritus at Stanford University

“Ayres’ point is that human beings put far too much faith in their intuition and would often be better off listening to the numbers.... The best stories in the book are about Ayres and other economists he knows, whether they are studying wine, the Supreme Court or jobless benefits.... Ayres himself is one of the [statistical] detectives. He has done fascinating research.”—The New York Times Book Review

"Ian Ayres [is] a law-and-economics guru."—Chronicle of Higher Education

“Lively and enjoyable.... Ayres skillfully demonstrates the importance that statistical literacy can play in our lives, especially now that technology permits it to occur on a scale never before imagined.... Edifying and entertaining."—Publishers Weekly

"Super Crunchers presents a convincing and disturbing vision of a future in which everyday decision-making is increasingly automated, and the role of human judgment restricted to providing input to formulae."—The Economist

"Insightful and delightful!" —Forbes

See all Editorial Reviews

Product Details

• Hardcover: 272 pages
• Publisher: Bantam; 1 edition (August 28, 2007)
• Language: English
• ISBN-10: 0553805401
• ISBN-13: 978-0553805406
• Product Dimensions: 6.2 x 1 x 9.3 inches
• Shipping Weight: 1.1 pounds (View shipping rates and policies)
• Average Customer Review: 3.6 out of 5 stars  See all reviews (117 customer reviews)
• Amazon Best Sellers Rank: #310,212 in Books (See Top 100 in Books)

More About the Author

Ian Ayres is the William K. Townsend Professor at Yale Law School and the Yale School of Management, and is editor of the Journal of Law, Economics and Organization. In addition to his best-selling SuperCrunchers, Ayres has written for the New York Times, the Wall Street Journal, Financial Times, International Herald Tribune, and The New Republic. He lives in New Haven, Connecticut.Barry Nalebuff is Professor of Economics and Management at the Yale School of Management. His books include The Art of Strategy (an update of the best-selling Thinking Strategically) and Co-opetition. He is the author of fifty scholarly articles and has been an associate editor of five academic journals. He lives in New Haven, Connecticut.

Most Helpful Customer Reviews

256 of 285 people found the following review helpful

2.0 out of 5 stars CRUNCHING on Empty, CRUNCHING Blind (Apologies to Jackson Browne) November 11, 2007

By Steve Koss VINE™ VOICE

Format:Hardcover

Is it a new brand of cereal? Or maybe it's a granola bar, or a chunky peanut butter spread? Then again, could it be the latest infomercial exercise device designed to give you the six pack abs you've always dreamed of but know in your heart of hearts you'll never achieve? Actually, it's a book - the title a product of the very methods the book describes. Here's what SUPER CRUNCHERS says.

(1) Mathematical regression models generated from large datasets often generate better predictions than human experts, and they provide supporting information on the predictive weight and reliability of each explanatory variable.
(2) Well-crafted experiments using randomized trials and control groups provide good market research and behavioral analysis results.
(3) Technological advances - the Internet, massive data storage devices, rapid computation, broadband telecommunication - are making it possible to share more sources of information and create ever-larger databases for analysis.
(4) Today's companies engage in multiple forms of market research by creating and using large databases and large-scale randomized trials.
(5) Many phenomena conform to normal distributions in which 95% of the population will be found within two standard deviations of the mean, the5% balance generally divided evenly in the two tails.

That's it. I just saved you $25.00 U.S. and a half-dozen or more hours learning how a guy from Yale named Ian Ayres collected a bit of information about applied mathematical techniques that have been in practical use for decades, packaged them up, palmed them off as something new, and cooked up the ridiculous name Super Crunching to describe an ostensibly new technological development. Yet "Super Crunching" is nothing more than the author's marketing hype for a couple of standard mathematical methodologies, a creation of nothing from something. There's no new breakthrough here, no new paradigm.

Yes, the anecdotal information about the future prices of wine vintages, Capital One's teaser offerings, and evidence-based medical diagnosis are interesting (hence the two stars rating). The rest, however, is neither prescriptive nor sufficiently critically analytical. Should we go out shopping for a Super Cruncher tomorrow? Should we delight in the increased accuracy of data-driven modeling and prediction, or should we fear the implied manipulation of our desires and the incessant, single-minded drive toward maximum profit at the expense of creativity? Do we really want movies and books to be developed from mathematical models like Epagogix? Do we really want our every keystroke on the Internet to be fodder for market research that manipulates us in response? John Kenneth Galbraith, among others, warned of exogenous, manufactured demand decades ago.

SUPER CRUNCHERS is part business tome, part econometric paean, and part sociology book, but not fully any of the three. No matter how many time the author uses words like "cool" and "humongous" and "amazing," it's still regrettably a "No Sale" even for someone like me who enjoys reading about applied mathematics.

233 of 283 people found the following review helpful

1.0 out of 5 stars Disappointing October 6, 2007

By William Addington VINE™ VOICE

Format:Hardcover

I read a blurb on this book in the Economist and bought it for that reason. When I read it however, it failed to deliver. It is similar to the Tom Peter's "Search of Excellence" type book with anecdotal stories with little substance. It is overgeneralized and overhypes the models it discusses. The models Ayres discusses are also NOT NEW. I personnally have been creating these types of system for nearly 30 years. What has changed over the years, of course, is greater accessibility of data and a greater capacity to process that data economically. But we still struggle with quality of data issues and appropriateness of model issues -- especially when the models begin to be used by people other than the model creators. The book glosses over this, only providing an example of how Choicepoint used a poor matching algorithm when eliminating felons from Florida's voting roles and even then the author minimizes the problem.

There is no discussion of how these models become abused when implemented as tools where the user of the tool has no knowledge of its limitations, when the model provides suboptimal solutions or what "outliers" are and how to deal with them (although you know immediately when you ARE the outlier and are trapped dealing with a company using a model designed for a population you don't belong to).

This leads us to becoming a nation of people who read off a screen and do what the computer says to do, while turning off our brain. Any wonder you can get outsourced in that scenario? But it must be right -- we Super Crunched it!

84 of 103 people found the following review helpful

5.0 out of 5 stars Outstanding Information and Very Interesting! August 30, 2007

By Loyd E. Eskildson HALL OF FAME

Format:Hardcover

"Super Crunchers" provides a very readable summary of what can be done to improve performance using the incredible volumes of data accumulated in business, government, health care, and education. Why now? One reason is that the massive amounts of data now available make randomization (essential to valid conclusions) much more achievable than in the past; the other is the low and continually falling costs of computers and storage media.

The bulk of Ayres' work consists of examples (names both companies and the software involved) within each of the sectors previously mentioned. Capital One has been running randomized tests since at least 1995 - tests include page layout, and type and size of offers. Google uses data analysis to fuel its web accelerator (uses your past browsing history to predict pages to be called up next), Wal-Mart's analysis of responses to various employment questions is used to rank potential employees, and Continental Airlines follows up on its own data to design follow-up programs for complaining fliers. Capital One's approach has also been used to evaluate various charity donation-matching programs, and could also be used to evaluate potential billboard and magazine ads. (Similarly, TiVo is now being used to evaluate various TV ads, using the same approach and measuring the relative frequency with which various ads are fast-forwarded through.)

"Offermatica" software not only automates randomization (format, type of offer) for a number of firms, it also analyzes the responses in real time, dramatically cutting the cost of experiments. Thus, no more waiting for hyper-controlled experiments in universities and laboratories that conclude, ALL OTHER THINGS BEING EQUAL (that never happens), eg. red is preferred to blue.

Randomized tests are also increasingly being used to evaluate various government programs, finding eg. that additional job location assistance more than paid for itself for those receiving unemployment benefits, guiding HeadStart programs to target those most likely to benefit.

"Super Crunchers'" health care examples were the most impressive. Don Berwick's "100,000 lives" campaign saved 122,342 lives in an 18 month period through persuading about 3,000 hospitals representing 75% of all beds to focus on six areas of improvement identified through data analyses. These included antiseptic placement of central line catheters in ICUs, elevating heads and washing the mouths of those on respirators, adoption of the latest heart attack treatments, and rapid response teams to patent beds.

Bottom Line: "Super Crunchers" is an exciting vision of what is already possible!