When Can You Trust the Experts: How to Tell Good Science from Bad in Education [Hardcover]

Daniel T. Willingham (Author)

Book Description

Publication Date: July 24, 2012 | ISBN-10: 1118130278 | ISBN-13: 978-1118130278 | Edition: 1

Clear, easy principles to spot what's nonsense and what's reliable

Each year, teachers, administrators, and parents face a barrage of new education software, games, workbooks, and professional development programs purporting to be "based on the latest research." While some of these products are rooted in solid science, the research behind many others is grossly exaggerated. This new book, written by a top thought leader, helps everyday teachers, administrators, and family members—who don't have years of statistics courses under their belts—separate the wheat from the chaff and determine which new educational approaches are scientifically supported and worth adopting.

• Author's first book, Why Don't Students Like School?, catapulted him to superstar status in the field of education
• Willingham's work has been hailed as "brilliant analysis" by The Wall Street Journal and "a triumph" by The Washington Post
• Author blogs for The Washington Post and Brittanica.com, and writes a column for American Educator

In this insightful book, thought leader and bestselling author Dan Willingham offers an easy, reliable way to discern which programs are scientifically supported and which are the equivalent of "educational snake oil."

Editorial Reviews

Review

"Parents increasingly come face-to-face with important educational decisions that they feel ill prepared to make. Whether they are choosing among schools, math programs or early interventions for a learning disability, this book will help them figure out which options are backed by the best science. (Recommended)"—Scientific American

"By my bedtable is Dan Willingham's new book, When Can You Trust the Experts?... This is help we all can use, from one of the most sensible guys around."—John Merrow, The Huffington Post

"A brilliant new book... Willingham presents a 'short cut' to assessing the value of a given idea—a set of four steps that will be useful to anyone sizing up an unfamiliar concept.  I’ve read Willingham’s book and I recommend it highly!"—Annie Murphy Paul

From the Inside Flap

Along with some potentially worthy ideas, the last fifty years have encapsulated a flood of educational quackery and nostrums. The innovation and implementation continues, while teachers, administrators, and policymakers have a hard time separating the wheat from the chaff. What makes this so difficult for individuals in the American educational system? They're on their own. There is no research team to evaluate every new idea. But there is pressure to effect change through these innovations.

In When Can You Trust the Experts? Daniel Willingham offers a solution for those who must sift through the information overload and discern which of the latest educational models, programs, and approaches are worthy of their attention. Willingham provides a reliable shortcut comprising four steps. For each step he offers an explanation of why the principle works by referring back to the rules for what constitutes good science. Willingham's easy-to-apply process consists of:

1. Strip it. Clear away the verbiage and look at the actual claim. What exactly is the claim suggesting a teacher should do, and what outcome is promised?
2. Trace it. Who created this idea, and what have others said about it? It's common to believe something because an authority confirms it, and this is often a reasonable thing to do. In education research, however, this can be a weak indicator of truth.
3. Analyze it. Why are you being asked to believe the claim is true? What evidence is offered, and how does the claim square with your own experience?
4. Should I do it? You're not going to adopt every educational program that is scientifically backed, and it may make sense to adopt one that has not been scientifically evaluated.

When Can You Trust the Experts? offers parents, teachers, administrators, and policymakers the tools they need to ask tougher questions, think more logically about why an intervention might or might not work, and ultimately make more informed decisions.

See all Editorial Reviews

Product Details

• Hardcover: 272 pages
• Publisher: Jossey-Bass; 1 edition (July 24, 2012)
• Language: English
• ISBN-10: 1118130278
• ISBN-13: 978-1118130278
• Product Dimensions: 6.4 x 1 x 9.1 inches
• Shipping Weight: 1 pounds (View shipping rates and policies)
• Average Customer Review: 4.3 out of 5 stars  See all reviews (27 customer reviews)
• Amazon Best Sellers Rank: #45,225 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Most Helpful Customer Reviews

5 of 5 people found the following review helpful

5.0 out of 5 stars I am a homeschool mom and I loved this one September 26, 2012

By Gracie TOP 1000 REVIEWER

Format:Hardcover|Amazon Vine™ Review (What's this?)

I have homeschooled my kids for years. I have read more books on educational philosophy, psychology, trends, and methods than I care to remember. Most of them are completely useless.

The homeschooling world is absolutely over run by curriculum, programs, methods, gurus, and philosophies. You could spend a lifetime and a fortune sorting it all out. Believe me, a lot of homeschoolers have tried.

This book gives you a clear path through the claims and hyperbole. Even as I strive to teach critical thinking to my kids, I am aware that I need to constantly be working on that myself. This book is a fantastic exercise in applying critical thinking to educational theory.

Not everything in this book translates well to the homeschool world. But enough content does to make this a very worth while read before you get suckered in at the next curriculum fair or homeschool conference.

I would actually very much like the author to write an addendum or revised additions for homeschoolers. We spend more money on books than any other segment of the market. We could use his insight.

4 of 4 people found the following review helpful

5.0 out of 5 stars Should be rquired reading for principals, school boards and curriculum committees. I do wish it were a bit more concise. September 8, 2012

By Two kids mom TOP 500 REVIEWERVINE™ VOICE

Format:Hardcover|Amazon Vine™ Review (What's this?)

I wish this were required reading for principals. The No Child Left Behind has left them desperate for anything which will improve student scores. I have a background in science and educational research and have spent many an hour explaining to principals that the newest "fad" in teaching (insert reading method, math program, "brain training" exercises) has no evidence to support effectiveness. They all sound good, and fling about authoritative scientific sounding or alternatively, flowery and romantic statements but lack proof.

Unfortunately, many educational research books delve into all sorts of statistics. Given that many teachers and principals do not have extensive backgrounds in statistics (once had to go in and explain to a principal that students could not "advance to the 100th percentile" from the 99th percentile) these books do little to enlighten.

This books is NOT for educational researchers. This book is for principals, teachers and parents. The author readily admits that his method is a shortcut. Using this method will give the reader a pathway to evaluate the claims of educational products and not simply resort o thinking "well, that sounds good, let's give it a try!" which seems to be the basis for many decision making committees in education.

However, given the lack of time that many parents and teachers have, I wish this book were shorter or came in two versions, the "well developed" version and the "really a shortcut version". Although the explanations of the scientific method and research methods are interesting ( and his beginning a clever way to open your eyes) I worry that the extra length means that some readers will not persevere to the meat of the book, how to evaluate educational claims. I would give it 4.5 stars. but I will round up, as the author does an excellent job explaining to the educated (but not necessarily scientific or mathematical) layman how to strip away the smoke and mirrors, get to the facts and make an informed decision.

2 of 2 people found the following review helpful

4.0 out of 5 stars Not just for teachers September 17, 2012

By J. Green VINE™ VOICE

Format:Hardcover|Amazon Vine™ Review (What's this?)

This book is specifically aimed at educators (teachers and administrators, but parents, too) who might be considering "educational software, games, workbooks or other programs" which claim to be "based on the latest research." While some of these products may be based on actual research, many are not. But how can you tell? Willingham discusses the history of science and the role it plays in persuading us and appeals to our biases (especially the "confirmation bias" where we look for "evidence" that supports what we already believe and discard what doesn't support it). Ultimately he outlines and explains four steps:

Strip it and Flip it. Strip the claim down to its essentials and promises: "If I do X, then there is a Y percent chance that Z will happen."
Trace it. Should you take statements by "authorities" at face value?
Analyze it. What evidence is offered? Is there any scientific evidence (from reliable studies) that support or refute the claims?
Should you do it? And how will you measure results, or when do you call it quits?

It's a rather straightforward process that can weed out a lot of programs and help you find (and understand) the kind of research for making better-informed decisions. And while it's geared more toward eduation professionals it's also written plainly enough that parents can use the same processes. I picked it up hoping it could apply to other areas where science is touted. Such issues are certainly beyond the scope of this book, but I think Willingham's method is a good place to start and can be applied in more areas than just education. It's not a long book and Willingham's writing style is easy to follow. But the main idea is to get people thinking for themselves and not be misled by emotional appeals or psuedo-science.