What Intelligence Tests Miss: The Psychology of Rational Thought [Hardcover]

Keith E. Stanovich (Author)

Book Description

Publication Date: January 27, 2009

Critics of intelligence tests—writers such as Robert Sternberg, Howard Gardner, and Daniel Goleman—have argued in recent years that these tests neglect important qualities such as emotion, empathy, and interpersonal skills. However, such critiques imply that though intelligence tests may miss certain key noncognitive areas, they encompass most of what is important in the cognitive domain. In this book, Keith E. Stanovich challenges this widely held assumption.

Stanovich shows that IQ tests (or their proxies, such as the SAT) are radically incomplete as measures of cognitive functioning. They fail to assess traits that most people associate with “good thinking,” skills such as judgment and decision making. Such cognitive skills are crucial to real-world behavior, affecting the way we plan, evaluate critical evidence, judge risks and probabilities, and make effective decisions. IQ tests fail to assess these skills of rational thought, even though they are measurable cognitive processes. Rational thought is just as important as intelligence, Stanovich argues, and it should be valued as highly as the abilities currently measured on intelligence tests.

Editorial Reviews

Review

“An original, well-supported, and brilliantly tied together book that reveals the misunderstood relationship between IQ, intelligence, and rationality.”—David Over, Durham University, Psychology Department
 

(David Over)

“In this compellingly readable book Keith Stanovich explains the bold claim that the notions of rationality and intelligence must be distinguished sharply and studied separately. His proposal would deeply change both the field of intelligence testing and the study of individual decision making—and he may well succeed.”—Daniel Kahneman, Princeton University, Nobel Laureate in Economics

(Daniel Kahneman)

“In this brilliant and entertaining book, Keith Stanovich shows that intelligence tests, though they have their uses, fail to assess the key components of rational thought and action.”—P. N. Johnson-Laird, author of How We Reason

(P. N. Johnson-Laird)

"Professor Stanovich has an unparalleled ability to synthesize results from diverse domains of cognitive science in a lively way that is tremendously useful to us non-specialists. This book is not about emotional or multiple intelligence; it's about intelligence in its most important practical dimensions."—E. D. Hirsch, Jr., author of The Knowledge Deficit and The Schools We Need

(E. D. Hirsch, Jr. 2008-05-01)

“In this smart and rational book, Keith Stanovich explains the difference between intelligence and rationality. Stanovich, one of psychology’s wisest writers about intelligence, also shows that IQ tests do not measure the full scope of mental ability because they fail to assess rational thought, which is central to happiness and fulfillment. This book is essential reading for anyone who wants to know what makes us truly smart—and why smart people often behave irrationally.”—Carol Tavris, Ph.D., coauthor of Mistakes Were Made (But Not by Me) : Why we justify foolish beliefs, bad decisions, and hurtful acts

(Carol Tavris, Ph.D.)

"In this dazzling synthesis about how well and poorly people think and why, Keith Stanovich drives a wedge between intelligence and rationality. This book demonstrates compellingly how rationality is more than intelligence and how those who are intelligent can be dismayingly irrational."—David Perkins, author of The Eureka Effect

(David Perkins)

Chosen as an Outstanding Academic Title for 2009 by Choice Magazine

(Choice 2010-01-01)

About the Author

Keith E. Stanovich is professor of human development and applied psychology, University of Toronto. He lives in Portland, OR.

Product Details

• Hardcover: 328 pages
• Publisher: Yale University Press; 1 edition (January 27, 2009)
• Language: English
• ISBN-10: 030012385X
• ISBN-13: 978-0300123852
• Product Dimensions: 6 x 1 x 9 inches
• Shipping Weight: 1.5 pounds
• Average Customer Review: 4.1 out of 5 stars  See all reviews (15 customer reviews)
• Amazon Best Sellers Rank: #799,581 in Books (See Top 100 in Books)

More About the Author

Keith E. Stanovich is currently Professor of Human Development and Applied Psychology at the University of Toronto. His book, What Intelligence Tests Miss, won the 2010 Grawemeyer Award in Education.

Stanovich is the author of over 200 scientific articles. In a three-year survey of citation rates during the mid-1990s (see Byrnes, J. P. (1997). Explaining citation counts of senior developmental psychologists. Developmental Review, 17, 62-77), Stanovich was listed as one of the 50 most-cited developmental psychologists, and one of the 25 most productive educational psychologists (see Smith, M. C., et al., Productivity of educational psychologists in educational psychology journals, 1997-2001. Contemporary Educational Psychology, 28, 422-430). In a citation survey of the period 1982-1992, he was designated the most cited reading disability researcher in the world (Nicolson, R. I. Developmental dyslexia: Past, present and future. Dyslexia, 1996, 2, 190-207).

Stanovich is the only two-time winner of the Albert J. Harris Award from the International Reading Association for influential articles on reading. In 1995 he was elected to the Reading Hall of Fame as the youngest member of that honorary society. In 1997 he was given the Sylvia Scribner Award from the American Educational Research Association, and in 2000 he received the Distinguished Scientific Contribution Award from the Society for the Scientific Study of Reading. Stanovich is a Fellow of the American Psychological Association (Divisions 3, 7, 8, & 15), the American Psychological Society, the International Academy for Research in Learning Disabilities, and is a Charter Member of the Society for the Scientific Study of Reading. He was a member of the Committee on the Prevention of Reading Difficulties in Young Children of National Research Council/National Academy of Sciences.

From 1986-2000 Stanovich was the Associate Editor of Merrill-Palmer Quarterly, a leading journal of human development. His introductory textbook, How to Think Straight About Psychology, published by Allyn & Bacon, is in its Ninth Edition and has been adopted by over 300 institutions of higher education. He is the author of five other books, including What Intelligence Tests Miss: The Psychology of Rational Thought (Yale University Press), The Robot's Rebellion: Finding Meaning in the Age of Darwin (University of Chicago Press), Decision Making and Rationality in the Modern World (Oxford University Press), and Progress in Understanding Reading (Guilford Press).

Most Helpful Customer Reviews

56 of 57 people found the following review helpful

5.0 out of 5 stars Rational thinking is more important than IQ alone February 12, 2009

By Gaetan Lion TOP 1000 REVIEWER

Format:Hardcover|Amazon Verified Purchase

This is an interesting book that expands the debate regarding IQ tests. The supporters of IQ tests such as Charles Murray in Bell Curve: Intelligence and Class Structure in American Life (A Free Press Paperbacks Book) and Arthur Jensen in The g Factor: The Science of Mental Ability (Human Evolution, Behavior, and Intelligence) state they fully capture cognitive capabilities and predict social outcome. But, the detractors such as Howard Gardner in Multiple Intelligences: New Horizons in Theory and Practice and David Coleman in Emotional Intelligence: 10th Anniversary Edition; Why It Can Matter More Than IQ state IQ is too narrow a concept and IQ tests are inaccurate. Stanovich agrees with the supporters that IQ can be measured and it captures specific cognitive skills. And, that it has causal social outcome implications. He disagrees with detractors that we need to expand the concept of intelligence and that IQ tests are irrelevant. However, he advances that IQ tests do not measure rational decision making ability.

Stanovich refers to IQ as the Algorithmic Mind and rationality as the Reflective Mind. He indicates that the correlation between the two is low. Many people have the equivalent of a powerful computer inside their brain. But, they are surprisingly poor "computer user" of that brain power. He mentions Georges Bush, Jr. who was very intelligent as measured by IQ tests.... But, he was not a proficient thinker as he was dogmatic, ill informed, impatient, and prone to rash decisions sometimes associated with devastating outcomes. Stanovich describes Bush condition as Dysrationalia or someone who is less rational than his IQ would suggest.

Stanovich advances that our thinking flaws have an evolutionary source. Evolution is concerned with maximizing survival through procreation. This is associated with quick thinking processes instead of the slower cogitating necessary for complex rational decisions.

Stanovich explores the thinking flaws that prevents us from thinking rationally. They include framing, anchoring, biases, extracting erroneous patterns, discounting future benefits excessively. Here, his references include Scott Plous excellent The Psychology of Judgment and Decision Making and Dan Ariely Predictably Irrational: The Hidden Forces That Shape Our Decisions.

Stanovich suggests we make mental mistakes for several different reasons. First, we are mentally lazy looking for the most immediate solution withouth engaging our higher level thinking processes (algorithmic and reflective thinking). Second, we lack the knowledge to interpret the data rationally (mindware gaps). Third, our rationality falls victim to irrational beliefs: creationism, astrology, Ponzi schemes, etc... (contaminated mindware).

Our lack of adequate rational thinking can have devastating results. This is true in personal finance. Overconfidence in one's knowledge and skills, fitting patterns where none exist, and loss aversion cause the majority of investors to loose money in the stock market. This is even true of investors who invest in mutual funds yet whose returns are far worse than the mutual funds they invest in. This is because they invest in and cash out at exactly the wrong time (buy high and sell low). Here, the author does support the Efficient Market Hypothesis and states that most investors are better off buying and holding an index fund than trading. For more on this subject, I recommend Malkiel's A Random Walk Down Wall Street: The Time-Tested Strategy for Successful Investing. Besides personal finance, lack of rational thinking has dire consequences in foreign policy, and medicine (check out "How Doctors Think" to study this issue further).

In chapter 10, he covers the main mindware gaps, or the quantitative knowledge we often lack to make rational decision. These tools include the scientific method, probability theory, and Bayesian statistics (his section on this topic is arduous for an easier explanation read instead Calculated Risks: How to Know When Numbers Deceive You. Within this chapter he also covers the thinking temperaments that make us good rational thinkers. This includes the ability to accept uncertainty, being open-minded, intellectually investigative, and humble. Such a temperament will allow one to practice sound critical thinking.

Contaminated mindware includes Ponzi schemes, recovered memory theory, conspiracy theories, tax-evasion schemes, win-the-lottery scams, fraudulent investment schemes, Holocaust denying, UFO abductions, Intelligent Design and creationism, religious fundamentalism among others. He indicates that believers in such contaminated mindware have often high IQs. He refers to many studies confirming that terrorists are among the best educated individuals within their religious communities. See Alan Krueger's What Makes a Terrorist: Economics and the Roots of Terrorism (New Edition).

In the last chapter, he recommends we teach rational thinking mindware in high school and college. Charles Murray in Real Education: Four Simple Truths for Bringing America's Schools Back to Reality agreed. College curriculum should include mandatory classes in statistics, logic, and philosophy so that we all become better decision makers.

He also recommends that social policies guide us to make the better choice so that society as a whole benefit from rationality despite our being irrational. This entails making the optimal choice the default selection when we are to choose to be an organ donor or participate in our company's 401K. By doing so, our society would save hundred of thousands of lives (more available organs) and improve the financial welfare of millions of retirees. This is called libertarian paternalism by Richard Thaler who wrote an entire book on the subject: Nudge: Improving Decisions About Health, Wealth, and Happiness.

This book will make you a better decision maker by making you aware of your own blind spots whether they are due to mindware gaps or contaminated mindware. Read more ›

28 of 30 people found the following review helpful

4.0 out of 5 stars How Can Smart People Do Dumb Things? (Dysrationalia?) March 18, 2009

By Kevin Currie-Knight TOP 500 REVIEWERVINE™ VOICE

Format:Kindle Edition|Amazon Verified Purchase

We are all familiar with the phenomenon of those who have high IQ's doing things that seem stupid. This leads to the distinction between "book smarts" and "street smarts," but strangely enough, we call BOTH of these things intelligence. We recognize both the absent-minded professor and the low IQed entrepreneur as "intelligent." How, though, can the term "intelligence" apply to two seemingly non-correlated things (being book-smart and street-smart)?

Psychologist Keith Stanovich has an interesting idea: maybe "intelligence tests" measure intelligence (as traditionally defined) but not a wholly different faculty of rationality. To Stanovich, the difference between intelligence and rationality is the difference between the "algorithmic mind" and the "reflective mind," or, the difference between the ability to employ algorithms and the ability to think about and CRITICALLY employ algorithms. (I might say that intelligence may be the ability to map or write a sentence and rationality is the ability to formulate arguments and write a persuasive essay.)

The first half of Stanovich's book is dedicated to showing that while IQ tests are a valid measure of a faculty of general intelligence (he does not deny that IQ tests measure a very real thing), it simply does not measure all that we understand to be good thinking.

Stanovich, though, is also a critic of those like Gardner and Sternberg who want to add to the number of "intelligences" (musical intelligence, naturalistic intelligence, creative intelligence). These things, he says, inadvertently beatify the term "intelligence" to be a be-all-end-all that it is not (by implying that any good mental work must be called an "intelligence" rather than a "talent," "skill" or "proclivity....") Instead, Stanovich makes the point that intelligence is simply one component of good thinking. The other, often overlooked, ingredient is rationality (and he alludes to several studies which show these two faculties are not very positively correlated. One can have high amounts of one and low amounts of the other.)

What I thought and hoped Stanovich would do next - what he did not do - is offer a sense of how we can test for RQ (rationality quotient). While the first half makes the case very well that rationality should be valued and tested every bit as much as intelligence, he does not follow it up by showing how such a thing might be done.

Instead, Stanovich devotes the second half of this book largely to cataloguing and demonstrating "thinking errors" that distinguish rational from irrational thought. For example, humans are "cognitive misers" by nature, who like to make decisions based often on first judgments and quick (rather than thorough) analysis (a likely evolutionary strategy, as ancestors that were quick and somewhat accurate probably did better than those who were slow and very accurate). Also, humans often put more emphasis on verification than falsification, and fail to consider alternative hypotheses in problems, preferring often to go with the most obvious answer.

All of these, while interesting, have been better and more thoroughly documented in other books by decision theorists and psychologists. All Stanovich needed to do was refer us to these, at most, devoting a chapter or two to examples. There is more important work for Stanovich to do then rehash what we can just as soon read elsewhere. Instead, I think he sh old have begun outlining ideas on how to test for rationality. What would such tests look like? How would such tests affect our educational system (focused, as it is, on IQ)? What would test questions even look like and how can they be adjusted for by age/grade level? Are there pitfalls?

None of these questions were answered, and Stanovich's argument is the worse for it. Stanovich himself notes that one big reason for IQ's predominance in the psychometric world is that it is measurable (which is a big strike against many of Gardner's "multiple intelligences"). Ironically, Stanovich's failure to suggest ways to measure RQ will likely have the same effect for his idea as it had for Gardner's.

It is a shame, though. As an educator concerned both with the undeserved predominance of IQ and also the failure of concepts such as Gardner's "multiple intelligence" to offer a serious challenge, I quite like Stanovich's germinal idea. As we all know that rationality is a key component to good thinking, and it is hard to think that it is positively correlated to IQ, it would be interesting to find a way to measure RQ as a valid supplement to IQ. It is simply too bad this book did not explore the practical questions involved with his tantalizing suggestion. Read more ›

15 of 19 people found the following review helpful

3.0 out of 5 stars Right direction, incomplete treatment September 6, 2010

By mbk

Format:Paperback|Amazon Verified Purchase

I agree on the points made already, including, good start by separating rational thinking from raw intelligence in the sense of processing power, then a propensity to present too many examples of faulty reasoning already made in the literature. I will focus on additional points not mentioned by other reviewers.

What this book gets right:
- stressing a clear distinction between IQ and rationality
- presenting a taxonomy of thinking processes and associated thinking errors according to current cognitive science

Where this book does not so well:
- examples for irrationality often strangely unconvincing or muddled with issues of preference over raw rationality
- repetition of arguments instead of fleshing them out (the endnotes are better written than the main text because here the authors does not try to pander to the 'average' reader by diluting his argument and finding examples from sports etc)
- creation of unnecessary neologisms ("contaminated mindware" instead of "questionable beliefs")

Where this book fails:
- failure to clearly define elements of rationality beyond the labels "instrumental" and "epistemic" and an arbitrary collection of good thinking habits
- failure to come to terms with, or even mention, the problem of volition - who is the controller, what would propel him to override/control his instincts, in which situations is rational thought it the 'right' choice, are there situations where it is not helpful, can such a choice even be determined a priori etc.
- complete failure to assess the issue of the normative in the discussion of rationality.... Every so often, examples slip in where the author seems unaware that what he labels irrational beliefs or thinking habits, may actually be legitimate choices, differences in opinion, differences in the assessment of long term effect, probabilistic trade offs in energy spent etc.
- the author seems to assume that 'correct' meaning - semantics - can be created by the 'correct' algorithmic processing of data. I find this worldview a bit simplistic to say the least.

As a result, the book clearly establishes what I also hold as somehow self evident, that the means to achieve an end (intelligence) are different from their owner's propensity to use them properly (lazy or faulty reasoning habits leading to faulty thinking or faulty conclusions from existing data). But the book fails to distinguish rationality from issues that are fundamentally semantic or normative, from personal choices, from probabilistic, evolutionary heuristics that may not be rational but justified because on average they work. There is little philosophical or epistemological depth, little awareness that maybe even a better algorithmic application may not be the final solution yet to cognition. The author simply assumes that proper application of algorithmic reasoning somehow would solve most "problems" - and falls into a rather Hayekian "scientism", or "pretense of knowledge" kind of trap in his assumptions about what even science can really know about the world.

That being said, as another reviewer has pointed out - it is a rare book that goes all the way to try and dethrone IQ with very good, hard arguments, for this I commend the author, it is worthwhile to read, and it may still be a good book to use in teaching. Too bad it is incomplete and itself somehow biased towards viewing as rationality as all one would ever need to live the good life. Read more ›