Scientific Reasoning: The Bayesian Approach [Paperback]

Colin Howson (Author), Peter Urbach (Author)

Book Description

Publication Date: April 10, 2005

In this clearly reasoned defense of Bayes's Theorem — that probability can be used to reasonably justify scientific theories — Colin Howson and Peter Urbach examine the way in which scientists appeal to probability arguments, and demonstrate that the classical approach to statistical inference is full of flaws. Arguing the case for the Bayesian method with little more than basic algebra, the authors show that it avoids the difficulties of the classical system. The book also refutes the major criticisms leveled against Bayesian logic, especially that it is too subjective. This newly updated edition of this classic textbook is also suitable for college courses.

Product Details

• Paperback: 470 pages
• Publisher: Open Court; 3rd edition (April 10, 2005)
• Language: English
• ISBN-10: 081269578X
• ISBN-13: 978-0812695786
• Product Dimensions: 8.9 x 6.9 x 0.8 inches
• Shipping Weight: 1.1 pounds (View shipping rates and policies)
• Average Customer Review: 3.6 out of 5 stars  See all reviews (8 customer reviews)
• Amazon Best Sellers Rank: #558,154 in Books (See Top 100 in Books)

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

51 of 53 people found the following review helpful:

5.0 out of 5 stars An unexpected and unusual gem, July 31, 2002

By 

Todd I. Stark "Cellular Wetware plus Books" (Philadelphia, Pa USA) - See all my reviews
(VINE VOICE)    (REAL NAME)   

This review is from: Scientific Reasoning: The Bayesian Approach (Paperback)

This book is a little-known treasure in the philosophy of science that deserves a spot alongside the better known works of Popper, Kuhn, Lakatos, and Feyerabend, and is more practical than most of those. Herein lies the clearest, simplest, and most persuasive discussion I've ever seen on the limits of Karl Popper's view of science, along with a sound introduction to the Bayesian probability theory requiring no more than high school algebra and a little persistence.

Much of this book will strike students of classical probability theory and philosophy of science as very counter-intuitive at first, but it is so well argued and so clear that I think most readers will begin to warm up to the Bayesian view at least to some degree by the time they finish the book.

The book starts out introducing one version of the traditional "problem of induction": 'how can we be certain of a rule inferred from finite individual observations ?' We then quickly discover why the usual solutions offered don't quite work in actual theory construction in practice. Mainly, the usual solutions (generally based on the disconfirmation of hypotheses) don't address the way _auxilliary_ hypotheses help theories escape refutation, and how webs of evidence of different kinds often converge to help confirm theories.

It has been generally accepted by modern philosophers of science that useful scientific theories go well beyond the experimental data. Hence they can technically not be "proven" in a logical sense, only considered increasingly more likely as their testable predictions are validated.

The Bayesian view is not based so much on a negative attitude toward objective confirmation of theories, as on the observation that classical methods which are the guardians of total objectivity, in fact violate that ideal constantly and in arbitrary ways. The most objective methods, such as those of Fisher and Neyman and Pearson are credibly claimed to rely on personal judgement of likelihood at key points, rather than being the objective logical consequences generally assumed of them.

The Bayesian view starts off acknowledging that subjective assessment of likelihood is an important part of theory selection and construction, and makes it part of the philosophy of science. The central point is that we have degrees of belief in theories, and that these degrees of belief adhere to probability calculus.

The power of scientific reasoning then results not from some elusive objective logic of discovery but because our innate inference abilities lead observation of evidence to beliefs that follow probability calculus, and hence our sense of increasing credibility tends to reflect greater likelihood of a theory making accurate predictions. Although our inferences are not consistently Bayesian by any means, our own intuitions about what represents *correct* inductive reasoning _are_ Bayesian in nature. So when we take pains to correct our inferences based on our own standards of tenability, our subjective assessments lead us to increasingly better theories.

Our beliefs can be measured as probabilities, and probabilities can be used to confirm theories. Among other things, the Bayesian view uniquely predicts, in contrast to the classical view of Popper and statistician Fisher, that novel observations should have and do have special importance in theory construction. The authors not only introduce probability calculus in simple algebraic terms and discuss its application to philosophy of science, but they also devote considerable time to exploring specific weaknesses of alternate views, and considerable time persuasively addressing the strongest criticisms of the Bayesian approach, such as that it is "too subjective." But the Bayesian philosophy of science is actually built on a powerful theory of inference and is itself "unimpeachably objective" because of its strict rules of consistency, even though its subject matter is subjective degrees of belief.

If you've ever wondered exactly what the Bayesian approach to probability is, and what it is supposed to offer science, or you've ever been dissatisfied with the traditional answers to the problem of induction, this book will be your welcome friend for a number of evenings. It combines mathematical elegance and deftness with simple philosophical wisdom and deals convincingly with the controversial nature of its claims.

19 of 25 people found the following review helpful:

3.0 out of 5 stars Just shy of being great...., October 20, 2004

By 

Randall Helzerman (campbell, ca) - See all my reviews
(VINE VOICE)    (REAL NAME)   

This review is from: Scientific Reasoning: The Bayesian Approach (Paperback)

This book contains lots of useful information for the budding Baysian. Excellent discussions on many topics. However, I have to give this only 3 stars, because on a cardinal point, the authors give very bad advice: they give the impression that Komogorov complexity-based methods are ill motivated. In fact, Kolmogorov complexity is one of the most fruitful new developments in Baysianism, and I have personally used it many times in industrial settings to solve otherwise intractible problems.

However, on most points the book is very useful. I recommend buying the first edition over the second, because the second edition doesn't really add that much useful info over the first. I also recommend buying in addition to this book Ming Li and Paul Vianyi's book on Kolmogorov complexity, for a comprehensive intro to a whole wonderland of Baysianism which Howson & Urbach have overlooked.

9 of 12 people found the following review helpful:

5.0 out of 5 stars An absolute "must-read" for all scientists and students of science, July 9, 2006

By 

Midwest Book Review (Oregon, WI USA) - See all my reviews

This review is from: Scientific Reasoning: The Bayesian Approach (Paperback)

Now in its third edition, Scientific Reasoning: The Bayesian Approach, is a basic introduction to the philosophy that scientific reasoning is, and should be, conducted in accordance with the axioms of probability. Called the Bayesian view, after a theorem first proven by Thomas Bayes in the late eighteenth century, has recently gained increased standing as a valuable methodology for examining scientific evidence. Scientific Reasoning explains the elements of probability calculus that are relevant to Bayesian methods and argues that probability calculus should be understood as a form of logic. Accessibly written, even to readers who understand only the basics of probability or calculus, Scientific Reasoning is a solid explanation of how Bayesian theory offers a unified and highly satisfactory accounting of scientific procedure, and is an absolute "must-read" for all scientists and students of science.