Measuring and Managing Performance in Organizations (Paperback)

by Robert D. Austin (Author)

Editorial Reviews

Review
"Buy Measuring, and use it to balance the points the overly enthusiastic fans of measurement will make in your next project meeting."

Product Description
Here's an essential reference for all managers facing the multitude of issues involved in any measurement program. Developed from an award-winning doctoral thesis at Carnegie Mellon University, this is a lucid, captivating analysis of organizational performance measurement.

Author Robert D. Austin emphasizes the behavioral aspects of measurement situations. The focus is on people and how they react when they are part of organizational systems that are being measured.

Interviews enrich the text, conducted with eight recognized experts in the use of measurement to manage computer software development: David N. Card, of Software Productivity Solutions; Tom DeMarco, of the Atlantic Systems Guild; Capers Jones, of Software Productivity Research; John Musa, of AT&T Bell Laboratories; Daniel J. Paulish, of Siemens Corporate Research; Lawrence H. Putnam, of Quantitative Software Management; E. O. Tilford, Sr., of Fissure; plus the anonymous Expert X.

A practical model for analyzing measurement projects solidifies the text -- don't start without it!

From the Foreword
". . . admirable . . . We believe this is a book that needs to be on the desk of just about anyone who manages anything."               -- Tom DeMarco and Timothy Lister

From the Preface
"Some books on measurement so strongly advocate its use that they look almost exclusively at success stories. They profess to tell you how to get it right but they supply little or no detail about the consequences or likelihood of getting it wrong. Partly this is because stories of management failures are harder to find than accounts of successes, for obvious reasons: People like to claim credit for successes and forget failures. But you can learn a lot from failure. So I've worked to find examples of failure and devoted a significant portion of this book to examining the examples in search of a common pattern. . . . Understanding the pattern of failure can help us avoid it."               -- RDA

Product Details

• Paperback: 216 pages
• Publisher: Dorset House Publishing Company, Incorporated (June 1996)
• Language: English
• ISBN-10: 0932633366
• ISBN-13: 978-0932633361
• Product Dimensions: 8.9 x 6 x 0.6 inches
• Shipping Weight: 12 ounces (View shipping rates and policies)
• Average Customer Review: 5.0 out of 5 stars See all reviews (10 customer reviews)
• Amazon.com Sales Rank: #473,201 in Books (See Bestsellers in Books)

Customer Reviews

Most Helpful Customer Reviews

22 of 22 people found the following review helpful:

5.0 out of 5 stars Why employee incentive programs go bad, January 29, 2002

By	Bret Pettichord (Austin, Texas) - See all my reviews (REAL NAME)

This book provides an amazingly convincing explanation for why employee incentive programs often do more harm than good. It's often because knowledge work is too complicated to benefit from any simple measures.

The core argument of the book uses some mathematical reasoning that will be accessible to anyone who stayed awake through Economics 101. This is illuminating enough, but then Austin continues to add on additional insights.

I've placed this book on my shelf next to The Logic of Failure (Doerner) and Normal Accidents (Perrow). All of these books provide solid scientific arguments for the limits of management.

As a software tester, the most obvious application of the book is as an explanation of exactly when counting defects (found by testers, or introduced by programmers) is likely to lead to trouble.

11 of 11 people found the following review helpful:

5.0 out of 5 stars A simplified bare-bones model of how a managed organization works, December 22, 2006

By	Vincent Poirier "CISSP, http://vfp15.wordpres... (Tokyo, Japan) - See all my reviews (TOP 1000 REVIEWER)    (REAL NAME)

Robert Austin presents an idealized model of a managed organization. Instead of looking at an organization made up of thousands of employees and a few hundred managers arranged in a hierarchy, Austin's model consists of three participants: a principal, i.e. a manager, and an agent, i.e. an employee, and finally a customer who buys the goods or services provided by the agent under the supervision of the principal.

He also assumes that an agent's job consists of two activities and the customer is happy if the agent performs well in both. Austin looks at the cases where the principal can monitor neither of the two activities, where she can monitor only one of the two activities, or where she can monitor both activities. According to the model the agent will behave differently in all three cases.

If the principal cannot (or will not) measure either activity, then we have delegated management, if she can measure both activities, then we have a fully supervised model, and if she can measure only one of two activities, we have a dysfunctional model.

When delegating management, the assumption is that agents want to work well, that they are not deriving maximum satisfaction by exerting the least amount of effort.

When supervising, the principal evaluates overall performance by measuring certain aspects of the agent's activity. Austin's conclusion is that measuring performance won't work unless you can measure everything employees should be doing (i.e. full supervision). Incomplete measurement is not only useless, it is dangerous since it motivates agents to make efforts only for what is measured.

For example, if a help desk line measures performance by the number of calls an employee takes, then employees are motivated to spend very little time per call. The customer is left dissatisfied, but the measurements show that the agent is providing first class results. Austin calls this situation dysfunctional.

Throughout the book, Austin emphasizes dysfunction to the point where it seems he dismisses any and all attempts at measurement, but to quote Austin, the central message of the book is that "organizational measurement is hard". It's not impossible.

He suggests one method, probabilistic measurement, to mitigate dysfunction. For instance, if dysfunction comes from being unable to measure everything an agent does, e.g. you just can't have your supervisors listen to all help desk calls, the principal can carry out random samplings of performance, e.g. you can record all the calls and listen to a random selection of them each day. The agent will then expend effort along those dimensions that cannot be completely measured simply because he knows they might be.

All in all, an effectively simplified model of organizations sure to spark healthy and constructive debate.

Vincent Poirier, Dublin

12 of 13 people found the following review helpful:

5.0 out of 5 stars Most important book on metrics and measurement I ever read, June 26, 1997

By A Customer

In my role as a methodologist, business process modeler, and designer of metrics and measurement programs I have long been concerned with the preverse and unanticipated effects of such measurement programs. For the first time Austin has identified what is going wrong with most types of measurements and offers a model for how to correctly construct a non-disfunctional approach to measuring things in the real world. I now understand what is wrong with the Consumer Price Index, why my marriage failed, and a lot of other inexplicable things about the world around me. I would urge every manager and professional to read at least the first few chapters of this book in order to understand the tremendous harm incorrect measurement can do and how collect and use measurements properly