Now comes a new book, How Would You Move Mount Fuji? Microsoft's Cult of the Puzzle - How the World's Smartest Company Selects the Most Creative Thinkers by science writer William Poundstone. Poundstone talked to various people who have been involved in Microsoft hiring, including those who were interviewed, and those who gave interviews (full disclosure: I worked at Microsoft for ten years and was one of the people he talked to). He includes a lengthy list of questions, and most interestingly for many people, he also includes answers.
In the book, Poundstone traces the origins of this type of question, providing some fascinating information on the history of intelligence testing. He then chronicles how a certain type of puzzle interview caught on in the high-tech industry. Microsoft was not the first company to ask such questions, but it certainly popularized it.
Poundstone explains that responding to a problem you can't solve could be thought of as the fundamental problem in Artificial Intelligence (AI), and then continues,
"The problems used in AI research have often been puzzles or games. These are simpler and more clearly defined than the complex problems of the real world. They too involve the elements of logic, insight, and intuition that pertain to real problems. Many of the people at Microsoft follow AI work closely, of course, and this may help to explain what must strike some readers as peculiar--their supreme confidence that silly little puzzles have a bearing on the real world."
It could be--or maybe Microsoft employees assume that since they were hired that way, it's a great way to hire (and complaints from those who were not hired are just sour grapes). Most developers I knew thought of AI as a pretty academic discipline, and were more concerned with putting a dialog box up at the right location on the screen than trying to pass the Turing Test.
Nevertheless, as companies seek to emulate Microsoft, the questions have caught on elsewhere. And as Poundstone put it, such questions have now "metastasized" to other industries, such as finance.
This makes the effectiveness of these questions an important issue. Poundstone first presents evidence that "Where do you see yourself in five years" and "What are you most proud of" are fairly pointless questions. In one experiment he describes, two trained interviewers conducted interviews with a group of volunteers. Their evaluations were compared to those of another group who saw a fifteen second video of the interview: the candidate entering the room, shaking hands, and sitting down. The opinions correlated strongly; in other words, when you are sitting in an interview telling the interviewer what you do on your day off and what the last book you read was, the interviewer has already made up his or her mind, based on who knows what subjective criteria. As Poundstone laments, "This would be funny if it weren't tragic."
Puzzle interviews could hardly be worse than that, but it turns out the evidence that they are better is doubtful. Poundstone shows how intelligence tests are on very dubious scientific standing, and points out that Microsoft's interviews are a form of IQ test, even though Microsoft does not admit that publicly. In his 1972 book of puzzles Games for the Superintelligent, Mensa member James Fixx wrote, "If you don't particularly enjoy the kinds of puzzles and problems we're talking about here, that fact alone says nothing about your intelligence in general". Yet virtually every Microsoft employee accepts the "obvious" rationale, that only people who do well in logic puzzles will do well at Microsoft.
There is another important point about puzzle-based interviews: although you would think that they were naturally more objective than traditional interviews--more black or white, right or wrong, and therefore less subject to interpretation by the interviewer--in fact, interviewers' evaluation of answers can be extremely subjective. Once you have formed your impression of a candidate from the enter/handshake/sit-down routine at the start of the interview, it is easy to rationalize a candidate's performance in an interview, either positively or negatively. They needed a bunch of hints to get the answer? Sure, but they were just small hints and it's a tough problem. They got the correct answer right away? No fair, they must have seen it before.
How Would You Move Mount Fuji? is worth reading even if you don't plan on interviewing at Microsoft. It has some interesting history, a few good Microsoft tidbits, and puzzles that are entertaining on their own. For those considering a job at Microsoft, the book may ratchet up the "arms race" of questions. Microsoft employees may assume that people interviewing have read the book--so if you are going to interview there, or anywhere else that imitates their style, you should probably read it too.
--From Slashdot, Adam David Barr
