Risks and Riddles

The Soviet Union was a puzzle. Al Qaeda is a mystery. Why we need to know the difference

Smithsonian Magazine | Subscribe

(Continued from page 1)

Solving puzzles is useful for detection. But framing mysteries is necessary for prevention.

That's one reason the FBI embarked on a change of mission after 9/11, from almost pure law enforcement to intelligence—from solving puzzles to framing mysteries. That change in mission requires an enormous change in organizational culture. For the puzzles of law enforcement, the measures of effectiveness are pretty clear—you can count the suspects collared and bad guys convicted. Terrorists, however, may commit but one crime, and by the time they do, it is too late. That scarcity of "collars" is a main reason why, rhetoric aside, counterterrorism was not a marquee FBI mission before 9/11.

For the mysteries of intelligence, measures of effectiveness are elusive. The goal of prevention is...nothing—an absence of attacks. But if no major terrorist attack occurs, does that represent the effectiveness of prevention, simple good luck or the fact that the threat was overstated in the first place?

That's one uncertainty we'll have to learn to live with. There are others that framing mysteries can help us understand.

No matter how much patients may seek the clarity of a puzzle, healthcare, too, is largely a mystery. The goal of medicine, like that of counterterrorism, is an absence—of illness and disease. Achieving that goal depends on many different factors. Behavior matters, but only in some complicated interaction with propensity; what is lethal obesity for one person is only a nuisance for another. Tests are imperfect predictors of illness, and treatments interact or have side effects.

While few doctors would put it this way, they act upon something that might be called Bayesian mystery framing. Bayes' theorem is a statistical technique for adjusting subjective probabilities in light of new, but inconclusive, evidence. Doctors base an initial assessment of a patient's health on propensity, as revealed by his or her medical history, and on diagnosis, determined through an examination. If the doctor's initial assessment is of a high probability of disease, he or she orders more tests, which in turn refine that probability. For chronic concerns, such as high blood pressure leading to heart disease, the initial assessment leads to a decision about whether and how to treat, followed by subsequent tests to see if the original probability of problems can be revised downward.

Most discussions about energy, as well, treat it as a puzzle: so many million barrels of proven reserves in country X, production to "peak" in country Y at a particular date and so on. From a geological point of view, the puzzle perspective makes sense: any individual drill hole or field has so much oil. Yet energy futures are a mystery, not a puzzle. How much oil a given well can produce is not the same as how much oil is there: whether it makes sense to use secondary or tertiary recovery methods after primary methods no longer suffice depends on price. And beyond a single well, the factors multiply. How fast will the global economy grow? What new energy discoveries will be made? Which alternative sources will come on line at what price?

In a recent issue of the New Yorker, writer Malcolm Gladwell made a fascinating observation about the Enron scandal. He noted that law-enforcement investigators and, later, prosecutors treated the case against former Enron CEO Jeffrey Skilling as a puzzle: Enron either lied or dissembled about its finances; either way, the public received too little information.

But a year before the scandal broke, Gladwell also noted, several financial analysts treated Enron as a mystery. Parsing the company's voluminous financial statements and quarterly findings, they realized that its vaunted profits—it claimed $111 billion in revenues in 2000—constituted a giant mystery: that is, the gains had not yet been realized, and depended on events that had not yet occurred. The company's actual cash flow was virtually nil. The analysts pursued the matter with Enron, and the company flew its accounting team to Dallas for a meeting. For the mystery-framers, the challenge was not too little information, but too much noise. A summary of a single set of Enron's complicated financial deals would have come to over a hundred thousand dense pages.

Ultimately, the mystery ended calamitously, as Enron's profit scenario failed to materialize, and the company collapsed. At that point, Enron became a puzzle, and the prosecutors' approach to solving it worked. After Skilling was convicted of fraud, he was sentenced to 24 years in prison, one of the most severe prison sentences ever given for a white-collar crime.

Comment on this Story

comments powered by Disqus