By Amy Zalman
The demand for measurable outcomes has historically posed an enduring challenge for Strategic Foresight projects both within and beyond governments. As Robert Shea observes in his recent post on Advancing the Evidence Agenda in the next administration, the U.S. Government has long sought better nuance in measuring outcomes and to more readily surface programs’ evidence of effectiveness. However, in the case of Strategic Foresight, common notions of outcomes and effectiveness may not apply, as I will explain in more detail below. This difficulty is no reason to throw out the proverbial baby with the bathwater. Rather, it is an opportunity to sharpen the government-wide understanding of what Strategic Foresight does—and does not—do, and to continue refining our measurement and evaluation toolset.
Getting Clear about What Foresight Does, So We Know what to Measure
Strategic Foresight is a set of techniques and processes designed to help managers orient policies and actions toward the future, in part by stressing that policies and actions in the present help to shape the future. In everyday parlance, foresight and the work of futurists are often conflated with our simplest notions of prediction, the idea that someone might see into the future and know what, when and where an event will happen. This is wrong. Those who work in strategic foresight do not connect dots. Rather, they seek weak signals and trends in a world they presume to be governed by complexity and uncertainty, the free will of men and women, and coincidence and accident, as well as intent. How these signals will surface later, and how trends – in demography, technology, and the economy, for instance – will play out, cannot be known exactly at present. However, rigorous and systematic ways of examining the future, coupled with expert opinion and the free play of imagination, can help governments produce a range of scenarios of what the future could look like.
Having these scenarios in hand positions leaders and managers to be more conscious about why they are pursuing particular strategies, resource allocations or policies and, as a result, to greater agility should the need to change course arise. Having these scenarios in hand also ensures that leaders are focused on the future, which can make policy less reactive.
How to Measure the Effectiveness of Strategic Foresight
Once we grasp that the activity of Strategic Foresight is to help leaders make better decisions and to more powerfully shape the future, we can also better grasp what we might measure. Here are just a few ways in which the government’s effectiveness could be measured:
(1) Performance measurements: Did the Agency engage in strategic foresight activities and if so to what degree;
(2) Quality of Strategic Foresight: The quality of evidence and richness of the assessment of the future, as well as the plausibility of the scenarios created as the basis for policy, can be evaluated;
(3) Leader assessments: Policy or resource allocations before and after strategic foresight activities can be gauged for their responsiveness to future threats and opportunities; program leaders and managers can rate their own level of understanding;
(4) Measure additional government values. Sid Kaplan has persuasively made the case that cross-agency collaboration is essential to strategic foresight. This is also measurable.
(5) Assess whether and to what degree Foresight based exercises influence policies and actions. The US Coast Guard’s Evergreen Program, which generates future based scenarios, uses scenario development to create and surface otherwise inchoate Strategic Needs—the basis for the Coast Guard’s strategic direction. In recent months, the program’s leadership has mapped the degree to which the needs identified via Strategic Foresight are developed in strategic documents and, from there, when and how they appear in concrete decisions.
(6) Develop measures that take into account the range of virtues that Strategic Foresight promotes. The United States Government is rightly concerned that its workforce, at every level, display the qualities required of us to thrive in complex times: imagination, innovation in our thinking, cross-disciplinarily and lateral abilities, the ability to work beyond siloes and programs. Strategic Foresight activities sharpen all of these abilities, in addition to sharpening the U.S. competitive edge in a tough world, full of surprising threats and astonishing opportunities.