Journal Article: Unpacking the Future: A Nudge Toward Wider Subjective Confidence Intervals

Subjective probabilistic judgments in forecasting are inevitable in many real-life domains. A common way to obtain such judgments is to assess fractiles or confidence intervals. However, these judgments tend to be systematically overconfident. Further, it has proved particularly difficult to debias such forecasts and improve the calibration. This paper proposes a simple process that systematically leads to wider confidence intervals, thus reducing overconfidence. With a series of experiments, including with professionals, we show that unpacking the distal future into intermediate more proximal futures systematically improves calibration. We refer to this phenomenon as the time unpacking effect, find it is robust to different elicitation formats, and address the possible reasons behind it. We further show that this results in better overall forecasting performance when improved calibration is traded off against less sharpness, and that substantive benefits can be obtained even from just one level of time unpacking.
Author’s Name: Kriti Jain, Kanchan Mukherjee, J. Neil Bearden and Anil Gaba
Journal Name: Management Science
Year of Publication: September 2013
Volume: Vol. 59, Issue 9, September 2013, Pg: 1970-1987
URL: http://pubsonline.informs.org/doi/abs/10.1287/mnsc.1120.1696
Journal Article: Unpacking the Future: A Nudge Toward Wider Subjective Confidence Intervals
Subjective probabilistic judgments in forecasting are inevitable in many real-life domains. A common way to obtain such judgments is to assess fractiles or confidence intervals. However, these judgments tend to be systematically overconfident. Further, it has proved particularly difficult to debias such forecasts and improve the calibration. This paper proposes a simple process that systematically leads to wider confidence intervals, thus reducing overconfidence. With a series of experiments, including with professionals, we show that unpacking the distal future into intermediate more proximal futures systematically improves calibration. We refer to this phenomenon as the time unpacking effect, find it is robust to different elicitation formats, and address the possible reasons behind it. We further show that this results in better overall forecasting performance when improved calibration is traded off against less sharpness, and that substantive benefits can be obtained even from just one level of time unpacking.
Author’s Name: Kriti Jain, Kanchan Mukherjee, J. Neil Bearden and Anil Gaba
Journal Name: Management Science
Year of Publication: September 2013
Volume: Vol. 59, Issue 9, September 2013, Pg: 1970-1987
URL: http://pubsonline.informs.org/doi/abs/10.1287/mnsc.1120.1696