Logo
Insights Logo
Working Papers
Complimentary CONTENT

The Economic Logic of Large Language Models

November 18, 2024
By: Megan Czasonis, Huili Song, David Turkington

By Megan Czasonis, Huili Song, and David Turkington

 

We show that LLMs can effectively extrapolate from disparate domains of knowledge to reason through economic relationships, and that this may have advantages over narrower statistical models.

 

Fundamentally, large language models (LLMs) and numerical models both learn patterns in training data. However, while traditional models rely on narrowly curated datasets, LLMs can extrapolate patterns across disparate domains of knowledge. In new research, we explore whether this ability is valuable for predicting economic outcomes. First, we ask LLMs to infer economic growth based on hypothetical conditions of other economic variables. We then use our Model Fingerprint framework to interpret how they use linear, nonlinear, and conditional logic to understand economic linkages. We find that their reasoning is intuitive, and it differs meaningfully from the reasoning of statistical models. We also compare the accuracy of the models’ reasoning using historical data and find that the LLMs infer growth outcomes more reliably than the statistical models. These results suggest that LLMs can effectively reason through economic relationships and that cross-domain extrapolation may add value above explicit statistical analysis.

 

READ THE 1-PAGE SUMMARY

Author Bios
Megan Czasonis
Megan Czasonis is Managing Director and Head of Portfolio Management at State Street Markets
Huili Song
Huili Song is Vice President and Quantitative Researcher at State Street Markets
David Turkington
David Turkington is Senior Managing Director and Head of State Street Associates at State Street Markets
State Street Logo
1. Peter L. Bernstein Award for Best Article in an Institutional Investor Journal in 2013; Bernstein-Fabozzi/Jacobs-Levy Award for Outstanding Article in the Journal of Portfolio Management in 2006, 2009, 2011, 2013 (2), 2014, 2015, 2016, 2021; Graham & Dodd Scroll Award for article in the Financial Analysts Journal in 2002 and 2010. Roger F. Murray First Prize for Research Presented at the Q Group Conference in 2012, 2021, 2023. Harry M. Markowitz Award for Best Paper in the Journal of Investment Management in 2022, 2023. Doriot Award for Best Private Equity Research Paper in 2022.