Logo
Insights Logo
Working Papers
Complimentary CONTENT

The Economic Logic of Large Language Models

November 18, 2024
By: Megan Czasonis, Huili Song, David Turkington

By Megan Czasonis, Huili Song, and David Turkington

 

We show that LLMs can effectively extrapolate from disparate domains of knowledge to reason through economic relationships, and that this may have advantages over narrower statistical models.

 

Fundamentally, large language models (LLMs) and numerical models both learn patterns in training data. However, while traditional models rely on narrowly curated datasets, LLMs can extrapolate patterns across disparate domains of knowledge. In new research, we explore whether this ability is valuable for predicting economic outcomes. First, we ask LLMs to infer economic growth based on hypothetical conditions of other economic variables. We then use our Model Fingerprint framework to interpret how they use linear, nonlinear, and conditional logic to understand economic linkages. We find that their reasoning is intuitive, and it differs meaningfully from the reasoning of statistical models. We also compare the accuracy of the models’ reasoning using historical data and find that the LLMs infer growth outcomes more reliably than the statistical models. These results suggest that LLMs can effectively reason through economic relationships and that cross-domain extrapolation may add value above explicit statistical analysis.

 

READ THE 1-PAGE SUMMARY

Author Bios
Megan Czasonis
Megan Czasonis is a Managing Director and Head of Portfolio Management Research at State Street Associates. The Portfolio Management Research team collaborates with academic partners to develop new research on asset allocation, risk management, and investment strategy. The team delivers this research to institutional investors through indicators, advisory projects, and thought leadership pieces. Megan has co-authored various journal articles and works closely with institutional investors to develop customized solutions based on this research. Megan graduated Summa Cum Laude from Bentley University with a B.S. in Economics / Finance.
Huili Song
Huili Song is a Vice President and Quantitative Researcher at State Street Associates (SSA). Since joining SSA in 2020, Huili has worked on quantitative applications of SSA's research and led product development initiatives for State Street Markets' research platform - Insights, offering intuitive and interactive way to engage with indicator products and research. Her research focuses on data-driven analysis and statistical learning in the realm of asset predictions, portfolio construction and risk management. Huili holds a Bachelor of Science Degree in Applied Mathematics from Shanghai Jiao Tong University and a Master of Finance Degree from Massachusetts Institute of Technology, with a concentration in financial engineering.
David Turkington
David Turkington is Senior Managing Director and Head of State Street Associates, State Street Markets’ decades-long partnership with renowned academics that produces innovative research on markets and investment strategy. David is a frequent presenter at industry conferences, has published more than 40 research articles in a range of journals, and serves on the editorial board of the Journal of Alternative Investments. He is the co-author of three books including “Asset Allocation: From Theory to Practice and Beyond” and “Prediction Revisited: The Importance of Observation.” His published research has received the 2010 Graham and Dodd Scroll Award, five Bernstein-Fabozzi/Jacobs-Levy Outstanding Article Awards, the 2013 Peter L. Bernstein Award for best paper in an Institutional Investor journal, the 2021 and 2023 Roger F. Murray First Prize for outstanding research presented at the Q Group seminars, and the 2022 and 2023 Harry Markowitz awards for best paper in the Journal of Investment Management.
State Street Logo
1. Peter L. Bernstein Award for Best Article in an Institutional Investor Journal in 2013; Bernstein-Fabozzi/Jacobs-Levy Award for Outstanding Article in the Journal of Portfolio Management in 2006, 2009, 2011, 2013 (2), 2014, 2015, 2016, 2021; Graham & Dodd Scroll Award for article in the Financial Analysts Journal in 2002 and 2010. Roger F. Murray First Prize for Research Presented at the Q Group Conference in 2012, 2021, 2023. Harry M. Markowitz Award for Best Paper in the Journal of Investment Management in 2022, 2023. Doriot Award for Best Private Equity Research Paper in 2022.