Although I don't think it even matters. They could easily cherry pick a period that is favorable for them. Wasting time and money on short term trading, rather than long term investment, using LLM or not, is never a good strategy for most people.
They backtested with public models, wouldn't the model weights already have the data? I double checked with chatgpt and looks like agents also had web search tool available so they could just lookup the past.
Comments
Anytime I see an investment framework I look for a “Performance” section or at least a backtest
There is a section in their paper.
Although I don't think it even matters. They could easily cherry pick a period that is favorable for them. Wasting time and money on short term trading, rather than long term investment, using LLM or not, is never a good strategy for most people.
They backtested with public models, wouldn't the model weights already have the data? I double checked with chatgpt and looks like agents also had web search tool available so they could just lookup the past.
https://chatgpt.com/share/6aa00d5e-6920-83ee-8e3e-9cbf23f7bd...