While this might be fun, it definitely wouldn't be plausible for economic modeling. LLMs aren't companies and people, they won't behave as a real economy does, or even any decent approximation, even if you could orchestrate a few million agents. For example, a real human, if you were to ask them a complex question that requires deep web searches, data corroboration, etc would ask for recompense before doing any of the work, while an LLM will just do it. I think this alone suggests how well they would model real economic agents.