I was wondering the same, that's basically exactly what Claude already does out of the box without having to use some custom GUI layer on top.

Describe what you want to build, and AgentSwift uses Claude to discover your project, implement changes, build, run, and validate — without you touching Xcode.