Comment on Show HN: RapidFire AI – parallel RAG experimentation with live run interventionComments−kbigdelyshOP6moHappy to answer questions about the IC Ops design, the scheduling algorithm, or how the online aggregation works. We use a fair-share shard scheduler inspired by how databases handle multi-tenant query execution.
Comments
Happy to answer questions about the IC Ops design, the scheduling algorithm, or how the online aggregation works. We use a fair-share shard scheduler inspired by how databases handle multi-tenant query execution.