Congrats on your project. Reliable CDC is hard to set up.
I worked a bit on the space, focusing on api instead of DB, which is in the end a quite different problem.
My goal was to leverage LLM to auto-build connector on the fly.
I left the space because I realize that I didn't want to work on this problem, even though I believe in the "AI" approach, and think simplifying data transfer (or distributing compute) is one the key factor to scale data usage.
Comments
Congrats on your project. Reliable CDC is hard to set up.
I worked a bit on the space, focusing on api instead of DB, which is in the end a quite different problem. My goal was to leverage LLM to auto-build connector on the fly.
I started by building a lightweight ETL, that I open-sourced (https://github.com/BenderV/universal-data).
I left the space because I realize that I didn't want to work on this problem, even though I believe in the "AI" approach, and think simplifying data transfer (or distributing compute) is one the key factor to scale data usage.