I have recently inherited the small and unsophisticated data engineering practice at my company and it's been a learning experience. The market for tooling seems to be incredibly frothy right now and I'm almost at a loss to make good selections. Is airbyte a direct competitor to stuff like fivetran or AWS Glue?
Yep. Airbyte is the leading open-source solution (with a Cloud hosted solution too). Fivetran is the leading closed-sourced one.
Open source makes it the solution future-proof, in the sense that it will address your future long-tail or custom needs, while a closed-source solution won't which will require you to build/maintain connectors in-house again.
Comments
I have recently inherited the small and unsophisticated data engineering practice at my company and it's been a learning experience. The market for tooling seems to be incredibly frothy right now and I'm almost at a loss to make good selections. Is airbyte a direct competitor to stuff like fivetran or AWS Glue?
Yep. Airbyte is the leading open-source solution (with a Cloud hosted solution too). Fivetran is the leading closed-sourced one.
Open source makes it the solution future-proof, in the sense that it will address your future long-tail or custom needs, while a closed-source solution won't which will require you to build/maintain connectors in-house again.