Comment on Ask HN: How do you decide which language/tech stack to learn?parentComments−Fiahil4yUnless you want to leverage Arrow heavily in your data engineering pipeline, then Rust can replace Spark.−tonightstoast4yDo you have any further reading or crate recommendations? I have slowly been getting into rust but haven’t really used it for data engineering.−Fiahil4yPolars and data fusion−andrenth4yNot really my domain, but the arrow2 crate seems to be high quality work.
Comments
Unless you want to leverage Arrow heavily in your data engineering pipeline, then Rust can replace Spark.
Do you have any further reading or crate recommendations? I have slowly been getting into rust but haven’t really used it for data engineering.
Polars and data fusion
Not really my domain, but the arrow2 crate seems to be high quality work.