Skip to content

Comment on DuckDB – Data power tools for your laptop, now in Clojure (2023)parent

Comments

but it's irritating to perform a full row-to-column conversion through an inefficient, non-batched API in order to get the data through JDBC and into TMD

[...]

In the last two years, DuckDB improved a lot. Importantly, the C interface now provides a batched system for both inserts and querying, which enables processing very large joins

That's why. Basically JDBC doesn't offer the batched APIs needed to get the same performance.

You could just let the driver support something like “LOAD DATA INFILE LOCAL <>” for the same effect.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.