Skip to content

Comment on Comparing SQLite, DuckDB and Arrow with UN trade data

Comments

Might as well try Arrow Feather, there's an R binding for it. This Flatbuffers-based format can be memory mapped and it requires very little decoding. Super fast and light on resources.

Also, Parquet supports different encodings, some of which may be faster, denser, and/or consume less RAM, or all of the above.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.