Skip to content

Comment on Show HN: pg-bulk-ingest – Now with multi-table support

Comments

I have always used pg_bulkload. It's a bit of pain to compile but the tool is really fast... I love how you can define what to do with constraint conflicts, etc.

Recently I used it to bulk import a billion rows and dedupe by a single column/constraint by throwing out the rows that conflicted. It did it-- in like two hours.

see: https://ossc-db.github.io/pg_bulkload/pg_bulkload.html

I didn't know about this - thanks!!

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.