Skip to content

Comment on Fast drilldown dashboards from a single Parquet file

Comments

The bytes pass through a small Cloudflare Worker on the way, because the free r2.dev URL is rate-limited.

For a 40MB file I suggest hosting it directly on GitHub Pages - that's effectively a free CORS-enabled CDN and supports HTTP range requests, so you should be able to get that demo working without needing to involve Cloudflare Workers at all.

Agreed, for a public demo like this one, GitHub Pages would work great (or any host that speaks HTTP range requests with CORS). I used R2 partly because I wanted to see how it behaved, and partly because the real use-case doesn't fit Pages. The source data already lives on R2 as Iceberg, the files are per-customer and would probably need auth (signed URLs or a session-checking Worker), and obviously 10k customer cubes on a schedule works better with object PUTs rather than git deploys

Agreed, for a public demo like this one, GitHub Pages would work great

If you are okay with it being down regularly

Edit: Ironically, that would be the case now: https://www.githubstatus.com/incidents/hcbtzksccj2f

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.