Skip to content

Comment on Data engineering and software engineering are convergingparent

Comments

SQL is beautiful when it works but when it doesn’t you end up with some abomination eg if you need some kind dynamic query.

The two most helpful things with SQL are (1) always use set-based operations (never a cursor) and (2) break up your queries into smallest possible reusable chunks (CTEs). Sprinkle in tests to taste. Without some discipline SQL can get out of hand. This is what made dbt popular.

Can you share more detail? Every pain point I've seen can be handled by a more suitable/performant/flexible DB and/or software that makes working with SQL less painful.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.