Skip to content

Comment on Amazon CloudWatch Logs Insightsparent

Comments

I'm with the team that built this. It's actually a new purpose-built engine, optimized for near real-time availability of large scale volumes of log data. It supports an unbounded number of fields across log records, and doesn't require the definition of a schema or dealing with data types at setup/ingestion time. Compute and storage are separate, which is what allows queries to address data from any time window. There is no limit on the data retention period.

We would all be exceptionally interested in more technical details about this.

Particularly if you compare to other approaches, talk about technical tradeoffs made, etc.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.