Skip to content

Comment on Pinecone Open-Sources AWS Reference Architecture with Pulumiparent

Comments

Ask yourself the same question about an OLAP system. Once you’re at a large enough scale, it makes sense to use tools custom designed for your access patterns.

I work on Azure SQL, but it’s pretty clear that this is a cool demo. It may scale for some usages, but I wouldn’t build a production system on it.

Well tried it with ~ 34 million records , which is good enough sample for our usecase

At what number of queries per second?

Azure SQL
large enough scale

You mean something like the Hyperscale service tier? This is what we are building our new products on top of.

Hyperscale is awesome. My point is more for vector search. Once you’re at a large enough scale, the simple algorithms for similarity search break down. You’d need something that implements HNSW and designed their database indexes around it.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.