You can also use tools like annoy or nmslib/hnsw which are built for this purpose -- store vectors on disk and do high performance similarity search against them.

Off topic - I'm pleasantly surprised that I could see this Twitter post without being logged in.