Comment on Here comes the Muybridge camera moment but for textparentComments−10c82yGenerating embeddings is relatively simple with a model and Python code. There's plenty of them on HuggingFace, along with code examples.all-MiniLM-L6-v2 is a really (if not the most) popular one (albeit not SotA), with 384 dimensions: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...Edit: A more modern and robust suite of models comes from Nomic, and can generate embeddings with 64 to 768 dimensions (https://huggingface.co/nomic-ai/nomic-embed-text-v1.5).When the author talks about thousands of dimensions, they're probably talking about the OpenAI embedding models.
Comments
Generating embeddings is relatively simple with a model and Python code. There's plenty of them on HuggingFace, along with code examples.
all-MiniLM-L6-v2 is a really (if not the most) popular one (albeit not SotA), with 384 dimensions: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...
Edit: A more modern and robust suite of models comes from Nomic, and can generate embeddings with 64 to 768 dimensions (https://huggingface.co/nomic-ai/nomic-embed-text-v1.5).
When the author talks about thousands of dimensions, they're probably talking about the OpenAI embedding models.