Comment on Honey, I shrunk the embeddings: Matryoshka vs. PCAparentComments−stephantul1moPCA is applied after the model, so there should be no difference in embedding throughput. Lookups in the index should be faster, but that speedup also applies equally to MRL.So I guess the answer is: no
Comments
PCA is applied after the model, so there should be no difference in embedding throughput. Lookups in the index should be faster, but that speedup also applies equally to MRL.
So I guess the answer is: no