Comment on Classifying all of the pdfs on the internetparentComments−throw109202yYou can apply statistical techniques to the embeddings themselves? How does that work?−mkl2yYou can apply statistical techniques to anything you want. Embeddings are just vectors of numbers which capture some meaning, so statistical analysis of them will work fine.−throw109202yDon't most statistical techniques rely on specific structure in the spaces containing the objects they operate on, in order to be useful?−mkl2yEmbeddings have structure, or they wouldn't be very useful. E.g. cosine similarity works because (many) embeddings are designed to support it.−throw109202yOh, that should have been obvious. Thank you for explaining.
Comments
You can apply statistical techniques to the embeddings themselves? How does that work?
You can apply statistical techniques to anything you want. Embeddings are just vectors of numbers which capture some meaning, so statistical analysis of them will work fine.
Don't most statistical techniques rely on specific structure in the spaces containing the objects they operate on, in order to be useful?
Embeddings have structure, or they wouldn't be very useful. E.g. cosine similarity works because (many) embeddings are designed to support it.
Oh, that should have been obvious. Thank you for explaining.