So embedding space itself is interesting. It's more than a step to an LLM. That's been known for a while, back to that early result where "King" - "Man" + "Woman" -> "Queen". This article, though, suggests more uses for embedding spaces. This could be interesting. It's a step beyond viewing them as a black box.
[alas, HN scrubs venus and mars symbols, and I shall spare you all the ancient egyptian hieroglyphs and O'Keeffean mathematical symbols, so `f` and `m` they are]
Comments
So embedding space itself is interesting. It's more than a step to an LLM. That's been known for a while, back to that early result where "King" - "Man" + "Woman" -> "Queen". This article, though, suggests more uses for embedding spaces. This could be interesting. It's a step beyond viewing them as a black box.
Is ♔ - m + f = ♕ specific to embeddings, or does it also work in https://en.wikipedia.org/wiki/Formal_concept_analysis#Exampl... ? (either as ♔ ⊕ f ⊕ m = ♕ or as ♔ ⋀ not(m) ⋁ f = ♕?)
[alas, HN scrubs venus and mars symbols, and I shall spare you all the ancient egyptian hieroglyphs and O'Keeffean mathematical symbols, so `f` and `m` they are]