Skip to content

Comment on Continuous Diffusion Language Models (CDLM's)parent

Comments

It’s both. Fine-tuning a BERT model changes its weights, which causes the embeddings to change.

For example you might have one model which embeds a text query and another model which embeds an image. You also have a dataset of image + text captions. Training means updating the weights of those models so that the embedding of the image is close to the embedding of its corresponding caption.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.