Show HN: "Be horse." – a diffusion language model on an M2 Airboesch.dev 10 pointsencrux4 months ago2 commentsSaveHideCopy link On HNBe horse.Comments−ricardobeat4moLove this kind of experiment. Would the model perform better with word tokens?−encruxOP4moA friend of mine forked the repo and tried it with BPE (Byte-Pair Encodings), and it did noticeably improve performance.
Comments
Love this kind of experiment. Would the model perform better with word tokens?
A friend of mine forked the repo and tried it with BPE (Byte-Pair Encodings), and it did noticeably improve performance.