Comment on Character Prefix ConditioningparentComments−pizza1ySeems like we should just use gradual annealing of tokens to more fine grained single character tokens over the course of training then−kevmo3141yI believe that's similar to the idea behind https://github.com/facebookresearch/blt
Comments
Seems like we should just use gradual annealing of tokens to more fine grained single character tokens over the course of training then
I believe that's similar to the idea behind https://github.com/facebookresearch/blt