Comment on DPO fine-tuned Mistral 7B beats Llama 70B on MT BenchparentComments−brucethemoose22yI dunno. I totally missed this and will check it out.- Huggingface is less likely to "cheat" by training on tests than other orgs, I think.- Some finetunes are really good at a particular test (like XWin). This isnt necessarily a bad thing, if they are good at a specific niche.
Comments
I dunno. I totally missed this and will check it out.
- Huggingface is less likely to "cheat" by training on tests than other orgs, I think.
- Some finetunes are really good at a particular test (like XWin). This isnt necessarily a bad thing, if they are good at a specific niche.