1-Bit Bonsai: The First Commercially Viable 1-Bit LLMsprismml.com 3 pointswicket4 months ago2 commentsSaveHideCopy link On HNComments−wicketOP4moRelated paperBitNet: Scaling 1-bit Transformers for Large Language Models (2023): https://arxiv.org/abs/2310.11453−vhodges4moThis came out too close to April 1 for me to know if it was real or not :).I do like the idea of local/on device llms so it's interesting and will keep an eye on it.
Comments
Related paper
BitNet: Scaling 1-bit Transformers for Large Language Models (2023): https://arxiv.org/abs/2310.11453
This came out too close to April 1 for me to know if it was real or not :).
I do like the idea of local/on device llms so it's interesting and will keep an eye on it.