1-Bit Bonsai: The First Commercially Viable 1-Bit LLMs(prismml.com)3 points·by wicket·3 เดือนที่ผ่านมา·2 commentsprismml.com1-Bit Bonsai: The First Commercially Viable 1-Bit LLMshttps://prismml.com/news/bonsai-8b2 commentsPost comment[–]wicket·3 เดือนที่ผ่านมาreplyRelated paperBitNet: Scaling 1-bit Transformers for Large Language Models (2023): https://arxiv.org/abs/2310.11453[–]vhodges·3 เดือนที่ผ่านมาreplyThis came out too close to April 1 for me to know if it was real or not :).I do like the idea of local/on device llms so it's interesting and will keep an eye on it.
BitNet: Scaling 1-bit Transformers for Large Language Models (2023): https://arxiv.org/abs/2310.11453