WOW. @Microsoft just open-sourced the code for one of "THE MOST" influential Paper of 2024 🔥 1-bit ...

Saved Oct 20, 2024

Shared by Rohan Paul @rohanpaul_ai on X

WOW. @Microsoft just open-sourced the code for one of "THE MOST" influential Paper of 2024 🔥 1-bit LLMs (e.g., BitNet b1.58). Now you can run a 100B param models on local devices quantized with BitNet b1.58 on single CPU at 5-7 tokens/sec 🤯 The dream we have all been waiting https://t.co/dxwZPewfvb

WOW. @Microsoft just open-sourced the code for one of "THE MOST" influential Paper of 2024 🔥 1-bit LLMs (e.g., BitNet b1.58). Now you can run a 100B param models on local devices quantized with BitNet b1.58 on single CPU at 5-7 tokens/sec 🤯 The dream we have all been waiting https://t.co/dxwZPewfvb

Visit original →