byteCoderSuccess! First Q2_K quantized 2-bit model of Enoch has been baked and now in automated testing. The...
Shared by Brian Roemmele @BrianRoemmele on X
Success! First Q2_K quantized 2-bit model of Enoch has been baked and now in automated testing. The goal is to have it small enough for an old iPhone or Android device as a standalone offline AI platform. After this I will try a merge with some of my local models.
Success! First Q2_K quantized 2-bit model of Enoch has been baked and now in automated testing. The goal is to have it small enough for an old iPhone or Android device as a standalone offline AI platform. After this I will try a merge with some of my local models.