PrismML Bonsai — Does a 1.15GB 8B Model Actually Make Sense?
PrismML Bonsai, built by a Caltech-founded team, is a 1-bit LLM that represents weights using only {-1, +1}. An 8B model fits in 1.15GB and reportedly runs 8x faster than full precision.
Tags
edge-ai
5 posts
Kitten TTS V0.8: Sub-25MB SOTA Speech for Edge Devices
A deep dive into Kitten TTS V0.8 — a 14M parameter, sub-25MB text-to-speech model matching cloud TTS quality. Analysis of edge deployment potential and the local voice AI trend.
$30 Radio + Local AI = Internet-Free Smart Home
Analyzing a real-world project that achieves voice control and smart home automation without internet using just a Mac mini and a $30 LoRa radio. A deep dive into local AI × IoT implementation and costs.
Training an LLM on CPU in 1.2 Hours
How FlashLM v3 trained a 13.6M-parameter LLM on CPU alone in 1.2 hours with MatMul-Free ternary-weight architecture, and its implications for edge AI.
FunctionGemma 270M — 90-97% Tool Calling in a Tiny Model
Analysis of how fine-tuning FunctionGemma 270M improved multi-turn tool calling accuracy from 10-39% to 90-97%, matching a 120B teacher model. More evidence that scaling isn't everything.