GoKawiilDeveloper runs 0.5B BitNet LLM across a 7-node ESP32S3 cluster
An open-source project splits a 0.5-billion-parameter 1.58-bit BitNet language model across seven ESP32S3 microcontrollers connected via SPI daisy-chain. One master unit handles tokenization, embeddings and final sampling, while six compute nodes each process four transformer blocks using 1.58-bit attention and MLP layers with KV caching in PSRAM.