GoKawiilSlotstream lets 48GB Macs run the 104GB Qwen3.8-Flash-Next model via SSD streaming
A new open-source tool called slotstream enables Apple Silicon Macs to run the 104GB Qwen3.8-Flash-Next language model even when the machine doesn't have enough RAM to hold it, by streaming weights from disk and dynamically sizing memory use, down to an 8.1GB floor. On a 48GB Mac it delivers about 12 tokens per second in warm decode with a roughly 3-second cold start, capping memory use at 32GB so the rest of the system stays usable. It requires macOS 14+, Apple Silicon, and about 110GB of free disk space for the one-time weight download.