GoKawiilDevelopers release open-source Edge0-145B on-device AI model
A development team has open-sourced Edge0-145B and Edge0-120B, two on-device AI models, alongside an inference framework and deployment tools. Edge0-145B is described as the first open-source on-device model with 145 billion parameters, running locally on a compatible laptop with reported peak memory of 29GB and decoding speeds above 80 tokens per second.