Tech News
← Home  ·  All topics

Gpu Cloud

2 GoKawiil briefs on this topic

Apple built 'Minions' system to turn idle Macs into internal GPU cloud

Apple researchers detailed a system called Minions in an arXiv paper, which harnesses idle Apple Silicon Macs across the company's network to process AI inference workloads. The system splits jobs—embedding tasks and LLM text generation via Ollama—into subtasks that idle Macs pull and execute, cutting wait times from over 10 hours in GPU queues to minutes.

Research proposes 'Minions' system to pool idle Apple Silicon GPUs for AI inference

A new paper describes Minions, a distributed system that aggregates spare GPU capacity from macOS devices running Apple Silicon chips to run large-scale machine learning inference workloads. The authors say the system handles task scheduling, fault tolerance, and resource utilization across these devices without requiring teams to buy additional GPU hardware.