Ace: Realtime Computer Autopilot

Intelligence. On your computer. Ace is a computer autopilot that performs tasks on your desktop using your mouse and keyboard. Ace outperforms other models on our suite of computer use tasks, which we are open-sourcing here. We're making the ace-control models available to selected partners through our developer platform. Model Accuracy Comparison Correct Left-Click Predictions ace-control-medium ace-control-small Operator Molmo-72B-0924 Claude 3.7 Sonnet UI-TARS-72B-SFT OmniParser V2 + GPT-4o Gemini 2.0 Flash Qwen2.5-VL-72B-Instruct Click Accuracy (95% CI) Ace is exceptionally fast! It can perform many tasks in superhuman time. Action Prediction Latency (ms) Ace works like we do—performing mouse clicks and keystrokes based on the screen and prompt—trained with <3 by our team of software specialists and domain experts on over a million tasks. Ace is still learning and can make mistakes. Here are some examples of its failures: We're just beginning. As we increase training resour ... Read full article.