Skip to content
Tech News
← Back to articles

Typesafe-computer-use drives a Mac toward a goal for 1/50th of a cent per step

read original get Apple Mac mini M2 → more articles
Why This Matters

This project demonstrates that many computer-automation tasks don't require expensive, slow frontier AI models to interpret screenshots—a lightweight classifier can make routine navigation decisions at a fraction of the cost and time. This matters because it could make AI-driven automation dramatically more economical and scalable for businesses and developers who currently rely on costly large multimodal models for simple, repetitive UI tasks.

Key Takeaways
Worth a Look

Apple Mac mini M2 — This kind of low-cost, always-on automation loop is exactly the workload a compact, efficient desktop like the Mac mini was built for. It sips power while running background agents and classifiers around the clock, making it a great low-footprint host for projects like this one.

See Apple Mac mini M2 on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.

typesafe-computer-use drives a Mac toward a goal you type in plain English, for about a fiftieth of a cent per step. It never sends a screenshot to a big model. Instead it reads the screen deterministically, asks a small classifier which action comes next, and only calls a writing model when a text field genuinely needs free text.

clicker "go to techcrunch and take me to the checkout page for the cheapest tickets to their next upcoming event" --act

Why

Frontier-model computer use is capable and expensive: every step ships a screenshot and waits several seconds for a plan. Most steps do not need a plan. They need one choice from a short list, made quickly and cheaply, with a confidence number you can gate on.

TypeSafe sells exactly that: a decision model that answers a Choice over up to 255 options with a full probability distribution and a calibrated confidence, in a few hundred milliseconds, with free output tokens. This project is a computer-use loop built around it.

Measured on the same screenshot and goal, one decision each:

typesafe (jev) Claude Opus 5, bare screenshot multiplier input tokens 4,882 4,785 same cost per decision $0.0002 $0.032 155x cheaper cost per decision, realistic loop with history $0.0002 $0.035 to $0.08 170x to 390x cheaper cost per 12-step task $0.003 $0.40 to $0.90 130x to 300x cheaper model latency 0.13 to 0.38 s 5.2 s 14x to 40x faster end-to-end step, with capture and OCR about 1.5 s about 5.5 s 3.7x faster

The honest caveat: the big model read the event dates off the pixels and compared them unaided. The classifier needed the date parsing described below. Every piece of reasoning the frontier model does for free has to be rebuilt here as deterministic state.

Install

macOS 14 or newer, Python 3.12 or newer, uv.

... continue reading