Tech News
← Home  ·  All topics

Vision Framework

2 GoKawiil briefs on this topic

Apple expands Foundation Models API to support Claude, Gemini and third-party LLMs

Apple has updated its Foundation Models framework, a native Swift API, to work with external server-based models such as Claude and Gemini, alongside its on-device Apple Intelligence models. The framework includes image understanding via multimodal prompts, built-in Vision tools like OCR and barcode scanning, guided generation, and tool calling. Small developers enrolled in Apple's App Store Small Business Program with under two million first-time downloads can access Apple's Foundation Models via Private Cloud Compute without cloud API costs.

Matter team launches Sundrop, a baby-photo app that skips cloud AI

Sundrop, a new iPhone app from the makers of read-it-later app Matter, turns parents' camera-roll photos into weekly recaps, time-lapses and themed scenes like magazine covers. The app processes images locally using Apple's Vision framework and on-device Core ML models rather than generative AI or cloud servers, and lets both parents sync shared photos via iCloud.