Skip to content
Tech News
← Back to articles

Darkbloom – Private inference on idle Macs

read original get Darkbloom Privacy Software → more articles
Why This Matters

Darkbloom introduces a method for private inference on idle Macs, potentially reducing costs and increasing privacy for AI computations. This innovation could disrupt the traditional AI compute market by enabling more efficient and secure local processing, benefiting both consumers and the industry. It highlights the importance of leveraging existing hardware for AI workloads to lower barriers and costs.

Key Takeaways

02 — Motivation

The AI compute market has three layers of margin.

NVIDIA sells GPUs to hyperscalers. AWS, Google, Azure, and CoreWeave mark them up and rent capacity to AI companies. AI companies mark them up again and charge end users per token. Each layer takes a cut. End users pay multiples of what the silicon actually costs to run.

Current supply chain → → API providers → End users