How to get started with running Ollama local models with Opencode and Docker Sandboxes.
Viable local LLM development is here. With powerful models like Qwen 3.8 and Gemma4 we can now finally use these models to build out web applications. I'm using a Apple Macbook pro m5 48GB model. I think this is the sweet spot for local development as it allows you to run 30B models with a decent sized context.
Why I use Ollama. To be frank it's just easy. It has mlx now, so it's fast on Apple silicon. It has a pretty good model directory. It is also very stable and won't crash.
Why Opencode. Well, we need to start somewhere with this blog and opencode is a great harness.
There is one other tool that I use, docker sandboxes aka sbx . I use frontier models at work which require us to sandbox our harnesses. I also, like to run my local models in containers as they can just as easily mess up your computer with a unwanted hallucination.
Installing the tools
Install Docker Sandbox:
brew trust docker/tap && brew install docker/tap/sbx
Install Opencode:
brew install anomalyco/tap/opencode
... continue reading