How to vibe code for free: Running Qwen3 on your Mac, using MLX

(or how to Vibe code for free!) Today I wanted to test running Qwen3 latest models locally on my mac, and putting that in an agentic loop using localforge. (or how to Vibe code for free!) Qwen3 turns out to be a quite capable model available on ollama: https://ollama.com/library/qwen3 And also on mlx community: https://huggingface.co/collections/mlx-community/qwen3-680ff3bcb446bdba2c45c7c4 Feel free to grab a model of your choice depending on mac hardware and let's dive in. Here is what I did step by step: Step 1: Install the core MLX library pip install mlx Copy Step 2: Install the LLM helper library pip install mlx-lm Copy Step 3: Run the model server mlx_lm.server --model mlx-community/Qwen3-30B-A3B-8bit --trust-remote-code --port 8082 Copy This command will both download and serve it (change port to whatever you want, and be ready to download tens of gigabytes of stuff) After download is done you should see something like: 2025-05-01 13:56:26,964 - INFO - Starting http ... Read full article.