GoKawiilMiniLake offers open-source local emulator for Databricks API
MiniLake is a new open-source project (MIT licensed, Python 3.11+) that emulates the Databricks API locally, supporting real SQL queries, Delta Lake tables and Spark job execution without a cloud account or API key. It can be installed via pip or run as a Docker container, and is designed to work with tools like the Databricks SDK, CLI, Terraform and Asset Bundles pointed at a local server.
GoKawiil's interpretation of the reporting above, not reported fact.
By replicating Databricks' API locally, MiniLake could let developers test and build Databricks-dependent workflows without incurring cloud costs or needing cloud credentials, which may speed up local development and CI testing. Its MIT license and open-source nature suggest it could be adopted by the broader data engineering community as a lightweight alternative for prototyping, though its fidelity to full Databricks functionality in production scenarios remains unproven.
- MiniLake emulates core Databricks functionality — SQL, Delta Lake, Spark — entirely on a local machine.
- It is open source under the MIT license and installable via pip or Docker.
- The tool is compatible with existing Databricks tooling such as the SDK, CLI, Terraform and Asset Bundles.
Source: dmux.github.io, 2026-10-27
Published there as: “MiniLake Is a Local Databricks API Emulator with SQL, Delta Lake and Spark”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.