DuckLake is an integrated data lake and catalog format

DuckLake provides a lightweight one-stop solution for if you need a data lake and catalog. You can use DuckLake for a “multiplayer DuckDB” setup with multiple DuckDB instances reading and writing the same dataset – a concurrency model not supported by vanilla DuckDB. If you only use DuckDB for both your DuckLake entry point and your catalog database, you can still benefit from using DuckLake: you can run time travel queries, exploit data partitioning, and can store your data in multiple files instead of using a single (potentially very large) database file. ... Read full article.