GoKawiil
Tech News
A new open-source library called Waymark lets developers build background task workflows that survive server restarts and crashes without adding extra infrastructure beyond Postgres. It ships as a single Python package bundling both client and server binaries, with 'actions' as distributed async functions and 'workflows' as the durable orchestration layer around them. Python is the first supported language, with more planned.
Orkes, maker of the Conductor workflow platform, commissioned Jepsen to test its in-house database ParticleDB, starting with version 1.1.4. ParticleDB combines SQL, key-value storage, vector search and analytics in one Rust-built engine, and can run as a single node or as a Raft-based replicated cluster, though replication is limited to enterprise cloud deployments. Orkes had already used an earlier 1.0.0 build internally and with some customers before refactoring the system for a broader public release via particledb.ai.
ParadeDB published results showing its Postgres-based search extension now runs COUNT queries roughly twice as fast as TantivyIndex (TIN) on a Wikipedia dataset benchmark, reaching 5,353 queries per second versus 2,645.8 QPS. The company says the gains come from optimizations such as segment partitioning that reduce costly visibility-map and CTID page accesses, which previously consumed over 80% of page reads during COUNT operations.
Muhammad Aqeel built pgVolvra, a tool that logs every row change—before and after values, author, timestamp, and transaction—on chosen Postgres tables so individual mistaken changes can be reversed without a full database restore. It is implemented entirely in plain SQL and PL/pgSQL, requiring no compiled extension, superuser access, or filesystem access, and installs by running a single SQL file against the database.
Michael Malis, creator of the Rust-based Postgres rewrite project pgrust, has found and reported several genuine bugs in PostgreSQL while testing his project, including issues affecting SP-GiST operations, JSONPath results, pgcrypto, the dictionary loader, and money-type overflow handling. The author of this piece notes pgrust's main goal is improved performance, not just a rewrite, and vouches for Malis's credibility based on personal familiarity with his work.
AWS engineer Marc Brooker describes building interactive animations to illustrate system failure modes, including a 'Stability Sim' for metastability and a demonstration of Raft losing writes when a cluster member's storage lies about fsync(). He also shares a trace from Postgres 16 running in a MicroVM showing how a load spike pushes queries off the page cache and onto disk, slowing the database even after handling 20 queries-per-second comfortably before the spike.
A bug in PostgreSQL's recovery_prefetch feature has been tied to real-world production outages, including a case where a customer's physical standby server suffered replay lag of several hours. The issue stems from the prefetch code issuing unnecessary fadvise system calls even when a page was already available from a full-page image in the WAL, burning excessive CPU in kernel space. The underlying concern was flagged by PostgreSQL developer Stephen Frost in a February 2021 mailing list message, well before the feature shipped, but was not addressed at the time.
A technical blog post explains optimizations for using Postgres DELETE efficiently rather than resorting to table truncation or partition dropping. The authors applied tuning techniques—focused on cache and index performance—to a Postgres-backed durable workflows and queues system handling tens of thousands of workflows and steps per second, in order to enforce data retention policies.
Lukas Vogel, creator of DoomQL, has built SQLDoom, a project that runs Doom's game logic inside the CedarDB database using 5,900 lines of SQL code. A Python frontend only handles graphics, sound and input, while all game calculations and state updates happen through SQL statements against database tables converted from Doom's original WAD files.
Supabase announced it is acquiring Turso, a company that rebuilt SQLite in Rust and built a cloud platform letting a single server manage millions of lightweight databases. Supabase said existing users on either platform won't see immediate changes: it will keep building on Postgres while Turso continues its SQLite work, with the two eventually integrated into one ecosystem.
ParadeDB published benchmark results showing it improved BM25-ranked text search throughput from 33 QPS to 81.9 QPS using the same StackExchange dataset and benchmarking harness PlanetScale used in its TIN launch post two weeks earlier. The company says the gains came from several optimization passes unrelated to document identifier handling, countering PlanetScale's claim that its speed advantage stemmed from using Postgres' internal ctid fields.
A developer has released Light Cloud, a cloud console that organizes deployments like a file system, combining static site hosting, containers, and managed Postgres databases in one project. The tool reads a connected repository to automatically deploy static sites to a CDN or containers to Cloud Run, provisions Postgres databases with configurable tier, region, and storage, and generates a unique preview URL for every branch and pull request that is removed once the branch is deleted.