GoKawiil
Tech News
Polars has released version 2.0, introducing initial out-of-core processing, significant performance improvements, and comprehensive SQL support. Benchmark tests show Polars surpassing DuckDB and DataFusion in TPC-H and TPC-DS workloads, highlighting its growing capabilities for data analytics tasks.
A throwaway pull request to add readahead to Turso's io_uring backend became a case study in I/O performance. Without readahead, Turso issues one io_uring read at a time and waits for each to complete before requesting the next page; with a 32-page prefetch window enabled via PRAGMA, it submits many reads concurrently. On a TPC-H full-table scan, this dropped actual device requests from about 196,000 to roughly 16,300, while average request size grew more than tenfold and request-merging jumped from near zero to over 90%.