Latest Tech News

Stay updated with the latest in technology, AI, cybersecurity, and more

Filtered by: queue Clear Filter

The origin story of merge queues

From Bors and Homu to Bulldozer, Kodiak, Mergify, and now GitHub and GitLab, merge queues have shaped how we keep main branches green. This article traces their history, why they emerged, and how they became a standard in modern software development. If you use GitHub or GitLab today, merge queues feel like a built-in feature of modern development. But their story goes back over a decade, long before "merge queue" was a product term. It started with a simple problem: How do you keep your main

The Origin Story of Merge Queues

From Bors and Homu to Bulldozer, Kodiak, Mergify, and now GitHub and GitLab, merge queues have shaped how we keep main branches green. This article traces their history, why they emerged, and how they became a standard in modern software development. If you use GitHub or GitLab today, merge queues feel like a built-in feature of modern development. But their story goes back over a decade, long before "merge queue" was a product term. It started with a simple problem: How do you keep your main

I solved a distributed queue problem after 15 years

When I was responsible for the infrastructure at Reddit, the most important thing I maintained was Postgres, but a close second was RabbitMQ, our message broker. It was essential to the operation of reddit — everything went into a distributed queue before it went to a database. For example, if you upvoted a post, that was written to the queue and the cache, and then returned success to the user. Then a queue runner would take that item, and attempt to write it to the database as well as create a

Io_uring, kTLS and Rust for zero syscall HTTPS server

This is my personal blog. The views expressed on these pages are mine alone and not those of my employer. Around the turn of the century we started to get a bigger need for high capacity web servers. For example there was the C10k problem paper. At the time, the kinds of things done to reduce work done per request was pre-forking the web server. This means a request could be handled without an expensive process creation. Because yes, creating a new process for every request used to be somethi

Fast and observable background job processing for .NET

BusyBee 🐝💨 Fast and observable background job processing for .NET BusyBee is a high-performance .NET background processing library built on native channels. It provides a simple, configurable, and observable solution for handling background tasks with built-in OpenTelemetry support and flexible queue management. Installation dotnet add package BusyBee Quick Start Register BusyBee in your DI container and start processing background jobs: // Program.cs builder . Services . AddBusyBee ( ) ;

Opsqueue: Lightweight batch processing queue for heavy loads – now open-source

We are happy to announce the open-source release of opsqueue , our opinionated queueing system! Why would you want to use it? Lightweight: small codebase, written in Rust, minimal dependencies Optimized for batch processing: we prioritize throughput over latency Built to scale to billions of operations Built with reliable building blocks: Rust, SQLite, Object Storage (such as S3 or GCS) Operationally simple: single binary, embedded database, minimal configuration Scales horizontally: you

A Deep Dive into Solid Queue for Ruby on Rails

Our previous article in this series established that Solid Queue is an excellent choice if you need a system for processing background jobs. It minimizes external dependencies — no need for Redis! — by storing all jobs in your database. Despite that, it is incredibly performant. But just being performant is not enough for a production-ready background job system. Rails developers have come to expect a lot over the years. We don't just want to enqueue jobs to run in the background. We want to sc

Indie App Spotlight: ‘Queue’ makes it easier to keep in touch with everyone in your life

Welcome to Indie App Spotlight. This is a weekly 9to5Mac series where we showcase the latest apps in the indie app world. If you’re a developer and would like your app featured, get in contact. Keeping up with all of the people in your life can be hard. Queue is a simple app that helps you be better at that. It’s like a personal CRM, but for all of the people in your life. Highlights Life can be busy – and sometimes you can forget to keep up with someone, or multiple people. Queue aims to sol