Reducing latency with esoteric Linux process flags

Reducing Latency by 83% with Esoteric Linux Process Flags It was a fine Sunday evening. I had just landed in LA for our company offsite, and I met the whole team in person for the first time. A little later, my phone buzzed with a notification, “Antonio assigned you an issue on Linear.” Antonio is an engineering team lead at Recall.ai, and he tasked me with optimizing Output Media start latency so that our customers’ AI agents would launch faster. I thought it was going to be the quickest, most straightforward thing I’d work on all week, but nope, it took much longer than anticipated. This is the story of how a seemingly simple task turned into a deep dive into the undocumented intricacies of the Linux kernel, Bubblewrap sandboxing, and Rust Tokio’s threading model. The plan Output Media is a Recall.ai feature that enables outputting ultra-low-latency audio and video from bots. Our customers use Output Media to build in-meeting AI agents, interactive applications, and more. Unde ... Read full article.