Trail Of Bits - GoKawiil

1Password's AI patch-benchmark study 'FLAWED' criticized for errors and thin citations

A security researcher publicly challenged 1Password's Off-by-1 Labs report 'Frontier Models' Vulnerability Patches are Often F.L.A.W.E.D,' echoing earlier critiques from Trail of Bits and Davi Ottenheimer that called its AI patching benchmark misleading. The researcher's Twitter thread cited arithmetic mistakes, inconsistent diagrams, and a citation list of just 19 sources—mostly corporate blogs—compared to 73 in the concurrent academic PatchBench paper.

suhacker.ai · 2026-09-24

Trail of Bits runs independent auditor for Signal's Automatic Key Verification

Signal has introduced Automatic Key Verification, a key transparency feature that checks whether the public keys stored for your account actually belong to your own devices, reducing reliance on manually comparing safety numbers. Trail of Bits built one of three independent auditors that continuously verify this system by maintaining its own Merkle tree copy of the global key map and periodically signing it to confirm consistency.

blog.trailofbits.com · 2026-09-12