Tech News
← Home  ·  All topics

Livecodebench Hard

1 GoKawiil brief on this topic

Memdoor-built multi-agent harness matches GVS5H's Qwen3.8-27B system on LiveCodeBench Hard subset

A reproduction built by Memdoor's coding tool, working only from a written description of the GVS5H paper's method, replicated the five-role multi-agent workflow using Qwen3.8-27B models. Across five passes on the first ten problems from the authors' LiveCodeBench Hard list, the rebuilt workflow averaged 9.8 of 10 correct, versus 9.6 for the authors' own harness and 8.0 for a single Fable 5 model, with full logs and costs published for all 50 runs.