Robotics engineer finds LLM coding assistants struggle with visual debugging tasks
A robotics developer describes attempting to offload the tedious process of visually debugging robot code to an LLM coding assistant equipped with an image encoder and MCP server access to a visualizer tool. The experiment largely failed: the assistant lacked an intuitive sense of what correct robot behavior looks like and struggled to navigate the debugging GUI, taking minutes to reach a viewpoint the developer could reach in seconds.