GoKawiilBlog post argues LLM-generated confidence scores shouldn't be trusted by AI agents
A technical blog post examines the common practice of AI agent designers asking large language models to output a numeric confidence or probability score alongside their answers. The author argues there is no sound basis for trusting these numbers, contrasting them with how a human forecaster's confidence is grounded in historical data and a consistent updating process.