The reason humans are so useful is not mainly their raw intelligence. It’s their ability to build up context, interrogate their own failures, and pick up small improvements and efficiencies as they practice a task
- "Why I don't think AGI is right around the corner", Dwarkesh Patel
In this post, based on our recent experiences selling 7-figure AI deals to Fortune 500s and Silicon Valley tech cos alike, I'll discuss how "confident inaccuracy" seems to be at the heart of this problem.
Being Confidently Wrong is The Only Problem
Aside from the hilarious "Oh I spend $10M on this campaign because our AI assistant told me to" first order problem, confident inaccuracy causes second and third order problems that are far more insidious:
a) Imposes a universal verification tax
I don't know when I might get an incorrect response from my AI. So I have to forensically check every response.
My minutes turn into hours; the ROI disappears.
b) Erodes trust asymmetrically
... continue reading