Overconfidence and AI (Godin)
so take this with a grain of salt…
Human beings are often more effective when we’re a bit self-effacing. “I think,” “Perhaps,” or “I might be missing something, but…” are fine ways to give our assertions a chance to be considered.
The solar-powered LED calculator we used in school did no such thing. 6 x 7 is 42, no ifs, ands or buts.
Part of the magic of Google search was that it was not only cocky, it was often correct. The combination of its confidence and its utility made it feel like a miracle.
Of course, Google was never completely correct. It rarely found exactly the right page every time. That was left to us. But the aura of omnipotence persisted–in fact, when Google failed, we were supposed to blame evil black-hat SEO hackers, not an imperfect algorithm and a greedy monopolist.
And now, ChatGPT shows up with fully articulated assertions about anything we ask it.
I’m not surprised that one of the biggest criticisms we’re hearing, even from insightful pundits, is that it is too confident. That it announces without qualification that biryani is part of a traditional South Indian tiffin, but it’s not.
Would it make a difference if every single response began, “I’m just a beta of a program that doesn’t actually understand anything, but…
