The Dangerous Truth About AI Coaching (It’s Not Actually Coaching)
I’ve seen the notion recently of people using “AI Coaches” — that is, using it to get feedback to mentor and guide you to action.
Heck, I’ve even used the language…before clarifying that by coach I really mean thing that asks me the most likely questions I didn’t think of.
It almost always ends the same way: me challenging the AI, and then it responding, “You’re absolutely right…” before backing its way into my line of thinking. And look…even as someone who thinks he’s right a lot, there’s no way I’m “absolutely right” every time I talk to the AI.
Because here’s the truth: AI cannot, and can never be, your coach. LLMs are information aggregators. They don’t think. They don’t know you. And if a chat goes on too long, it will get confused.
The best they can do is tell you the most statistically likely answer. That’s not coaching. That’s a faster, less accurate form of Googling.
It’s like when you’re at a bar and your friend says, “I think Morgan Freeman is dead,” because they saw someone tweet it.
