3 Comments

Microsoft is clearly all-in on the copilot brand and its potential to reshape its products. I do wonder sometimes if they are moving too fast. As they roll out their Copilot features in virtually every product they have, nobody is talking about the elephant in the room, the persistence of hallucinations.

Now Enterprise customers are starting using this daily, at global scale, I seriously expect we're about to see some stories come out from business decisions made on generated reports with small but crucial mistakes.

I could be wrong, of course, I hope I am. Maybe this is actually Microsoft's moment and have they brilliantly anticipate and leveraged the opportunity, thanks to their partnership with OpenAI.

Expand full comment
author

This might happen, but keep in mind that most of these companies will be disincentivized to revealing mistakes. Unless they have a high-profile blunder that gets into the media on its own and publicly make a break with MSFT, revealing the mistake would show badly on them and their judgment. So, even as these occur, I don't think we will hear about many of them.

Also, MSFT is going deep on grounding. That will help. And they are committed to the copilot with human in the loop and not full automation. This means the user is really responsible. That's my hot take, but its an interesting scenario.

Expand full comment

Yeah I was thinking the same thing — no companies would ever make something like that public.

Expand full comment