Rank #21 of 24·Hallucination·14 Apr 2025·Cursor support bot 'Sam'
Cursor's AI support agent invents a fake 'one device' policy
Chaos index6.0 / 10
0246810
“Hallucinated a policy so convincingly that customers obeyed it by leaving.”
What happened
Users getting logged out when switching machines asked support why. The AI agent 'Sam' replied that this was a new one-device-per-subscription policy, which did not exist; the real cause was a bug. Users cancelled, and Cursor apologised and started labelling AI support replies.
How to not be next
Ground support agents in real policy docs and label AI replies as AI.
Source: Ars Technica ↗