It’s almost like having a little angel on your shoulder
What a horrific, and probably intentional, mischaracterization. Calling AI a "little angel" presupposes that it has the best interests of the affected humans guiding it, while the truth is that these systems are absolutely going to be designed to benefit their corporate overlords first, foremost, and always.
How long until Microsoft inks a deal with Delta so that its agents prioritize Delta when someone asks it for help booking a flight? Or directs inquiries about food nutrition and health towards companies that the packaged foods corporate lobbyists group promotes? Sends requests to watch a show to Hulu instead of Netflix?
Perhaps each request will trigger a real-time auction the same way Google does for ads, with the winner taking control over your agent. Every task you might request of an AI agent is going to be susceptible to subtle (or overt) manipulation, sponsored by undisclosed parties.
AI is not immune to enshittification. I'd argue it's going to take that path almost immediately because (1) it's a completely opaque system that nobody can peer into, (2) it's unbelievably expensive to operate and there will soon be a massive push to start recouping those costs, and (3) the tech bros are comfortably in with the Trump administration, which already tried to make it illegal to pass laws regulating AI.
<<<<< EVACUATION ROUTE <<<<<