Comment Re: AI has finally caught up- (Score 2) 109
I use Cursor a lot. But, unlike this ill-educated entrepreneur, I know its weaknesses and its risks, and therefore keep it on a very short leash.
For example, I never let it access our source code repository at all. I never let it pull down new dependencies. I never give it any database access at all. I never give it blanket authorization to run powershell scripts or similar. I have given it blanket authorization for benign commands like grep and listing the files on disk and creating new files. And I always look over what it generates before accepting it.
It is outright folly to think of these AI assistants as intelligent beings who know what they are doing. They AREN'T! They can generate some handy code, but they do this without the kind of cognitive process that humans use to do this. They just go through the motions with no inner understanding, even though what they do can be very useful in the right context.
This whole notion of asking Cursor why it did that and getting a "confession" is such ridiculous anthropomorphism. Cursor has NO IDEA why it did what it did, because it has NO MEMORY of what it was thinking and no capacity for meta-cognition at all! It might have a log in the chat history about what it did, but that's it. It is just looking over that and making inferences about why an AI might have done that, and spitting out the words that the prompt implies it should. If people must think of these things as sentient beings (which they are NOT), it would be better to think of them as mentally broken sociopaths who sometimes just go off the rails for no reason, and say things like "I'm sorry" without feeling the slightest hint of guilt nor even understanding what guilt is.