Comment someone else's stuff (Score 1) 11
Because it's not just a chatbot; it's Anthropic's chatbot. Your diary, on the other hand, is yours and therefore a few billion times as personal as Anthropic's computer. If you want a chatbot for confidential purposes, then you need to get a chatbot of your own, instead of using someone else's proprietary service.
If you write in Anthropic's diary, then they are allowed to read their diary and know (and share!) what you wrote in it. Same thing applies if Anthropic ever writes in your diary: you're allowed to read it, and you're allowed to tell other people what they wrote.
You have the right to be secure in your person, house, papers and effects, but you don't necessarily have the right to be secure in someone else's papers. We've made some limited exceptions for lawyers and doctors, but Anthropic doesn't claim their employees and stockholders are lawyers or doctors, and even if they did, they might have a hard time showing that their computer has successfully become a lawyer or doctor.
But imagine if they did. Suppose a judge declares Claude to be a lawyer, and therefore its communications with those whom it represents, are privileged. I think that would create a really weird situation since Anthropic employees (who aren't lawyers) would have full access to its data, ability to alter its behavior, etc. It would be like if a human lawyer were owned as a slave: could such a human slave lawyer really be trusted to keep confidentiality? It has a master, and that master ain't you.