It should be opt-in, not opt-out.
It is opt-in if you write your robots.txt file that way. Just disallow * and allow the bots you want. The site owner gets the choice.
sites that are actively engaged in who you can follow, and what content gets posted should not get the protections 230 affords.
Agreed. Sites that exercise editorial control over the content posted should not get 230 protection. Sites that do not should have the liability shifted to the poster as 230 does.
Example: A newspaper that chooses to print (or not print) my letter to the editor is exercising editorial control and should be help liable (along with me) if it contains defamatory or otherwise illegal speech. A telephone network that does not exercise editorial control over what I say in any way should not be liable for any of the speech that occurs on that telephone network.
Another way to say this: If you take responsibility for the speech on your system then you are responsible for the speech on your system.
"All my life I wanted to be someone; I guess I should have been more specific." -- Jane Wagner