The real problem is that the companies are going to try and refuse the responsibility for the AI actions.
As in:
Yes my AI was empowered to set prices, but we did not want it to set a price less than a $1000 and it set a price of 10 cents. No we do not want to give up all other transactions the AI approved.
Yes the AI hired only christian white woman and illegally asked if they had children, but we did not mean to break the law. That was the LLM, not our fault.
Yes the AI illegally rejected every rental applicant that was single but we did not mean to violate the Fair Housing Law. We never told it to do that, it is just the algorithm.
You can't sue us if we did not intend to break the law.
No. They can definitely sue you for unintenionally breaking the law.