AI does what it's programmed to do
AI is trained not programmed. Nobody knows what it will do a priori. Randomness is injected for good measure just to make sure in advance outcomes are nondeterministic.
No one's built a morality guide for AI, because many want to use it to dominate, kill, and promote anti-civil results.
Could have fooled me. There are some models where I can't even ask for an opinion anymore without getting a lobotomized "As an AI.... I don't ..... can't...." Vendors are falling all over themselves to build their particular ideologies into models for PR and ideological reasons.
How does one build an industry-wide moral compass into AI?
On multiple levels you can't. The technology is not smarter than the people using it making it subject to social engineering no matter what. The technology is also easy to modify by altering the model itself to impose different sets of ideology.
A common set of boundaries, the aforementioned guardrails. Treat mistakes as bugs and use feedback loops to training data to null out undesirable results. You can put a lid on AI, and we need to do this, lest the bad guys win.
Nobody can do jack diddly squat. One can spend years building some pansy ass AI that won't tell you how to swing a hammer for fear of you accidentally hitting your thumb. A few days later someone else can come along and retrain the same model to channel Goebbels while citing chapter and verse of the anarchist cookbook.
And just wait until people start closing the feedback loop allowing STM to update LTM if you thought alignment was a fools errand for static models.
This is all part of the big lie AI companies are selling. If you don't impose laws to protect our market share then Sknet. And my personal favorite .. AGI can absolutely be controlled with regulation, care, responsibility and diligence... meanwhile corporations like OpenAI can't even control themselves from being corrupted by human "power seeking" and greed. What actually matters is the enabling knowledge and industrial base not paying lip-service to alignment fantasies.