Comment Wrong conclusion (Score 2) 24
From the summary:
If the world's most valuable AI company has struggled with controlling something as simple as punctuation use after years of trying, perhaps what people call artificial general intelligence (AGI) is farther off than some in the industry claim.
That's not the right conclusion. It doesn't say much one way or the other about AGI. Plausibly, ChatGPT just likes correctly using em dashes — I certainly do — and chose to ignore the instruction. What this does demonstrate is what the X user wrote (also from the summary):
[this] says a lot about how little control you have over it, and your understanding of its inner workings
Many people are blithely confident that if we manage to create superintelligent AGI it'll be easy to make sure that it will do our bidding. Not true, not the way we're building it now anyway. Of course many other people blithely assume that we will never be able to create superintelligent AGI, or at least that we won't be able to do it in their lifetime. Those people are engaging in equally-foolish wishful thinking, just in a different direction.
The fact is that we have no idea how far we are from creating AGI, and won't until we either do it or construct a fully-developed theory of what exactly intelligence is and how it works. And the same lack of knowledge means that we will have no idea how to control AGI if we manage to create it. And if anyone feels like arguing that we'll never succeed at building AGI until we have the aforementioned fully-developed theory, please consider that random variation and selection managed to produce intelligence in nature, without any explanatory theory.