Comment Re:Wikipedia will be replaced (Score 1) 100
What are the lyrics to Theatre of Tragedy's "Cassandra". Prove an accurate transcription, and dont make anything up. If you don't know, just say you don't know.
GPT-4 responds
I'm sorry, but as an AI language model, I do not have the ability to look up information in real time. My knowledge is based on the text corpus I was trained on, which goes up until September 2021. While I can provide information on a wide range of topics, I don't have the lyrics to Theatre of Tragedy's "Cassandra" readily available. If you need the lyrics, I recommend looking them up through a reliable source, such as the band's official website or a reputable lyrics database.
But again, if i asked it for the lyrics like you did, it does indeed make something up:
Theatre of Tragedy is a Norwegian gothic metal band that was active from the early 1990s until their disbandment in 2010. "Cassandra" is a song from their third album, "Aégis," released in 1998. Here are the lyrics to the song:
[Verse 1]
By the emerald stream, the lifelike water and the wind,
I lie - in the moss and ferns, the scent of twilight;
My dusky countenance - the pallor of the birch,
A blanket of stars - the cloak of the firmament
So its basically trying to give you what the lyrics should be, even though it doesn't actually know. Its trying its best mate. Dont be mad a the machine, but instead try to find where you went wrong asking the machine the question. For these systems, prompts do indeed matter.
I'm not saying these system are perfect, but these strawmans (which are largely upvoted by the unknowing) i think are largely driven by a mixture of bias and fear.
Understanding how these models arrive at specific outcomes is up for debate. Researchers understand the general concept of attention, as well as how to implement and train models that use it. However, interpreting the attention weights and understanding their exact influence on the model's decision-making process can be quite challenging. There is still much to learn about how attention mechanisms and other components in deep learning models work together to produce results. Pretending otherwise is intellectual fraud. Whenever i see people that claim they 'know' exactly how these machines work, i know they're full of shit.
"Its fancy statistics"
is a handwoven way of saying "I dont know, but really i do" without a true understanding of what the hell youre talking about. It is true that these models are, in essence, complex mathematical constructs that rely on statistical patterns in data. This description, however, doesn't capture the full depth and intricacy of their inner workings. Even experts in the field don't have a complete understanding of every aspect of an LLM's behavior, particularly when it comes to interpretability and explainability.