Comment Fundamental misunderstood tech (Score 2) 85
I'm amazed the amount of tech people that have no clue what an LLM is and how it works. I get why the CEOs of the companies and sales people are just running around with PR bullshit, but tech people? Why?
Simple facts like LLMs not having state. You feed the same input and it will always generate the same output. You can add randomness to the input of course, but the model is not changing while being used. It's static. Stateless. Having "memory" is just a feature of the client sending in previous dialog (or a summary of it) together with latest input.
Simple facts like LLMs not having state. You feed the same input and it will always generate the same output. You can add randomness to the input of course, but the model is not changing while being used. It's static. Stateless. Having "memory" is just a feature of the client sending in previous dialog (or a summary of it) together with latest input.