Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror

Comment Will it make local LLM use any easier? (Score 1) 108

My chatbot provider is located at 127.0.0.1:8080. The browser is actually responsible for the context window and conversation history, as I found out the hard way the first time I had to restart and lost my history and context window. I thought this was a llama.cpp problem but no, it was the fact that I have my cookie policy set to discard all cookies at the end of each session. I had to add 127.0.0.1 as an exception.

If they're somehow going to add more functionality onto that, good. I'd like to see what they have in mind. If they somehow have ways to improve on ComfyUI, I'd like to see that too. But I have a feeling they're going to do nothing for my particular class of AI use. As long as they don't get in the way, I'll just ignore these new features or find ways to make them useful myself.

Slashdot Top Deals

Always try to do things in chronological order; it's less confusing that way.

Working...