I have 4 roof sections on different orientations with 70 PV panels, and a lot of excess energy. No batteries, though, so I can't really run the local AI on renewables all the time. Trying to rectify the battery situation this year.
I ran out of my ChatGPT Codex $100/month sub for the week. They still let me use Codex 5.3-spark. I tried to use it today for some really basic stuff. It's a complete P.O.S., not capable of making even minor bug fixes without adding regressions. These were simple changes to a dashboard I use to monitor my local inference box.
I have been using Qwen 3.8 27B, and it is rather amazing. NVFP4 quant, on 4 x 5060 Ti 16 GB. Running with SGlang, 1M context. It chews input tokens at around 2000/s, and spits out around 100/s. Not as fast as the cloud models, but very usable. I do need to relocate it due to heat/noise, though. Mainly noise. I like heat.