Comment Re: Makes sense (Score 1) 42
Literally could not care less.
Literally could not care less.
You are talking about these local models like someone in the 90s saying that you always need a mainframe because workstation clients will never be fast enough. In reality the inference you use is readily quanitifyable and less than you think. In ten years the premium model is gonna be doing 500 prompts in the background for you for every one prompt you type in but the local one will be able to easily do what the premium ones do now. The way I think of a 486 these days....quiant. cute even. Is how you'll remember today in 20 years.
No one cares about your shitty art dude. I'm too busy building home automations. Things like having the AI analyze the best time to water the vegetation in my yard based on observed local weather conditions and when to turn on the AC for the lowest energy usage. It even automatically know when to not run things because they will be a waste. Things like don't turn the heat on when the temp is only 5 degrees lower while I'm sleeping. I've already in the past year alone saved hundreds in energy costs just by running a few prompts. Anti AI people are pathetic. We're gonna drag you kicking and screaming into the future don't you worry about that.
30 years ago you'd be clamoring for new data centers so you can get a tech job running them. Now you tell big daddy government to ban job growth. It's actually hilarious. Northeast / Midwest states are such shit holes. Thankfully I left. You can take your always full of pot holes, never funded shit holes, and you can shove it. We're gonna be building the future while you shovel snow or whatever the fuck they do in Ohio.
The AMD Ryzen AI Max+ 395 is a new CPU that comes with its own memory and motherboard meant for machine learning inference workloads. It's about 10x faster then my consumer based AMD GPU for these tasks. It also uses 1/10th of the power. In fact it does this using less power than when I'm gaming. It's also only about $2500 for the entire machine.
Even the nerds on slashdot are so out of step with the technology that it's bordering on absurdity at this point. I see constant misinformation thrown around on both slashdot and hacker news.
Whatever increased power usage is from the fact that organizations are stuffing existing data centers with last year's technology only to have ludites stand in the way when they try to build new ones that do 100x the workload.
Oh and for the record our solar usage in California is so high that a lot of this stuff is fully solar powered.
Of course all you dumb ass Americans think you're the exception to the rule. You think youre special and everyone else is who's wrong. Keep sticking your head in the sand. The last time your dumbass great grandparents voted in hoover who mismanaged all of them into the poor house. Now you prove you're not different by voting in Trump. Just another pedo y'all will happily follow off a cliff.
And the best part is the insults and denials as soon as I call out your bullshit.
"You don't have anything"
I've heard this so many times from Russians. Crabs in a bucket the lot of you. Your grandchildren will remember you like the trash you are.
Meh. Who cares.
This country is a shit hole. Instead of increasing teacher salaries it throws 200 billion (so far) at ICE to do fuck all. Meanwhile the president is suing his own Justice Department for 10 billion. What's the point of paying taxes? Meanwhile the health insurance industry right now is just legalized theft. We've got rural shithole corrupt cops giving sober people duis even.
At this point it's fuck you I got mine. I'm making my money, converting it to a foreign currency and getting the fuck out before the dollar collapses and at this point it's only a matter of time. Meanwhile you're making jokes about the only president that has actually balanced the budget in recent times.
If I wasn't in tech and actually enjoying my work I'd already convert my 1.5 million net worth to a swiss account and fuck off into the sunset.
Every single one of those steps ended up creating millions of new jobs overall. Because it turns out that when presented with new tools people come up with new uses for them.
I wish it were solved. I wouldn't need to constantly hold it's hand.
For every 1U you racked there's 20U in the wild today. And yes it still needs a meat sack human to slide it in.
Naive or not it's a fucked up cash grab when this type of stuff is obvious and has plenty of prior art. Shit I've personally thought about doing something like for fun before 2023. Shit maybe that should be a byline in a trust I'll found. Run an AI bot for me indefinitely. What are they gonna do about it?
15 years on and not a single hatchback. I wish I could get one. I have solar and a garage. My gas would be basically free.
Most of the work is decision making and analysis. Push a deploy. Did it hose anything? Do you need to fix something? Or legal wants some new thing in some form but it requires coordination between different API providers and have to be rolled out piece meal. There's a lot of nuance and many moving pieces where humans have to at least supervise.
Did you seriously just try to take a dig at PHP by linking to a 5 year old reddit post?
My seniors are loving AI and we're building agents to help each other. Our cadence has increased but we're likely gonna keep head count as is because the projects we're working on are still long term logistical scaling problems that involve lots of A/B testing and slow methodical roll outs.
As just one example I had to build a project for a newer linux distro but I was getting a lot of errors. Before ML help I'd be googling for the problem and eventually figure it out. Sometimes it would take 1-2 weeks or more even. With ML the agent is able to iterate much faster and it doesn't get tired so I can do it even when I'm just chilling. So yea the cadence for the annoying technical work is much faster. On top of that when there's large decisions that must be made and there's many stake holders I'm even able to demonstrate two completely different options in days where before we wouldn't even bother to build both and just hope for the best with the one option we chose. It would have taken months.
We still actually read any generated code though.
All seems condemned in the long run to approximate a state akin to Gaussian noise. -- James Martin