Silicon Valley Is Buzzing About This New Idea: AI Compute As Compensation 86
sziring shares a report from Business Insider: Silicon Valley has long competed for talent with ever-richer pay packages built around salary, bonus, and equity. Now, a fourth line item is creeping into the mix: AI inference. As generative AI tools become embedded in software development, the cost of running the underlying models -- known as inference -- is emerging as a productivity driver and a budget line that finance chiefs can't ignore.
Software engineers and AI researchers inside tech companies have already been jousting for access to GPUs, with this AI compute capacity being carefully parceled out based on which projects are most important. Now, some tech job candidates have begun asking about what AI compute budget they will have access to if they decide to join.
"I am increasingly asked during candidate interviews how much dedicated inference compute they will have to build with Codex," Thibault Sottiaux, engineering lead at OpenAI's Codex, the startup's AI coding service, wrote on X recently. He added that usage per user is growing much faster than overall user growth, a sign that AI compute is becoming even scarcer and more valuable. That scarcity is reshaping how engineers think about their work and pay. "The inference compute available to you is increasingly going to drive overall software productivity," said OpenAI President Greg Brockman.
The report cites a recent compensation submission from a software engineer that listed "Copilot subscription" as part of the pay and benefits. "OpenAI and Anthropic should create recruitment sites where their clients can advertise roles, listing the token budget for the job alongside the salary range," said Peter Gostev, AI capability lead at Arena, a startup that measures the performance of models.
Tomasz Tunguz of Theory Ventures predicts AI inference will be the fourth component of engineering compensation, alongside salary, bonus, and equity. "Will you be paid in tokens? In 2026, you likely will start to be," Tunguz said.
Software engineers and AI researchers inside tech companies have already been jousting for access to GPUs, with this AI compute capacity being carefully parceled out based on which projects are most important. Now, some tech job candidates have begun asking about what AI compute budget they will have access to if they decide to join.
"I am increasingly asked during candidate interviews how much dedicated inference compute they will have to build with Codex," Thibault Sottiaux, engineering lead at OpenAI's Codex, the startup's AI coding service, wrote on X recently. He added that usage per user is growing much faster than overall user growth, a sign that AI compute is becoming even scarcer and more valuable. That scarcity is reshaping how engineers think about their work and pay. "The inference compute available to you is increasingly going to drive overall software productivity," said OpenAI President Greg Brockman.
The report cites a recent compensation submission from a software engineer that listed "Copilot subscription" as part of the pay and benefits. "OpenAI and Anthropic should create recruitment sites where their clients can advertise roles, listing the token budget for the job alongside the salary range," said Peter Gostev, AI capability lead at Arena, a startup that measures the performance of models.
Tomasz Tunguz of Theory Ventures predicts AI inference will be the fourth component of engineering compensation, alongside salary, bonus, and equity. "Will you be paid in tokens? In 2026, you likely will start to be," Tunguz said.
Life balance?? (Score:2)
Re: (Score:2)
don't worry, you will live at the company town and get paid in company scrip
also: FUCK SLASHDOT ADS.
Re: (Score:2)
"also: FUCK SLASHDOT ADS" - I really had to play around with uBlock this time to get this latest ad to disappear. I agree: #FUCKSLASHDOTADS
Re:Life balance?? (Score:5, Informative)
Add this rule to ublock origin:
||fsdn.com/con/*/floating-unit.js
Not sure if that works on uBlock Lite or not... Chrome really cripples what you can do.
Re: (Score:2)
Yep that seems to work.
I really don't enjoy having ads promising to eliminate my job. Do better slashdot....
Re: (Score:2)
Wish i had modpoints. Very helpful. Gracias.
Re: (Score:2)
Re: (Score:2)
I do not see ads and I perform no configuration on uBlock Origin. I strongly suspect that is because NoScript is my primary defense. With those two pieces of software along with Firefox, the Internet is not so bad.
Re: (Score:2)
just "disable javascript on this site".
Re: More fucking ads (Score:2)
Re: (Score:2)
Re: (Score:2)
I had to right click on the ad, then choose block element, then choose "pick", click the ad with the mouse, then move the right slider to 1 to get the ad to disappear. I also had to block the sticky ad that persists as you scroll.
Not compensation (Score:5, Insightful)
This isn't compensation, if it is something necessary to do the job at the levels they require, any more than asking if the building has HVAC in the summer is negotiating benefits.
They sell the idea that using AI is necessary for the position, and then try to sell access to that AI as a perk? That's rich up there with working in a coal mine and being told you can only use company tools, and that for some positions they supply the tools and some they don't.
Re:Not compensation (Score:5, Insightful)
No kidding, how is this any different than saying "The laptop we provide to you, which is required to do your work, is considered part of your compensation. But no, you don't get to take it with you when you leave."
Re:Not compensation (Score:5, Insightful)
Indeed. Same as putting mandatory company apps on your phone. The last time somebody tried that, I told them they were free to give me a company phone, but they would not be getting inside my personal security border. Turns out they could live without me having their apps.
Re:Not compensation (Score:5, Interesting)
Yep. Essentially a scam. Tools for the job are to be provided by the employer, no matter how expensive. And they can get very expensive.
I guess they can get a few true AI believers cheaper that way. But do you really want to hire such people?
Re: (Score:1)
"Tools for the job are to be provided by the employer, no matter how expensive. And they can get very expensive."
That's often not true. Many professions expect a workman to have his own tools. Auto mechanics, carpenters, musicians, electricians, plumbers, photographers, and so on.
Re: Not compensation (Score:3)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Damn I wish I had mod points for you.
Re: Not compensation (Score:3)
It also betrays that the raw cost of AI outstrips any efficiency gains.
OpenAI needs to pay someone less for it to be worth using their product. One would think if the gains outstripped the cost they'd pay someone more, or at least let them use the tool with equal pay.
Re: (Score:2)
It also betrays that the raw cost of AI outstrips any efficiency gains.
I don't think so.
There are more and less efficient ways of using AI. Using it more efficiently takes more work, more planning, more thinking, but the cost difference can be pretty enormous, so companies have a motivation to put budgets in place to motivate engineers to be more efficient.
For example, for many tasks, the slightly older and cheaper models are sufficient (e.g. Claude Sonnet 4.5 - medium effort), but for other things you really want the better reasoning of a later model with more context (e
Re: (Score:2)
This isn't compensation, if it is something necessary to do the job at the levels they require, any more than asking if the building has HVAC in the summer is negotiating benefits.
They sell the idea that using AI is necessary for the position, and then try to sell access to that AI as a perk? That's rich up there with working in a coal mine and being told you can only use company tools, and that for some positions they supply the tools and some they don't.
The "as compensation" model is clearly ludicrous. I see it as a valid "work environment" question, though, up there with free food, etc. All else equal (which it never is) I'd much rather work at the place that gives me a $500 monthly budget over the place with a $200 budget.
Re: (Score:2)
Re: (Score:2)
My company gives me 300 Github Copilot premium model credits per month. When I'm out, I'm out. It would be in their best interest to give me as much as I can possibly use. It's like $0.04 per request. But nope. Instead I'm back to writing code manually, or trying to debug the drivel that the free models regurgitate.
Seriously, if I was interviewing today, how much compute I get is a question I would most certainly ask!
Re: (Score:3)
Only idiots think that AI can be creative. It can help free you to be more creative... but I suspect that is not how AI is being pushed or used in those jobs.
Re: (Score:3)
> The report cites a recent compensation submission from a software engineer that listed "Copilot subscription" as part of the pay and benefits.
That sounds more like a punishment than any sort of perk or compensation. I wonder what the engineer in question did to suffer such crappy AI?
Re: (Score:2)
For exceeding expectations we are giving you a 100 toilet flush bonus.
Re: (Score:2)
Brought to you by your corpo masters. They never gave up on the ideal of slavery.
you get 16 tons (Score:5, Funny)
of Co2
Re: (Score:2)
...and what do you get?
Another day older and deeper in debt...
Re: (Score:2)
I wonder how many inference tokens 16 tons of #9 coal gets you?
Good grief. Giving them ideas. (Score:3)
If the techbros think they can get by with "compensating" people by giving them compute to do the job.... I got nothing. Even worse, people are ASKING for that as part of their compensation package? That'd be like a person in 1995 saying part of their take-home would be a desktop computer at their desk to do their coding on. This just seems like a weird reflection of the "AI GOD IS COMING, YOU MUST BE A PART OF AI GOD" mentality that's pervading all of tech.
I'm more than a little skeeved out by it being framed as compensation.
Re: (Score:3)
This all sounds like desperate BS to me. The AI bros looking for ideas to implement hoping to make more use of their slop machines. I highly doubt people are asking for AI as compensation.
Re: (Score:3)
I have no doubt that applicants are asking about what tools are used and will be available.
But the only people looking at these tools as part of the compensation package are the executive team members. I don't even think middle managers would be stupid enough to look at this as part of the applicant's compensation.
Re: (Score:3)
Re: (Score:1)
spoiler: i won't use the cash to buy AI time.. or "compute" as they say.... yuck.
Re: (Score:2)
There likely have been cases, back when PCs and workstations were expensive and endpoint auditing and management were typically fairly light, when computers were used to sweeten the deal at least for certain sorts of lower level nerds; but because it was fairly easy to just turn a blind eye to recreational use off hours and relatively difficult to have random endpoint hardware doing something productive 24/7.
With 'cloud' re
How about charging everyone the true cost first? (Score:4, Interesting)
This story is why I believe IP must be abolished (Score:2, Offtopic)
Global mergers/acquisitions heading toward all technology being the proprietary possession of a small coterie of Barons.
You will be technically "free" to live as you wish, the same way the poor schmucks who took the Red Pill exited the Matrix and were free-- to scrabble out their depressing MRE-hardtack existence hiding in the dark crags of subterranean tunnels.
You will, on paper, philosophically speaking, have all your freedoms, but they won't be worth exercising. Because if you want access to the producti
Not needed (Score:2)
Re: (Score:3)
And they do, and every time it looks like they might eventually fall behind, they leap forward.
The real question isn't about the inference- it's when do the SOTA models hit the wall of what it costs to train them. That's the magic that the bubble is fueling. Inference is a legitimate commodity. People paid for compute before AI, and they will after AI. But nobody at the front of the pack h
Compete for resources ... (Score:3)
One out of two gets rifle.
The one without, follows him!
When the one with the rifle gets killed, the one who is following picks up the rifle and shoots!
- Enemy at the Gates
Ah! I missed that at first... (Score:5, Interesting)
This is from TFA, and should have been in TFS:
As a coder in the AI era, if you don't have access to massive compute, you might end up producing far less software than your colleagues, threatening your career prospects.
When I read that, I couldn't help thinking that software development will move farther and faster toward every project being its own gig. Any company benefits beyond those making an employee more effective will be sacrificed by said employee in the pursuit of more dollars and a better resume to help land more - and more lucrative - gigs in the future.
I didn't use the word 'gig' carelessly. I predict that if what TFA is talking about ever gains real traction, it will turn the whole industry into the high end of the gig economy. A much larger portion of corporate programming departments will consist of temps working for large paycheques and minimal benefits.
Coincidentally - or maybe not - this dovetails nicely with the advent of "vibe coding". Everything written will be the programming equivalent of dollar store goods: it will be cheap, it will work (perhaps only for some values of "work"), and nobody will miss it when it falls apart because it was meant to fill a short-term need and by then it will be "on to the next".
Everybody expects dollar store goods to work, but nobody expects quality or durability from them. This may be the advent of dollar store programming as an everyday industry-wide practice.
Re: (Score:3)
I'm inclined to agree as someone pretty deeply embedded in the bullshit currently, 20 years into my career as a software engineer.
Though only thing I'm not so sure about is the large paycheques part.
Mostly, we've been looking at this semi-sentient codegen operators as disposable, and paying them disposable wages.
Re: (Score:3)
People round the world; in the workplace and more in their homes, will just be expected to use buggy software prone to crashing and messing up data; it will just be an accepted thing. The days of well made, easy to use, robust software will disappear. I wonder if we'll start seeing more things return to pen and paper as a result?
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
A much larger portion of corporate programming departments will consist of temps working for large paycheques and minimal benefits.
I believe the ideal is to have EVERYONE, not merely programmers, be temps without benefits.
It is nice to have slaves without being responsible for caring for the health and well being of those slaves.
Alternative offer (Score:2)
guillotine
Fake news (Score:1)
Nobody is asking this lol gtfo
A valid concern (Score:2)
A decently proficient software developer can get an awful lot done with AI assistance these days. Far more than anyone would be capable of on their own. AI can be an incredible productivity booster in the hands of a practiced user, and in my opinion those practitioners are way more valuable as employees than the folks who won't use AI.
But the AI rocket fuel does cost money. A good coding practitioner who is able to flog the AI unmercifully can burn through a lot of credits. I'm seeing reports of $2-3k per m
remember when we needed ppl and wanted them around (Score:1)
by the end of this century, hiring is going to look like a fad of the previous one.
Compensation means employee owns it (Score:2)
Re: (Score:2)
What's important to remember, is that you are taxed at the fair market value of the compensation- regardless of whether you own it.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
But I think you don't actually care enough to read it. I think you'd rather remain ignorant.
Re: (Score:2)
From a legal perspective- the rules are way too fucking complicated for me.
I trust our accounting department to tell me what's taxable and what isn't (since they have to account for them too)
Anything you can't take with is not "compensation" (Score:4, Insightful)
If you can't take it with you when you decide to walk out the door (or the company shows it to you), it is not compensation. Period, end of story.
- Stock options: do you actually have the stocks yet?
- Bonuses: do you actually have the bonus yet?
- Fancy coffee machines and free lunches: nope
Insist on money so that you can decide what to do with it.
A note on stock option. Besides the fact that stock options often don't pan out, investing in the industry you work in (much less the company you work for) is generally a bad idea. If the industry is in a down cycle and you get laid off, your options are probably worthless at that point as well. The value of your options is not tied to your effort but the decisions of PHB a few floors up.
Sincerely,
The Grey Beard
Subtract from your pay to train your replacement (Score:1)
Hell No (Score:2)
If you offer me subscriptions to AI platforms as compensation I am walking out the door.
Re: (Score:2)
energy as compensation (Score:2)
Energy credits to run your compute or your coffee maker? This future of currency has been predicted by sci-fi authors for longer than I've been alive. I think it's probably going to happen one day, but it is also not terribly insightful to point out.
Let them eat cake (Score:2)
Astroturfing an idea (Score:1)
This is so clearly some astroturfing from the hollow suits&ties to plant the idea they could count something as pseudo-compensation they can provide for nearly free while increasing the usage count of their more-or-less-random BS-generators - and then they can hassle their subordinates why they are not more productive, forcing ever more unpaid overtime.
With all that AI, who cares about a paycheck (Score:1)
not compensation (Score:2)
Can you eat it? (Score:2)
Or, can you buy stuff with it? If you leave the company, do you get to keep it?
Calling it "compensation" is probably illegal, since it's considered a necessary to perform the job. Employers are required to provide employees with the tools needed to do their jobs.
Thankfully, my company isn't trying this swindle, they provide professional GitHub Copilot licenses for all developers.
Kind of like Printer Autofactory Minutes (PAMs) (Score:2)