×
Cloud

Alternative Clouds Are Booming As Companies Seek Cheaper Access To GPUs (techcrunch.com) 1

An anonymous reader quotes a report from TechCrunch: CoreWeave, the GPU infrastructure provider that began life as a cryptocurrency mining operation, this week raised $1.1 billion in new funding from investors, including Coatue, Fidelity and Altimeter Capital. The round brings its valuation to $19 billion post-money and its total raised to $5 billion in debt and equity -- a remarkable figure for a company that's less than 10 years old. It's not just CoreWeave. Lambda Labs, which also offers an array of cloud-hosted GPU instances, in early April secured a "special purpose financing vehicle" of up to $500 million, months after closing a $320 million Series C round. The nonprofit Voltage Park, backed by crypto billionaire Jed McCaleb, last October announced that it's investing $500 million in GPU-backed data centers. And Together AI, a cloud GPU host that also conducts generative AI research, in March landed $106 million in a Salesforce-led round.

So why all the enthusiasm for -- and cash pouring into -- the alternative cloud space? The answer, as you might expect, is generative AI. As the generative AI boom times continue, so does the demand for the hardware to run and train generative AI models at scale. GPUs, architecturally, are the logical choice for training, fine-tuning and running models because they contain thousands of cores that can work in parallel to perform the linear algebra equations that make up generative models. But installing GPUs is expensive. So most devs and organizations turn to the cloud instead. Incumbents in the cloud computing space -- Amazon Web Services (AWS), Google Cloud and Microsoft Azure -- offer no shortage of GPU and specialty hardware instances optimized for generative AI workloads. But for at least some models and projects, alternative clouds can end up being cheaper -- and delivering better availability.

On CoreWeave, renting an Nvidia A100 40GB -- one popular choice for model training and inferencing -- costs $2.39 per hour, which works out to $1,200 per month. On Azure, the same GPU costs $3.40 per hour, or $2,482 per month; on Google Cloud, it's $3.67 per hour, or $2,682 per month. Given generative AI workloads are usually performed on clusters of GPUs, the cost deltas quickly grow. "Companies like CoreWeave participate in a market we call specialty 'GPU as a service' cloud providers," Sid Nag, VP of cloud services and technologies at Gartner, told TechCrunch. "Given the high demand for GPUs, they offers an alternate to the hyperscalers, where they've taken Nvidia GPUs and provided another route to market and access to those GPUs." Nag points out that even some Big Tech firms have begun to lean on alternative cloud providers as they run up against compute capacity challenges.
Microsoft signed a multi-billion-dollar deal with CoreWeave last June to help provide enough power to train OpenAI's generative AI models.

"Nvidia, the furnisher of the bulk of CoreWeave's chips, sees this as a desirable trend, perhaps for leverage reasons; it's said to have given some alternative cloud providers preferential access to its GPUs," reports TechCrunch.
AI

OpenAI and Stack Overflow Partner To Bring More Technical Knowledge Into ChatGPT (theverge.com) 5

OpenAI and the developer platform Stack Overflow have announced a partnership that could potentially improve the performance of AI models and bring more technical information into ChatGPT. From a report: OpenAI will have access to Stack Overflow's API and will receive feedback from the developer community to improve the performance of AI models. OpenAI, in turn, will give Stack Overflow attribution -- aka link to its contents -- in ChatGPT. Users of the chatbot will see more information from Stack Overflow's knowledge archive if they ask ChatGPT coding or technical questions. The companies write in the press release that this will "foster deeper engagement with content." Stack Overflow will use OpenAI's large language models to expand its Overflow AI, the generative AI application it announced last year. Further reading: Stack Overflow Cuts 28% Workforce as the AI Coding Boom Continues (October 2023).
Technology

'The Good Enough Trap' (ian-leslie.com) 26

An anonymous reader shares an essay: Software designers refer to "the good enough principle." It means, simply put, that sometimes you should prioritise functionality over perfection. As a relentless imperfectionist, I'm inclined to embrace this idea. I gave this newsletter its name to encourage myself to post rough versions of my pieces rather than not to write them at all. When it comes to parenting, I'm a Winnicottian: I believe you shouldn't try to be the perfect mum or dad because there's no such thing. At work and in life, it's often true that the optimal strategy is not to strive for the optimal result, but to aim for what works and hope for the best.

The good enough can be a staging post to the perfect. The iPhone's camera was a "good enough" substitute for a compact camera. It did the job, but it wasn't as good as a Kodak or a Fuji. Until it was. Technological innovation often works like this, but the improvement curve isn't always as steep as with the smartphone camera. Sometimes we allow ourselves to get stuck with a product which is good enough to displace the competition, without fulfilling the same range of needs. The psychological and social ramifications can be profound.

Let's say you're a student and you use ChatGPT to write your essays for you. Give it the right prompts and it will produce pieces that are good enough to get the grade you need. That seems like a win: it saves you time and effort, presuming your tutors don't notice or don't care. Maybe you get through the whole of university this way. But be wary of this equilibrium. Over the longer term, you will be stunting the growth of your own mind. The struggle of turning inchoate thought into readable sentences and paragraphs is a powerful exercise for the brain. It's how you get better at thinking. It is thinking.

News

Shell Sold Millions of 'Phantom' Carbon Credits 36

Shell sold millions of carbon credits tied to CO2 removal that never took place [non-paywalled link] to Canada's largest oil sands companies, raising new doubts about a technology seen as crucial to mitigating greenhouse gas emissions. FT: As part of a subsidy scheme to boost the industry, the Alberta provincial government allowed Shell to register and sell carbon credits equivalent to twice the volume of emissions avoided by its Quest carbon capture facility between 2015 and 2021, the province's registry shows. The subsidy was reduced and then ended in 2022.

As a result of the scheme, Shell was able to register 5.7mn credits that had no equivalent CO2 reductions, selling these to top oil sands producers and some of its own subsidiaries. Credits are typically equivalent to one tonne of CO2. Some of the largest buyers of the credits were Chevron, Canadian Natural Resources, ConocoPhillips, Imperial Oil and Suncor Energy. Keith Stewart, a senior energy strategist with Greenpeace Canada, criticised these "phantom credits." Stewart added: "Selling emissions credits for reductions that never happened ... literally makes climate change worse."

Shell said carbon capture played "an important role in helping to decarbonise industry and sectors where emissions cannot be avoided" and that realising its potential "requires creating market incentives now." Alberta's environment ministry said the crediting support scheme had not resulted in "additional emissions" by industrial polluters.
News

North Yorkshire Apostrophe Fans Demand Road Signs With Nowt Taken Out (theguardian.com) 35

A council has provoked the wrath of residents and linguists alike after announcing it would ban apostrophes on street signs to avoid problems with computer systems. From a report: North Yorkshire council is ditching the punctuation point after careful consideration, saying it can affect geographical databases. The council said all new street signs would be produced without one, regardless of whether they were used in the past. Some residents expressed reservations about removing the apostrophes, and said it risked "everything going downhill." They urged the authority to retain them.

Sam, a postal worker in Harrogate, a spa town in North Yorkshire, told the BBC that signs missing an apostrophe -- such as the nearby St Mary's Walk sign that had been erected in the town without it -- infuriated her. "I walk past the sign every day and it riles my blood to see inappropriate grammar or punctuation," she said. Though the updated St Mary's sign had no apostrophe, someone had graffitied an apostrophe back on to the sign with a marker pen, which the former teacher said was "brilliant." She suggested the council was providing a bad example to children who spend a long time learning the basics of grammar only to see it not being used correctly on street signs.

Dr Ellie Rye, a lecturer in English language and linguistics at the University of York, said apostrophes were a relatively new invention in our writing and, often, context allows people to understand their meaning. "If I say I live on St Mary's Walk, we're expecting a street name or an address of some kind." She said the change would matter to people who spend a long time teaching how we write English but that it was "less important in [verbal] communication."

Security

Google is Changing How You Set Up 2FA 27

Google is streamlining the process of setting up two-factor authentication (2FA). From a report: Instead of entering your phone number first to enable 2FA, you can now add a "second step method" to your account such as an authenticator app or a hardware security key to get things set up. This should make it safer to turn on 2FA, as it lets you avoid using less secure SMS verification. You can choose to enter a time-based one-time passcode through apps like Google Authenticator, or you can follow the steps to link a hardware security key.
AI

40,000 AI-Narrated Audiobooks Flood Audible (techspot.com) 60

A new breed of audiobook is taking over digital bookshelves -- ones narrated not by professional voice actors, but by artificial intelligence voices. It's an AI audiobook revolution that has been turbo-charged by Amazon. From a report: Since announcing a beta tool last year allowing self-published authors to generate AI "virtual voice" narrations for their ebooks, over 40,000 AI-narrated titles have flooded onto Audible, Amazon's audiobook platform. The eye-popping stat, revealed in a recent Bloomberg report, has many authors celebrating but is also raising red flags for human narrators.

For indie writers wanting to crack the lucrative audiobook market without paying hefty professional voiceover fees, Amazon's free virtual narration tool is a game-changer. One blogger cited in the report claimed converting an ebook to audio using the AI narration took just 52 minutes, bypassing the expensive studio recording route. Others have mixed reactions. Last month, an author named George Steffanos launched an audiobook version of his existing book, posting that while he prefers human-generated works to those generated by AI, "the modest sales of my work were never going to support paying anyone for all those hours of narration."

Earth

Poorer Nations Must Be Transparent Over Climate Spending, Says Cop29 Leader (theguardian.com) 27

Poor countries must demonstrate clearer accounting and transparency to back up their calls for trillions of dollars of climate finance, the president of global climate negotiations has said. From a report: Mukhtar Babayev, the ecology minister of Azerbaijan, who will lead the Cop29 UN climate summit in November, urged governments in developing countries to draw up reports showing their progress on cutting greenhouse gas emissions, and their spending on the climate crisis. "It's very important to build this correct, good and honest trust between the parties," he said in an interview in Baku, the capital of Azerbaijan. "It's a very, very important step, the creation of a transparency mechanism between the countries."

At Cop29 in Baku, countries will be expected to come up with a new global goal on supplying climate finance to poorer countries, to help them cut their greenhouse gas emissions and adapt to the impacts of extreme weather. Some governments from the global south are calling for the sums to reach more than $1tn a year. These pledges are expected to be subject to bitter wrangling at Cop29, as rich countries are unlikely to agree to provide anything like such sums from their taxpayers but the role of other sources of finance -- such as the private sector -- is still in question.

Security

Police Resurrect Lockbit's Site and Troll the Ransomware Gang (techcrunch.com) 14

An international coalition of police agencies have resurrected the dark web site of the notorious LockBit ransomware gang, which they had seized earlier this year, teasing new revelations about the group. From a report: On Sunday, what was once LockBit's official darknet site reappeared online with new posts that suggest the authorities are planning to release new information about the hackers in the next 24 hours, as of this writing. The posts have titles such as "Who is LockBitSupp?," "What have we learnt," "More LB hackers exposed," and "What have we been doing?"

In February, a law enforcement coalition that included the U.K.'s National Crime Agency, the U.S. Federal Bureau of Investigation, as well as forces from Germany, Finland, France, Japan and others announced that they had infiltrated LockBit's official site. The coalition seized the site and replaced information on it with their own press release and other information in a clear attempt to troll and warn the hackers that the authorities were on to them.

PlayStation (Games)

PlayStation Reverses Course on Helldivers 2 PSN Account Requirement 41

PlayStation has reversed course on the Helldivers 2 PSN account requirement, walking back the unpopular policy after a weekend long backlash that included tens of thousands of negative reviews, some of which spread to Sony's other Steam games. From a report: "Helldivers fans -- we've heard your feedback on the Helldivers 2 account linking update. The May 6 update, which would have required Steam and PlayStation Network account linking for new players and for current players beginning May 30, will not be moving forward," PlayStation wrote on its official account.

"We're still learning what is best for PC players and your feedback has been invaluable. Thanks again for your continued support of Helldivers 2 and we'll keep you updated on future plans." PlayStation's decision means that Helldivers 2 players on Steam won't have to link a PSN account in order to play. The unpopular policy, which would have seen new players confronted with a mandatory login beginning this week, resulted in Helldivers 2 being delisted in around 177 countries.
Microsoft

Microsoft Readies New AI Model To Compete With Google, OpenAI (theinformation.com) 20

For the first time since it invested more than $10 billion into OpenAI in exchange for the rights to reuse the startup's AI models, Microsoft is training a new, in-house AI model large enough to compete with state-of-the-art models from Google, Anthropic and OpenAI itself. The Information: The new model, internally referred to as MAI-1, is being overseen by Mustafa Suleyman, the ex-Google AI leader who most recently served as CEO of the AI startup Inflection before Microsoft hired the majority of the startup's staff and paid $650 million for the rights to its intellectual property in March. But this is a Microsoft model, not one carried over from Inflection, although it may build on training data and other tech from the startup. It is separate from the Pi models that Inflection previously released, according to two Microsoft employees with knowledge of the effort.

MAI-1 will be far larger than any of the smaller, open source models that Microsoft has previously trained, meaning it will require more computing power and training data and will therefore be more expensive, according to the people. MAI-1 will have roughly 500 billion parameters, or settings that can be adjusted to determine what models learn during training. By comparison, OpenAI's GPT-4 has more than 1 trillion parameters, while smaller open source models released by firms like Meta Platforms and Mistral have 70 billion parameters. That means Microsoft is now pursuing a dual trajectory of sorts in AI, aiming to develop both "small language models" that are inexpensive to build into apps and that could run on mobile devices, alongside larger, state-of-the-art AI models.

The Almighty Buck

More Than 90% of Stablecoin Transactions Aren't From Real Users, Visa Study Finds (theedgesingapore.com) 38

More than 90% of stablecoin transaction volumes aren't coming from genuine users, according to a new metric co-developed by Visa, suggesting such crypto tokens may be far away from becoming a commonly used means of payment. Bloomberg: The dashboard from Visa and Allium Labs is designed to strip out transactions initiated by bots and large-scale traders to isolate those made by real people. Out of about $2.2 trillion in total transactions in April, just $149 billion originated from "organic payments activity," according to Visa.

Visa's finding challenges stablecoin proponents' argument that the tokens, pegged to an asset like the dollar, are poised to revolutionize the $150 trillion payments industry. PayPal and Stripe are among the fintech giants making inroads into stablecoins, with Stripe co-founder John Collison in April citing "technical improvements" for being bullish on the tokens. [...] Visa itself, which handled more than $12 trillion worth of transactions last year, is among companies that could stand to lose out should stablecoins become a generally accepted means of payment.

Privacy

In Argentina, Facing Surging Inflation, 500K Accept Worldcoin's Offer of $50 for Iris-Scanning (restofworld.org) 53

Wednesday Rest of World noticed an overlooked tech story in Argentina: Olga de León looked confused as she walked out of a nightclub on the edge of Buenos Aires on a recent Tuesday afternoon. She had just had her iris scanned. "No one told me what they'll do with my eye," de León, 57, told Rest of World. "But I did this out of need." De León, who lives off the $95 pension she receives from the state, had been desperate for money. Persuaded by her nephew, she agreed to have one of her irises scanned by Worldcoin, Sam Altman's blockchain project. In exchange, she received nearly $50 worth of WLD, the company's cryptocurrency.

De León is one of about half a million Argentines who have handed their biometric data over to Worldcoin. Beaten down by the country's 288% inflation rate and growing unemployment, they have flocked to Worldcoin Orb verification hubs, eager to get the sign-up crypto bonus offered by the company. A network of intermediaries — who earn a commission from every iris scan — has lured many into signing up for the practice in Argentina, where data privacy laws remain weak. But as the popularity of Worldcoin skyrockets in the country, experts have sounded the alarm about the dangers of giving away biometric data. Two provinces are now pushing for legal investigations. "Seeing that [iris scans have] been banned in European countries, shouldn't we be trying to stop it, too?" Javier Smaldone, a software consultant and digital security expert, told Rest of World.

Last month Worldcoin's web site announced that more than 10 million people in 160 countries had created a World ID and compatible wallet (performing 75 million transactions) — and that 5,195,475 people had also verified their World ID using Worldcoin's iris-scanning Orb.

But the article notes a big drop in the number of countries even allowing Worldcoin's iris-scanning — from 25 to just eight. While in less than a year Worldcoin opened nearly 60 centers across Argentina...
Twitter

Elon Musk's X Launches Grok AI-Powered 'Stories' Feature (techcrunch.com) 66

An anonymous reader shared this report from Mint: Elon Musk-owned social media platform X (formerly Twitter) has launched a new Grok AI-powered feature called 'Stories', which allows users to read summaries of a trending post on the social media platform. The feature is currently only available to X Premium subscribers on the iOS and web versions, and hasn't found its way to the Android application just yet... instead of reading the whole post, they'll have Grok AI summarise it to get the gist of those big news stories. However, since Grok, like other AI chatbots on the market, is prone to hallucination (making things up), X provides a warning at the end of these stories that says: "Grok can make mistakes, verify its outputs."
"Access to xAI's chatbot Grok is meant to be a selling point to push users to buy premium subscriptions," reports TechCrunch: A snarky and "rebellious" AI, Grok's differentiator from other AI chatbots like ChatGPT is its exclusive and real-time access to X data. A post published to X on Friday by tech journalist Alex Kantrowitz lays out Elon Musk's further plan for AI-powered news on X, based on an email conversation with the X owner. Kantrowitz says that conversations on X will make up the core of Grok's summaries. Grok won't look at the article text, in other words, even if that's what people are discussing on the platform.
The article notes that some AI companies have been striking expensive licensing deals with news publishers. But in X's case, "it's able to get at the news by way of the conversation around it — and without having to partner to access the news content itself."
Star Wars Prequels

How 'Star Wars' was Influenced by San Francisco - and Architecture (sfgate.com) 40

"Without San Francisco, Star Wars wouldn't exist," says David Reat, the culture studies director of the architecture department at Glasgow's University of Strathclyde.

SFGate reports: Lucas was born and raised in Modesto, where his father expected him to run the family stationery store once he turned 18, but Lucas instead left for Los Angeles, where he studied film production at the University of Southern California, before moving to San Francisco. Despite all that these cities had to offer, Lucas constantly found himself conflicted over his feelings toward them. "The battle of living in the country versus living in the city is huge with Lucas," says Reat, who notes that this theme runs throughout the likes of "THX 1138," "American Graffiti" and the "Star Wars" series. "He sees cities as the givers and takers of things. He's fascinated by cities. He doesn't actually want to live in one. He now lives in a ranch near one. He wants to orbit them. He's a paradox."

When Lucas moved to San Francisco in the late 1960s, there were a number of huge building projects taking place across the city that piqued the burgeoning filmmaker's interest, most notably the construction of BART and a new terminal at San Francisco airport. "Infrastructure really fascinated Lucas. They were these big huge alienating spaces," says Reat. "I think Lucas was driving around San Francisco, looking at them, and seeing that they looked alien." There's a reason why Lucas was particularly interested in the architecture in San Francisco: "He's on record as saying he wanted to be an architect," says Reat. "He has referred to himself as a frustrated architect." Lucas' interest provoked him and his creative team to put extra care and thought into each of the "Star Wars" buildings, vehicles, houses, villages, cities, worlds and galaxies, especially when it came to what they symbolized and represented.

"The architecture in the films play a key role for younger viewers," says Reat, explaining that it helps to indicate who is good and who is evil. When it comes to the Death Star there are "no women, no plants, no signs of life, and it's basically the Nazis in space," continues Reat. "Lucas doesn't like modernism. He always uses it for bad things, a bit like every James Bond baddie." Meanwhile, Luke Skywalker and the rest of the light side of the Force are seen living in "exaggerated domesticity" as they sit around drinking blue milk, surrounded by creatures. "There's a care and a weirdness to their architecture, plus it's loaded with color," says Reat, who adds that these choices help to make those characters more appealing and relatable....

The San Francisco International Airport also played a key role in the making of "Phantom Menace." A tour of its maintenance bay gave the film's creative designers a jolt of inspiration when they were creating Anakin's podracer and other vehicles.

The article also adds that the inspiration for the Theed Royal Palace on Naboo in The Phantom Menace was "the Marin County Civic Center, where Lucas once served jury duty."

Slashdot Top Deals