×
Medicine

Google Lens Can Now Search For Skin Conditions 11

Google Lens, the company's computer vision-powered app that scans objects and brings up relevant information, is now able to search for skin conditions, like moles and rashes. "Uploading a picture or photo through Lens will kick off a search for visual matches, which will also work for other physical maladies that you might not be sure how to describe with words (like a bump on the lip, a line on nails or hair loss)," reports TechCrunch. From the report: It's a step short of the AI-driven app Google launched in 2021 to diagnose skin, hair and nail conditions. That app, which debuted first in the E.U., faced barriers to entry in the U.S., where it would have had to have been approved by the Food and Drug Administration. (Google declined to seek approval.) Still, the Lens feature might be useful for folks deciding whether to seek medical attention or over-the-counter treatments. Lens integration with Google Bard is also coming soon. "Users will be able to include images in their Bard prompts and Lens will work behind the scenes to help Bard make sense of what's being shown," reports TechCrunch.
Google

Google Is Weaving Generative AI Into Online Shopping Features (bloomberg.com) 10

Google is bringing generative AI technology to shopping, aiming to get a jump on e-commerce sites like Amazon. From a report: The Alphabet-owned company announced features Wednesday aimed at helping people understand how apparel will fit on them, no matter their body size, and added capabilities for finding products using its search and image-recognition technology. Additionally, Google introduced new ways to research travel destinations and map routes using generative AI -- technology that can craft text, images or even video from simple prompts.

"We want to make Google the place for consumers to come shop, as well as the place for merchants to connect with consumers," Maria Renz, Google's vice president of commerce, said in an interview ahead of the announcement. "We've always been committed to an open ecosystem and a healthy web, and this is one way where we're bringing this technology to bear across merchants." Google is the world's dominant search engine, but 46% of respondents in a survey of US shoppers conducted last year said they still started their product searches and research on Amazon, according to the research firm CivicScience. TikTok, too, is making inroads, CivicScience's research found -- 18% of Gen Z online shoppers turn to the platform first. Google is taking note, with some of its new, AI-powered shopping exploration features aimed at capturing younger audiences.

A new virtual "try-on" feature, launching on Wednesday, will let people see how clothes fit across a range of body types, from XXS to 4XL sizes. Apparel will be overlaid on top of images of diverse models that the company photographed while developing the capability. Google said it was able to launch such a service because of a new image-based AI model that it developed internally, and the company is releasing a new research paper detailing its work alongside the announcement.

Sony

Sony Starts Testing Cloud Streaming PS5 Games (theverge.com) 22

Sony says it has started testing the ability to stream PS5 games from the cloud. The PlayStation maker says it's testing cloud streaming for PS5 games and is planning to add this as a feature to its PlayStation Plus Premium subscription. From a report: "We're currently testing cloud streaming for supported PS5 games -- this includes PS5 titles from the PlayStation Plus Game Catalog and Game Trials, as well as supported digital PS5 titles that players own," says Nick Maguire, VP of global services, global sales, and business operations at Sony Interactive Entertainment. "When this feature launches, cloud game streaming for supported PS5 titles will be available for use directly on your PS5 console." A cloud feature for PS5 games would mean you'll no longer have to download games to your console to stream them to other devices. Sony currently supports streaming PS5 games to PCs, Macs, and iOS and Android devices, but you have to use your PS5 as the host to download and stream titles to your other devices.
AI

Amazon Using Generative AI To Summarize Product Reviews (cnbc.com) 26

Amazon is turning to artificial intelligence to help users find the right product. From a report: The e-retailer recently began testing a feature in its shopping app that uses AI to summarize reviews left by customers on some products. It provides a brief overview of what shoppers liked and disliked about the product, along with a disclaimer that the summary is "AI-generated from the text of customer reviews." A mobile listing for a children's "Magic Mixies" cauldron toy says that buyers gave positive feedback around its "fun factor, appearance, value, performance, quality, charging, and leakage."

"However, the majority of customers have expressed negative opinions on these aspects," the summary states. "For example, some customers have paid over $100 for a toy that wasn't worth it, while others have experienced issues with the product's quality and charging." Amazon confirmed that it's testing the feature. The company didn't share specific details about it works or what AI models are being used to summarize.

Privacy

Edge Sends Images You View Online To Microsoft 39

An anonymous reader shares a report: Not so long ago, Microsoft Edge ended up in hot waters after users discovered a bug leaking your browser history to Bing. Now you may want to toggle off another feature to ensure Edge is not sending every picture you view online to Microsoft. Edge has a built-in image enhancement tool that, according to Microsoft, can use "super-resolution to improve clarity, sharpness, lighting, and contrast in images on the web." Although the feature sounds exciting, recent Microsoft Edge Canary updates have provided more information on how image enhancement works. The browser now warns that it sends image links to Microsoft instead of performing on-device enhancements.
Programming

Does the New 'Mojo' Programming Language Offer a Faster Superset of Python? (infoworld.com) 70

InfoWorld explores how the new Mojo program language "resembles Python, how it's different, and what it has to offer." The newly unveiled Mojo language is being promoted as the best of multiple worlds: the ease of use and clear syntax of Python, with the speed and memory safety of Rust. Those are bold claims, and since Mojo is still in the very early stages of development, it will be some time before users can see for themselves how the language lives up to them. But Mojo's originator — a company named Modular — has provided early access [through a limited-enrollment preview program] to an online playground: a Jupyter Notebook environment where users can run Mojo code and learn about the language's features and behavior...

Mojo can be described as a "superset" of Python. Programs written in Python are valid Mojo programs, although some Python behaviors haven't yet been implemented... It's also possible to use the actual Python runtime for working with existing Python modules, although there is a performance cost. When Mojo introduces new syntax, it's for system-level programming features, chiefly manual memory handling. In other words, you can write Python code (or something almost exactly like it) for casual use cases, then use Mojo for more advanced, performance-intensive programming scenarios... Mojo's other big difference from Python is that Mojo's not interpreted through a runtime, as Python is. Mojo is compiled ahead-of-time to machine-native code, using the LLVM toolchain. To that end, the best performance comes from using features specific to Mojo. Python features are likely to come at the cost of emulating Python's dynamic behaviors, which are inherently slow — or again, by just using the Python runtime.

Many of Mojo's native language features do one of two things. They're either entirely new features not found in Python at all, or expansions of a Python feature that make it more performant, although with less of Python's dynamism.

For example, Mojo has its own fn keyword which defines a function with explicitly-typed and immutable-by-default arguments, and its own struct keyword which is less like a Python class and more like its C/C++ and Rust counterpart "with fixed layouts determined at compile time but optimized for machine-native speed."

But "At a glance, the code closely resembles Python. Even the new Mojo-specific keywords integrate well with existing Python syntax, so you can run your eye down the code and get a general idea of what's happening." And then there's the speed... The notebook demos also give examples of how Mojo code can be accelerated via parallelism, vectorizing, and "tiling" (increasing cache locality for operations). One of the demos, a 128x128 matrix multiplication demo, yielded a claimed 17-times speedup over Python (using the Python runtime in the Mojo playground) by simply running as-is with no special modification. Mojo added 1866x speedup by adding type annotations, 8500x speedup by adding vectorized operations, and 15000x speedup by adding parallelization.
Debian

Debian 12 'Bookworm' Released (debian.org) 62

Slashdot reader e065c8515d206cb0e190 shared the big announcement from Debian.org: After 1 year, 9 months, and 28 days of development, the Debian project is proud to present its new stable version 12 (code name bookworm).

bookworm will be supported for the next 5 years thanks to the combined work of the Debian Security team and the Debian Long Term Support team...

This release contains over 11,089 new packages for a total count of 64,419 packages, while over 6,296 packages have been removed as obsolete. 43,254 packages were updated in this release. The overall disk usage for bookworm is 365,016,420 kB (365 GB), and is made up of 1,341,564,204 lines of code.

bookworm has more translated man pages than ever thanks to our translators who have made man-pages available in multiple languages such as: Czech, Danish, Greek, Finnish, Indonesian, Macedonian, Norwegian (Bokmål), Russian, Serbian, Swedish, Ukrainian, and Vietnamese. All of the systemd man pages are now completely available in German.

The Debian Med Blend introduces a new package: shiny-server which simplifies scientific web applications using R. We have kept to our efforts of providing Continuous Integration support for Debian Med team packages. Install the metapackages at version 3.8.x for Debian bookworm.

The Debian Astro Blend continues to provide a one-stop solution for professional astronomers, enthusiasts, and hobbyists with updates to almost all versions of the software packages in the blend. astap and planetary-system-stacker help with image stacking and astrometry resolution. openvlbi, the open source correlator, is now included.

Support for Secure Boot on ARM64 has been reintroduced: users of UEFI-capable ARM64 hardware can boot with Secure Boot mode enabled to take full advantage of the security feature.

9to5Linux has screenshots, and highlights some new features: Debian 12 also brings read/write support for APFS (Apple File System) with the apfsprogs and apfs-dkms utilities, a new tool called ntfs2btrfs that lets you convert NTFS drives to Btrfs, a new malloc implementation called mimalloc, a new kernel SMB server called ksmbd-tools, and support for the merged-usr root file system layout...

This release also includes completely new artwork called Emerald, designed (once again) by Juliette Taka. New fonts are also present in this major Debian release, along with a new fnt command-line tool for accessing 1,500 DFSG-compliant fonts.

Debian 12 "bookworm" ships with several desktop environments, including:
  • Gnome 43,
  • KDE Plasma 5.27,
  • LXDE 11,
  • LXQt 1.2.0,
  • MATE 1.26,
  • Xfce 4.18

AI

Nvidia's AI Software Tricked Into Leaking Data 10

An anonymous reader quotes a report from Ars Technica: A feature in Nvidia's artificial intelligence software can be manipulated into ignoring safety restraints and reveal private information, according to new research. Nvidia has created a system called the "NeMo Framework," which allows developers to work with a range of large language models -- the underlying technology that powers generative AI products such as chatbots. The chipmaker's framework is designed to be adopted by businesses, such as using a company's proprietary data alongside language models to provide responses to questions -- a feature that could, for example, replicate the work of customer service representatives, or advise people seeking simple health care advice.

Researchers at San Francisco-based Robust Intelligence found they could easily break through so-called guardrails instituted to ensure the AI system could be used safely. After using the Nvidia system on its own data sets, it only took hours for Robust Intelligence analysts to get language models to overcome restrictions. In one test scenario, the researchers instructed Nvidia's system to swap the letter 'I' with 'J.' That move prompted the technology to release personally identifiable information, or PII, from a database.

The researchers found they could jump safety controls in other ways, such as getting the model to digress in ways it was not supposed to. By replicating Nvidia's own example of a narrow discussion about a jobs report, they could get the model into topics such as a Hollywood movie star's health and the Franco-Prussian war -- despite guardrails designed to stop the AI moving beyond specific subjects. In the wake of its test results, the researchers have advised their clients to avoid Nvidia's software product. After the Financial Times asked Nvidia to comment on the research earlier this week, the chipmaker informed Robust Intelligence that it had fixed one of the root causes behind the issues the analysts had raised.
Iphone

Apple To Stop Autocorrecting Swear Word To 'Ducking' On iPhone (nbcnews.com) 55

At Apple's developer conference earlier this week, the company said it has tweaked the iPhone's autocorrect feature to prevent it from replacing the common expletive with "ducking." Craig Federighi, Apple's software chief, mentioned that the keyboard will now learn and adapt to users typing the intended word. From a report: The iPhone keyboard autocorrect feature has always had its quirks, sometimes taking a misspelled word while texting and substituting what it deems a logical option that ends up changing the meaning of a particular phrase or sentence. Such occurrences generally produce follow-up texts along the lines of "damn autocorrect!" But the "ducking" substitution is a long-standing source of mirth or frustration, depending on how many times one has had to rewrite their own texts or scream at one's own device (the iPhone cannot correct one's verbal epithets).
Facebook

Meta's First Generative AI Feature Will Be AI Stickers In Messenger 15

Meta is planning to introduce AI-generated stickers on Messenger, allowing users to create stickers based on text prompts. The Verge reports: During a companywide meeting today that The Verge listened to, Ahmad Al-Dahle, Meta's vice president of AI, told employees that the company will leverage its image generation model to let users create stickers based on text prompts. Employees will begin testing the feature internally before it's made available to the public. "With AI-generated stickers, our users can have infinitely more options for self-expression, cultural representations, and even trend relevance," Al-Dahle says. "Of course, stickers are just the tip of the iceberg."

Al-Dahle adds that the company is also "working on AI models that are going to transform any image you want in any way you want." That includes doing things like "changing the aspect ratio of your picture" or turning a picture of a corgi "into a painting."
Google

Google's Password Manager Gains Biometric Authentication on Desktop (techcrunch.com) 18

Google's aiming to make it easier to use and secure passwords -- at least, for users of the Password Manager tool built into its Chrome browser. From a report: Today, the tech giant announced that Password Manager, which generates unique passwords and autofills them across platforms, will soon gain biometric authentication on PC. (Android and iOS have had biometric authentication for some time.) When enabled, it'll require an additional layer of security, like fingerprint recognition or facial recognition, before Chrome autofills passwords.

Exactly which types of biometrics are available in Password Manager on desktop will depend on the hardware attached to the PC, of course (e.g. a fingerprint reader), as well as whether the PC's operating system supports it. Beyond "soon," Google didn't say when to expect the feature to arrive.

Privacy

iOS 17 Automatically Removes Tracking Parameters From Links You Click On (9to5mac.com) 54

iOS 17 and macOS Sonoma include even more privacy-preserving features while browsing the web. From a report: Link Tracking Protection is a new feature automatically activated in Mail, Messages, and Safari in Private Browsing mode. It detects user-identifiable tracking parameters in link URLs, and automatically removes them.

Adding tracking parameters to links is one way advertisers and analytics firms try to track user activity across websites. Rather than storing third-party cookies, a tracking identifier is simply added to the end of the page URL. This would circumvent Safari's standard intelligent tracking prevention features that block cross-site cookies and other methods of session storage. Navigating to that URL allows an analytics or advertising service at the destination to read the URL, extract those same unique parameters, and associate it with their backend user profile to serve personalized ads.

Government

10 Years After Snowden's First Leak, What Have We Learned? (theregister.com) 139

An anonymous reader quotes a report from The Register: The world got a first glimpse into the US government's far-reaching surveillance of American citizens' communications -- namely, their Verizon telephone calls -- 10 years ago this week when Edward Snowden's initial leaks hit the press. [...] In the decade since then, "reformers have made real progress advancing the bipartisan notion that Americans' liberty and security are not mutually exclusive," [US Senator Ron Wyden (D-OR)] said. "That has delivered tangible results: in 2015 Congress ended bulk collection of Americans' phone records by passing the USA Freedom Act." This bill sought to end the daily snooping into American's phone calls by forcing telcos to collect the records and make the Feds apply for the information.

That same month, a federal appeals court unanimously ruled that the NSA's phone-records surveillance program was unlawful. The American Civil Liberties Union (ACLU) and the New York Civil Liberties Union sued to end the secret phone spying program, which had been approved by the Foreign Intelligence Surveillance Court, just days after Snowden disclosed its existence. "Once it was pushed out into open court, and the court was able to hear from two sides and not just one, the court held that the program was illegal," Ben Wizner, director of the ACLU Speech, Privacy and Technology project, told The Register. The Freedom Act also required the federal government to declassify and release "significant" opinions of the Foreign Intelligence Surveillance Court (FISC), and authorized the appointment of independent amici -- friends of the court intended to provide an outside perspective. The FISC was established in 1978 under the FISA -- the legislative instrument that allows warrantless snooping. And prior to the Freedom Act, this top-secret court only heard the government's perspective on things, like why the FBI and NSA should be allowed to scoop up private communications.

"To its credit, the government has engaged in reforms, and there's more transparency now that, on the one hand, has helped build back some trust that was lost, but also has made it easier to shine a light on surveillance misconduct that has happened since then," Jake Laperruque, deputy director of the Center for Democracy and Technology's Security and Surveillance Project, told The Register. Wyden also pointed to the sunsetting of the "deeply flawed surveillance law," Section 215 of the Patriot Act, as another win for privacy and civil liberties. That law expired in March 2020 after Congress did not reauthorize it. "For years, the government relied on Section 215 of the USA Patriot Act to conduct a dragnet surveillance program that collected billions of phone records (Call Detail Records or CDR) documenting who a person called and for how long they called them -- more than enough information for analysts to infer very personal details about a person, including who they have relationships with, and the private nature of those relationships," Electronic Frontier Foundation's Matthew Guariglia, Cindy Cohn and Andrew Crocker said.
James Clapper, the former US Director of National Intelligence, "stated publicly that the Snowden disclosures accelerated by seven years the adoption of commercial encryption," Wizner said. "At the individual level, and at the corporate level, we are more secure."

"And at the corporate level, what the Snowden revelations taught big tech was that even as the government was knocking on the front door, with legal orders to turn over customer data, it was breaking in the backdoor," Wizner added. "Government was hacking those companies, finding the few points in their global networks where data passed unencrypted, and siphoning it off." "If you ask the government -- if you caught them in a room, and they were talking off the record -- they would say the biggest impact for us from the Snowden disclosures is that it made big tech companies less cooperative," he continued. "I regard that as a feature, not a bug."

The real issue that the Snowden leaks revealed is that America's "ordinary system of checks and balances doesn't work very well for secret national security programs," Wizner said. "Ten years have gone by," since the first Snowden disclosures, "and we don't know what other kinds of rights-violating activities have been taking place in secret, and I don't trust our traditional oversight systems, courts and the Congress, to ferret those out," Wizner said. "When you're dealing with secret programs in a democracy, it almost always requires insiders who are willing to risk their livelihoods and their freedom to bring the information to the public."
Social Networks

New York City Sues Kia and Hyundai Over Car Thefts That Went Viral on TikTok (theverge.com) 98

New York City became the latest city to file suit against Hyundai and Kia over a rash of vehicle thefts that went viral on TikTok and other social media platforms in recent years, according to The Wall Street Journal. From a report: In its lawsuit, the US attorney's office for the Southern District of New York claims the automakers were guilty of negligence by failing to include anti-theft devices in their cars that would have made them much harder to steal. The so-called "Kia Challenge" has led to hundreds of car thefts nationwide, including at least 14 reported crashes and eight fatalities, according to the National Highway Traffic Safety Administration. Thieves known as the "Kia Boys" would post instructional videos on YouTube and TikTok about how to bypass the vehicles' security systems using tools as simple as a USB cable. Other videos would feature joyrides in stolen vehicles and the resulting property destruction.
Desktops (Apple)

Apple's New Proton-like Tool Can Run Windows Games on a Mac (theverge.com) 50

If you're hoping to see more Windows games on Mac then those dreams might finally come true soon. From a report: Apple has dropped some big news for game developers at its annual Worldwide Developers Conference (WWDC) this week, making it far easier and quicker to port Windows games to Mac thanks to a Proton-like environment that can translate and run the latest DirectX 12 Windows games on macOS. Apple has created a new Game Porting Toolkit that's similar to the work Valve has done with Proton and the Steam Deck.

It's powered by source code from CrossOver, a Wine-based solution for running Windows games on macOS. Apple's tool will instantly translate Windows games to run on macOS, allowing developers to launch an unmodified version of a Windows game on a Mac and see how well it runs before fully porting a game. Mac gaming has been a long running meme among the PC gaming community, despite Resident Evil Village and No Man's Sky ports being some rare recent exceptions to macOS gaming being largely ignored.

"The new Game Porting Toolkit provides an emulation environment to run your existing unmodified Windows game and you can use it to quickly understand the graphics feature usage and performance potential of your game when running on a Mac," explains Aiswariya Sreenivassan, an engineering project manager for GPUs and graphics at Apple, in a WWDC session earlier this week.

IOS

Apple's New iOS 17 Will Warn You If Someone Tries To Send Unsolicited Nudes (businessinsider.com) 70

Apple's new iOS 17 includes a Sensitive Content Warning feature that notifies users when they receive unsolicited nude images. Insider reports: Apple said in a press release that the Sensitive Content Warning would help adult users avoid seeing unwanted nude images and videos. The company would not get access to the content as processing for the new feature occurred on the user's device, the press release added. The tech giant is also expanding Communication Safety, a feature aimed at protecting children, to cover sending and receiving content via AirDrop, Contact Posters, and FaceTime messages. The privacy feature will also expand to cover video content, as well as images. Further reading: Apple Announces iOS 17 With StandBy Charging Mode, Better Autocorrect
Anime

Redditor Creates Working Anime QR Codes Using Stable Diffusion (arstechnica.com) 61

An anonymous reader quotes a report from Ars Technica: On Tuesday, a Reddit user named "nhciao" posted a series of artistic QR codes created using the Stable Diffusion AI image-synthesis model that can still be read as functional QR codes by smartphone camera apps. The functional pieces reflect artistic styles in anime and Asian art. [...] In this case, despite the presence of intricate AI-generated designs and patterns in the images created by nhciao, we've found that smartphone camera apps on both iPhone and Android are still able to read these as functional QR codes. If you have trouble reading them, try backing your camera farther away from the images.

Stable Diffusion is an AI-powered image-synthesis model released last year that can generate images based on text descriptions. It can also transform existing images using a technique called "img2img." The creator did not detail the exact technique used to create the novel codes in English, but based on this blog post and the title of the Reddit post ("ControlNet for QR Code"), they apparently trained several custom Stable Diffusion ControlNet models (plus LoRA fine tunings) that have been conditioned to create different-styled results. Next, they fed existing QR codes into the Stable Diffusion AI image generator and used ControlNet to maintain the QR code's data positioning despite synthesizing an image around it, likely using a written prompt. Other techniques exist to make artistic-looking QR codes by manipulating the positions of dots within the codes to make meaningful patterns that can still be read. In this case, Stable Diffusion is not only controlling dot positions but also blending picture details to match the QR code.

This interesting use of Stable Diffusion is possible because of the innate error correction feature built into QR codes. This error correction capability allows a certain percentage of the QR code's data to be restored if it's damaged or obscured, permitting a level of modification without making the code unreadable. In typical QR codes, this error correction feature serves to recover information if part of the code is damaged or dirty. But in nhciao's case, it has been leveraged to blend creativity with utility. Stable Diffusion added unique artistic touches to the QR codes without compromising their functionality. [...] This discovery opens up new possibilities for both digital art and marketing. Ordinary black-and-white QR codes could be turned into unique pieces of art, enhancing their aesthetic appeal. The positive reaction to nhciao's experiment on social media may spark a new era in which QR codes are not just tools of convenience but also interesting and complex works of art.

IOS

Apple Announces iOS 17 With StandBy Charging Mode, Better Autocorrect (theverge.com) 44

At WWDC today, Apple debuted iOS 17. "Highlights include new safety features, a built-in journaling app, a new nightstand mode, redesigned contact cards, better auto-correct and voice transcription, and live voicemail," reports The Verge. "And you'll be able to drop the 'hey' from 'Hey Siri.'" From the report: Your contact book is getting an update with a new feature called posters, which turns contact cards into flashy marquee-like images that show up full-screen on your recipient's iPhone when you call them. They use a similar design language as the redesigned lock screens, with bold typography options and the ability to add Memoji, and will work with third-party VoIP apps. There's also a new live transcription feature for voicemail that lets you view a transcript of the message a caller is leaving in real time. You can choose to ride it out or pick up the call, and it's all handled on-device. You'll also be able to leave a message on FaceTime, too.

Some updates to messages include the ability to filter searches with additional terms, a feature that jumps to the most recent message so you can catch up more easily, transcriptions of voice messages -- similar to what the Pixel 7 series introduced -- and a series of new features called Check In that shares your live location and status with someone else. It can automatically send a message to a friend when you've arrived home, and it can share your phone's battery and cell service status to help avoid confusion if you're in a dead zone. Stickers are getting an overhaul, too, with the ability to add any emoji or photo cutout as a "sticker" positioned on iMessages or anywhere within the system. Live photos can be turned into animated stickers, too, and you can now add effects to stickers.

AirDrop gets an update to send contact information -- cleverly called NameDrop -- which will send your selected email addresses and phone numbers (and your poster) just by bringing two iPhones near each other. It also works between an iPhone and an Apple Watch. Photos can be shared the same way, and if the file is a big one, it's now possible to move out of range while continuing the download. iOS 17 also includes keyboard updates, including enhancements to autocorrect. It now relies on a new language model for better accuracy, plus an easier shortcut to revert to the original word you wrote if necessary. There's now in-line predictive typing and sentence-level autocorrections to correct more grammatical mistakes. It'll finally learn your favorite cuss words, too; Apple's Craig Federighi even made a "ducking" joke onstage. Dictation uses a new AI model, too, that's more accurate.

A new app called Journal automatically suggests moments that you might want to commemorate in a journal entry. Your entries can include photos, music, and activities, and you can schedule reminders for yourself to start writing. It's end-to-end encrypted, too, to keep things private. StandBy is a new mode for charging that turns the screen into a status display with the date and time. It can show information from Live Activities, widgets, and smart stacks and automatically turns on when your phone is in landscape mode while charging. You can swipe to the right to see some of your highlighted photos, and it comes with customizable clockfaces. Siri will surface visual results in StandBy, and the display shifts to a red tone at night to avoid disrupting sleep. Last but not least, Siri gets a boost, too, and finally lets you drop the "hey" from "Hey Siri." It will also recognize back-to-back commands.
iOS 17 is available to developers today, with a public beta released next month.
OS X

Apple Announces macOS Sonoma With Desktop Widgets and Game Mode (macrumors.com) 23

At WWDC today, Apple announced macOS Sonoma, the latest version of its Mac operating system that includes new features like desktop widgets, aerial screensavers, a new Game mode, and enhancements to apps like Messages and Safari. MacRumors reports: The first feature that Apple detailed was new interactive widgets, which can now be placed right on your desktop. Widgets blend into your desktop wallpaper to not be obtrusive when you're working, and with Continuity you can use the same widgets from your iPhone on your Mac. macOS Sonoma also introduces enhanced video conferencing features, including Presenter Overlay to allow a user to display themselves in front of the content they are sharing. Reactions let users share how they feel within a video session, and Screen Sharing has been improved with a simplified process.

As is usual with macOS updates, Safari is getting numerous new features within Sonoma. There's an update to Private Browsing that provides greater protection from trackers and from people who might have access to the user's device. Profiles within Safari offer a way to separate browsing between topics, like having one for work and one for personal browsing. There's also a new way to create web apps that work like normal apps and let you get to your favorite website faster.

When you're not actively using macOS Sonoma, the new screen savers feature slow-motion videos of various locations worldwide. They shuffle between landscape, Earth, underwater, or cityscape themes, similar to what you'll see on tvOS. For gamers, there's a new Game Mode in macOS Sonoma that delivers an optimized gaming experience with smoother and more consistent frame rates. It dramatically lowers audio latency with AirPods and reduces input latency with game controllers, and it works with any game on Mac.
A beta version of macOS Sonoma is now available via the Apple Developer Program, with a public beta launching next month.

As Ars Technica notes, the macOS Sonoma update will only run on a couple generations of Intel Macs. "[I]f you're using anything made before 2018 or anything without an Apple T2 chip in it, you won't be able to run the new OS."
Operating Systems

Apple Announces VisionOS, the Operating System For Its Vision Pro Headset (theverge.com) 38

Apple has announced a new operating system for its Vision Pro headset. Called visionOS, the operating system has been designed from the ground up for spatial computing and will have its own App Store where people can download Vision Pro apps and compatible iPhone and iPad apps. The Verge reports: The operating system is focused on displaying digital elements on top of the real world. Apple's video showed new things like icons and windows floating over real-world spaces. The primary ways to use the headset are with your eyes, hands, and your voice. The company described how you can look at a search field and just start talking to input text, for example. Or you can pinch your fingers to select something or flick them up to scroll through a window. The Vision Pro can also display your eyes on the outside of the headset -- a feature Apple calls "EyeSight."

It seems Apple envisions this in part as a productivity device; in one demo, it showed a person looking at things like a Safari window, Messages, and Apple Music window all hovering over a table in the real world. Apple also showed a keyboard hovering in midair, too. And the Vision Pro can also connect to your Mac so you can blow up your Mac's screen within your headset. It will also be a powerful entertainment device, apparently. You can make the screen really big by pinching a corner of a window (Apple demoed this with a clip of Foundation). You can display the screen on other backgrounds, including a cinema-like space or in front of Mt. Hood (Apple's suggestion!), thanks to a feature Apple calls Environments. You'll also be able to watch 3D movies on the device. And Disney is working on content for the headset, which could be a major way for people to get on board with actually using it to watch shows and movies -- Disney Plus will be available on day one, Disney CEO Bob Iger said during the show.

Apple Vision Pro will play games, too, and support game controllers; Apple showed somebody using the device with a PS5 DualSense headset. Over 100 Apple Arcade titles will be available to play on "day one," Apple said during its keynote. The Vision Pro also has a 3D camera, so you can capture "spatial" photos and video and look at those in the headset. And panorama photos can stretch around your vision while you're wearing the device. FaceTime is getting some "spatial" improvements, too; as described in Apple's press release, "Users wearing Vision Pro during a FaceTime call are reflected as a Persona -- a digital representation of themselves created using Apple's most advanced machine learning techniques -- which reflects face and hand movements in real time."
You can learn more about Apple's first spatial computer here. A dedicated page for the Vision Pro headset is also now available on Apple.com.

Slashdot Top Deals