Here’s a summary of the latest announcements from Apple at WWDC24: Introducing Apple Intelligence, Siri enhanced with ChatGPT, the reveal of iOS 18, and a multitude of other thrilling updates.
Apple event WWDC 2024: Apple has just concluded its annual Worldwide Developers Conference keynote with a slew of major announcements. The standout revelation was its foray into artificial intelligence with Apple Intelligence. Additionally, users will now have the option to integrate OpenAI’s ChatGPT into Siri functionality, providing an enhanced experience for those who want it.
Starting Monday, Apple will roll out developer versions of its software, followed by a public preview next month. The finalized versions will be released to everyone in the fall once they are fully polished.
Siri will tap into OpenAI’s ChatGPT and will be free
Apple revealed that Siri now has the capability to leverage OpenAI’s ChatGPT as needed. The company expressed its desire for users to access external models seamlessly.
When prompted, Siri will inquire whether you wish to share your query with ChatGPT, subsequently providing suggestions from the OpenAI chatbot. Moreover, ChatGPT is integrated into systemwide writing tools. As an example, Apple highlighted the ability to craft bedtime stories for children, complemented by images generated by ChatGPT. This feature will be available at no cost and without requiring an account, with assurances from Apple that user requests and information will not be logged.
This integration is slated for release in iOS 18, iPadOS 18, and macOS Sequoia later this year. Apple also mentioned plans to incorporate additional third-party artificial intelligence models.
Apple introduces custom AI emojis called Genmoji
In Apple unveiled a novel type of personalized emojis known as Genmoji. With this feature, users can fashion their own emojis employing Apple’s artificial intelligence, particularly handy when a standard emoji doesn’t quite capture the intended expression. Moreover, users will have the ability to craft Genmojis resembling their friends.
Creating a Genmoji is straightforward; users can generate one directly within their keyboard by describing their desired emoji. Apple will then present several options for users to select from.
Apple event WWDC 2024, Apple is discussing its advancements in AI for writing.
Apple’s latest Writing Tools are now accessible across the entire system, even within third-party applications. Enhancements encompass the ability to revise existing text, adjust the tone of language, condense messages into “TLDR” summaries, and compose Smart Replies for messages.
Apple unveils significant Siri update integrating AI advancements.
Now, you have the option to interact with Siri through text, amend your statements in real-time, and enjoy a refreshed interface that seamlessly integrates with the operating system.
This new functionality is driven by Apple Intelligence, the company’s AI platform. Siri is now equipped to respond to “thousands of inquiries” regarding the operation of your Apple device, even if you’re unsure about the specific feature you’re seeking.
Siri is set to expand its capabilities by executing tasks within and across various applications, such as sharing an article from Apple News directly to a group conversation in Messages. Additionally, third-party apps will gain access to some of Siri’s upgraded features.
Furthermore, Siri will harness the “personal context” functionality previously highlighted by Apple, enabling it to access a wider range of information and data stored on your device. For instance, it will be able to search through your entire device, allowing you to ask queries like “show me items I sent to Todd last week.”
Apple unveils its AI initiative, Apple Intelligence.
Apple has finally unveiled its much-anticipated artificial intelligence endeavor, Apple Intelligence, during which CEO Tim Cook stressed the importance of privacy and personalization, transitioning from “artificial intelligence” to “personal intelligence.”
Craig Federighi, from Apple, highlighted that the generative models powering Apple Intelligence would be accessible across iOS, iPadOS, and macOS, offering a range of capabilities:
Contextual notifications:
Apple Intelligence can discern which notifications hold significance based on your personal context.
Writing enhancements:
Systemwide proofreading and style enhancements will be introduced by Apple Intelligence across both third-party and native applications.
Image generation:
Apple Intelligence is capable of generating photos based on your photo library, presenting three distinct styles: Sketch, Illustration, and Animation.
Cross-app task management:
Apple Intelligence can navigate through your applications and perform tasks on your behalf. One example cited by Federighi involved requesting Apple Intelligence to retrieve files sent by a contact within a specific timeframe.
Focus on personal context:
Apple Intelligence can leverage your entire activity suite as well as the content displayed on your screen. For instance, you can inquire whether a rescheduled meeting would potentially result in tardiness for a personal commitment.
Private Cloud Compute:
Utilizing cloud-based models on dedicated servers featuring Apple Silicon, Apple Intelligence ensures user data remains private and secure. If a request necessitates accessing a cloud server, Apple asserts that only a limited selection of data will be transmitted in a “cryptographically” secure manner.
Federighi emphasized Apple’s unwavering commitment to privacy, highlighting Apple Intelligence as a fusion of highly proficient large language and diffusion models, coupled with an on-device semantic index. This system operates seamlessly across applications, identifying data and supplying it to the models.
A majority of these models will operate on the device itself. For those requiring cloud storage, Federighi emphasized Apple’s capability to empower users with control over the type of data stored in the cloud and its accessibility.
“We aim to extend the privacy and security standards of your iPhone into the cloud,” Federighi stated.
Apple announces Passwords app
Apple unveiled a new Passwords app for iPhone, iPad, Vision Pro, Mac, and Windows. This app serves as a centralized hub for storing various types of passwords, including verification codes, app passwords, Wi-Fi passwords, shared passwords, Passkeys, and more. Users can conveniently manage their passwords within the app, assess their strength, and organize them effectively. The Passwords app bears similarities to 1Password in its functionality.
Apple announces macOS Sequoia, some AI enhancements
Here’s what’s new in macOS Sequoia. Developer betas roll out today, public betas roll out next month and the full OS will release in the fall.
Continued enhancements from iPadOS and iOS:
New features, including text animations and Maps improvements, will also be on macOS.
iPhone mirroring:
Users can now see and control their iPhone from their Mac via Continuity. iPhones will remain locked even if in a virtual session. StandBy will also remain visually undisrupted.
Unified Notification Center:
iPhone notifications will now appear on macOS.
New Passwords app:
Apple is breaking out its iCloud-powered Keychain feature into a discrete app, competing directly with 1Password and other password managers. It will also be available on Windows.
Video enhancements:
MacOS will now offer further enhancements to video calls, including background features and screen isolation.
Safari enhancements:
Safari now has artificial intelligence-powered highlights to extract helpful information from a webpage.
Apple announces iPadOS 18
Interface improvements:
iPadOS 18 introduces a floating tab bar and automatic sidebars, maximizing screen utilization.
SharePlay enhancements:
Users gain control over SharePlay sessions.
Calculator on iPad:
Apple debuts a native Calculator app for iPad, complete with support for unit conversions. When paired with the Apple Pencil, users unlock Math Notes, allowing handwritten problem-solving.
Math Notes for Calculator:
Utilizing the Apple Pencil, users can automatically solve handwritten problems, with support for scientific calculator functions.
Notes:
The native app introduces Smart Script, leveraging on-device machine learning to tidy up handwriting. Additionally, users can seamlessly convert typed words into handwritten text during a session.
Apple announces watchOS 11 for Apple Watch
Training mode:
Introducing a new training mode in watchOS, tracking workout intensity and duration’s impact on the body over time. Utilizing calorimetry data like heart rate, pace, and elevation, a sophisticated algorithm translates power sensor data into post-workout effort ratings automatically.
Customize the summary tab:
Users can tailor their summary tab with preferred information, such as weekly running distance.
New Vitals app:
watchOS 11 introduces the Vitals app, monitoring metrics like heart rate, respiratory rate, and risk temperature, providing insights. Users can easily monitor vitals and receive alerts when multiple metrics deviate from normal ranges. Insights on how vitals respond to factors like alcohol, illness, and elevation changes are also provided.
Tools for pregnant users:
Enhanced cycle tracking now includes gestational aids, while the Health app displays pregnancy progress across various charts and prompts.
Ring adjustments:
Users now have the flexibility to adjust activity goals by days of the week, with the option to pause activity rings for short breaks.
Photos for watch faces:
Leveraging artificial intelligence, watchOS identifies suitable photos for watch face backgrounds.
Apple unveils updates for AirPods alongside new features for tvOS.
Apple unveiled enhancements to its Audio products and Home platform. Here’s what’s new:
AirPods Updates:
Siri Integration:
AirPods now feature Siri integration, allowing users to answer or reject phone calls with head motions (nodding to answer, shaking head to reject).
Voice Isolation:
AirPods Pro now offers enhanced voice isolation capabilities, effectively isolating the user’s voice even in noisy environments.
New Features on tvOS:
Insight:
A novel feature providing information about current TV content, accessible on both the TV and iPhone.
Audio Enhancements:
Apple TVs now boast improved audio enhancements, including isolation of spoken audio and optimized subtitle timing.
Projector Support:
Apple TVs now support 21 x 9 projectors for enhanced display options.
New Screensavers:
Users can enjoy Apple TV screensavers featuring Portrait photos and select their preferred screensavers.
Apple announces iOS 18
Apple unveiled iOS 18 with an array of personalization features. Here’s a rundown of what’s new:
Home Screen Customizations:
Users can now rearrange apps, adjust colors, and tweak app darkness for a personalized home screen experience. Apps can be arranged around background photos to prevent covering them up.
Redesigned Control Center:
The Control Center receives a fresh look with grouped controls for easier access. Developers can integrate app controls through the introduction of a controls API.
Privacy Enhancements:
Users gain the ability to lock apps for added security, controlling access to information without authentication. Additionally, users can manage which contacts are accessible to various apps.
Enhanced Messages Functionality:
Users can now add new effects to their texts and react with fresh emojis.
Satellite Messaging:
iMessage and SMS messages can now be sent via satellite.
Mail App Filters:
Users will soon be able to filter emails by categories, enhancing email organization.
Tap to Cash:
A convenient and private method to pay another person by simply holding phones together.
Enhanced Event Tickets:
iOS 18 introduces a revamped event guide and support features like venue maps for easier navigation to seats.
Gaming Improvements:
Gaming on iOS 18 optimizes background activity, supports wireless controllers, and enhances compatibility with AirPods.
Photos:
It will be easier for users to search through their photos. The grid will appear at the top, and a theme, such as time, people or trips, is displayed below. A new filter button shows specific types of content so you can, for example, filter out screenshots.
Apple announces VisionOS 2
During Apple’s announcement, Vice President Mike Rockwell introduced the latest iteration of Apple’s OS for Vision Pro, VisionOS 2, marking its release four months after the initial launch of VisionOS. Rockwell also highlighted the availability of 2,000 apps compatible with Vision Pro.
Vision Pro will expand its availability to China, Japan, and Singapore starting June 28, with further rollout to Australia, Canada, France, Germany, and the U.K. scheduled for July 12.
Key updates in VisionOS 2 include:
Photos:
VisionOS 2 utilizes artificial intelligence to convert standard photos into Spatial photos compatible with Vision Pro.
New Gestures:
VisionOS 2 introduces intuitive gesture-driven controls.
Ultrawide Display:
Vision Pro now supports an ultrawide display equivalent to two side-by-side 4K monitors.
Train Support for Travel Mode:
Apple enhances its Travel Mode by adding support for trains, expanding beyond its previous airplane-only support.