Tech

What to expect from Apple’s AI-powered iOS 18

Apple’s Worldwide Developers Conference next week promises to be a pivotal moment in the iPhone maker’s history. The Cupertino tech giant will present how it has chosen to integrate AI technology into its devices and software, including through a historic partnership with OpenAI. As the big event approaches, all sorts of leaks have emerged about what iOS 18 and its AI-powered apps and features have in store for us.

Among the changes, Apple would power some of its new AI features with its Ajax LLM. Other reports indicate that Apple is considering processing AI data in a way that even employees won’t be able to access, which would help Apple continue to deliver on its promise of data privacy for its users.

Below, we’ll take a look at how Apple would add AI to its apps and services in the next big update for the iPhone, as well as other improvements and changes coming to iOS 18.

The future of Siri thanks to AI

  • Apple’s digital assistant is ready to get an AI overhaul. The digital assistant will leverage Apple’s large language models and allow Siri to control individual features within apps. This will work without any configuration needed from developers or users, as currently required by app intents or Siri Shortcuts. Instead, users will be able to ask Siri to do things like delete an email or edit a photo, for example.
  • Some of Siri’s improved AI capabilities won’t be ready until next year, however. For example, Siri’s ability to handle multi-step tasks is likely delayed.
  • A more advanced Siri will also be available on Apple Watch for use on the go. You can use Siri on your watch to play music on another device, according to a report.
  • Siri will receive more natural voices.
  • Siri will be able to summarize notifications including people, businesses, calendar events, locations, dates and more.
  • Could Siri’s new look be hinted at in the animations below?

The new look of Apple Photos

  • A new interface is being teased.
  • People will also have the ability to edit photos with AI, which could challenge Google Photos in this area.
  • A “Clean” feature, for example, would allow you to remove objects from your photos using generative AI technology, similar to Google’s Magic Eraser.
  • A report states that Apple has created an internal-only app called Generative Playground that uses genAI to create and edit images. It’s unclear how this feature will be presented to end users, although iMessage integration has been spotted in the form of an app extension.

Safari with more AI

Notes injected with AI

  • Users will be able to request AI summaries of grades.
  • GenAI will also help transcribe audio into Notes.
  • In-app audio recording will be supported alongside audio transcription and AI summary.
  • Math Notes will help users create graphs and solve equations with AI by recognizing the text of math equations and then helping you solve them.
  • Notes users may also have the option to automatically complete their math equations as they type.
  • Project Greymatter is the codename for a set of in-kernel AI tools like Safari, Photos and Notes, Bloomberg reported.

Voice memo transcriptions

iMessages gets a makeover with AI

  • AI generative emojis will be supported, allowing users to create their own emojis using the technology.
  • AI recaps of missed texts will also be available.
  • Overall, deeper Siri integration is expected.
  • Tapbacks will receive new icons.
  • Message effects for individual words will be supported in addition to effects for the message itself.
  • The messages will offer suggested answers generated by Ajax LLM on the Apple device to make it easier to respond via SMS.
  • RCS support is also supported this year to bring reading recipes, typing indicators as well as high-quality videos and images when texting with Android users via iMessage.

Calendar update

  • Apple’s LLM will be able to communicate with the Calendar app to check events when writing responses to messages.

Mail with AI support

New settings interface

  • We hope settings will become less confusing with a revamped interface and updates including better organization and improved search.

Control Center Updates

  • A new Music widget will be available – possibly to feature larger artwork?
  • HomeKit improvements for smart home integrations.

Notifications

Projector

Home screen updates

  • iOS 18 will offer the ability to place app icons wherever you want, instead of having to align them to the grid with no space between them.
  • Users will also be able to change the color of app icons, perhaps as Apple’s answer to Google’s Material You.

Maps with route creation

Music with AI-powered playlists

More improvements

Other apps with planned updates include Freeform, Xcode, and Apple’s productivity apps, like Keynote and Pages, which may benefit from genAI features.

techcrunch

Back to top button