WWDC 2024: What Apple will surprise this time around

Apple has been making a lot of moves lately, announcing a number of new features for its devices at the beginning of this week. However, many of these features are already available on Apple devices to some degree through third-party apps. So, as in years past, here are some of the ideas that Apple "tossed" into this year's update.

Apple Intelligence

The company has since identified several characteristics of its approach to generative AI. Many established companies in the field take a "bigger is better" approach to modeling. Rather than overwhelming users with AI features, the Cupertino-based tech giant tries to implement them where they are useful. This means that when it comes to using Apple devices, it's not introducing technology where it could pose a significant threat to a carefully crafted consumer experience.

Highlights of the new version of the operating system include extensive personalization options, including placing apps and widgets on the home screen and customizing buttons. Other features include new text effects, the ability to block and hide apps, a new way to manage incoming messages, the introduction of satellite iMessages and an update to the Photos app.  

Apple is working with partners

Craig Federighi confirmed during Apple's presentation after the VP keynote that the company will work with third-party models outside of OpenAI, citing Google's Gemini model as an example. He added that Apple "can't announce anything yet, but that's the general direction we're going."

Tesla, SpaceX and xAI CEO Elon Musk continues to campaign against OpenAI's competitor, threatening to ban Apple devices from his company "if Apple integrates OpenAI at the operating system level."

Availability of Apple Intelligence

Before you get enthusiastic about testing Apple Intelligence, make sure your device is new enough: Only the iPhone 15 Pro and 15 Pro Max, as well as iPads and Macs with an M1 chip or later, can support Apple's new AI evolution features. Apple is also integrating ChatGPT, a chatbot based on OpenAI's GPT-4 model and other generative AI models, into Siri and other Apple apps.

One of the "Apple Intelligence" features in iOS 18 allows iPhone users to create images of message recipients using artificial intelligence that works similarly to Bitmoji's augmented AI. Of course, it's designed to make your "everyday conversations more interesting." Apple's smart system understands who you're messaging, so if you want to personalize your chats with personalized European images, it can create them instantly.

Apple TV+

Apple TV+ users will be able to take advantage of a new feature called InSight. It allows viewers to recognize the names of actors and songs on the screen. According to Lauren Forristal, the feature is similar to Amazon's X-Ray technology, which allows Fire TV users to view actor biographies and behind-the-scenes information while watching TV shows and movies. What sets InSight apart, however, is its Shazam feature, which highlights songs played while watching a TV show or movie and adds them to an Apple Music playlist for later listening.

Apple has also made improvements to its Siri intelligent assistant. Specifically, generative AI features have been added to make Siri more natural and personalized. In addition, a new indicator has been added. In addition, Siri now responds to hesitations in conversation and better understands context. In addition, users who prefer text input can now type.

Apple Intelligence knows you

Apple Intelligence (AI): The company promises that this feature is based on a secure and highly personalized experience. First and foremost, it needs to know you and take into account your personal context - your daily life, your relationships, your communications, CEO Tim Cook said at WWDC on Monday. Of course, from the beginning, it should have been designed with your privacy in mind. Of course, from the beginning, it should have been designed with your privacy in mind. This is personal intelligence and the next big thing for Apple.

It's for the general public, but WWDC is a developer conference and Apple has already revealed how developers will soon be integrating Apple Intelligence into their software. A number of artificial intelligence features will be added to existing SDKs, allowing developers to generate images and new prompts for Siri, expanding the scope of Apple Intelligence.

List of new features

• Password app: You can already use your iCloud account to store passwords and synchronize them across all your devices, but finding them has never been easier. Apple just launched the Passwords app. There's a new column on the left side that makes it easier to browse your password collection. For example, you can view all your passwords, Wi-Fi passwords (recently added), or keys and passwords not related to websites or services.
• Smart Scripts for iPad: The new Smart Script feature cleans up your handwriting when you write notes with the Apple Pencil. Apple claims this feature makes writing notes smoother and more correct. The feature improves the appearance of your notes by using the device's machine learning capabilities to reconstruct your handwriting from your notes. Your own handwriting will become smoother and clearer. Click here for more information.
• Calculator for iPad: The classic calculator for iOS is finally on the big screen. It makes the most of the extra screen area and offers new features that the company failed to include on the iPhone. There's no bigger news than the addition of the new Math Notes feature. This additional feature can do the math for you.
• Satellite Information: This new feature works on the same principle as Apple's SOS emergency call feature. If there's no signal, you'll be prompted to find a satellite to send data from. You'll need to keep your phone pointed in the right direction, but a deflection message will remind you to do so.
• Apple Photos: Apple has released a new Photos app that will be included in the next version of iOS. The new app features new navigation, organization, and other options to help you find your favorite photos of friends, family, pets, and travel. The new design saves you time searching for photos because everything you need is at your fingertips. One of the major changes is the consolidation of the app into a single view, where the photo grid is at the top and libraries organized by topic are at the bottom.
• Tap to Cache: One of the most interesting additions is Tap to Cash, a feature that lives up to its name by allowing you to pay for purchases using two iPhones. As Brian Hayter writes, the feature is an extension of Apple Pay's long-standing "tap to pay" feature. In addition, the new feature appears to take advantage of the device's NFC capabilities. Apple claims that the feature allows you to send money without transferring personal data.

iOS 18

You can now lock apps when you give your phone to someone to look at a photo or play a game. With App Lock, if someone tries to touch your phone, you'll have to authenticate it with Face ID, Touch ID, or a passcode. With App Lock enabled, your app information doesn't show up anywhere else, such as in search or notifications.

Apple also shared details about the next major release of iOS, the operating system designed for the iPhone. Unsurprisingly, much of the information has to do with artificial intelligence. Remember when icons were tied to a grid? Now you can place icons on your homescreen however you want, as long as they don't obscure the background photo. iOS 18 is an important release that gives you even more ways to personalize your iPhone, stay connected, and relive special moments," said Craig Federighi, Apple's vice president of software engineering.

When it comes to icons, most of the updates are welcome features, such as the ability to place app icons and widgets anywhere on the home screen and support for dark mode icons in a variety of color combinations.

VisionOS 2

VisionOS 2 will feature improved performance and "exciting new features". One such feature is "spatial" editing of regular photos using artificial intelligence technology. Another is a new navigation feature that will allow VisionOS 2 users to tap on the homescreen or flip the palm of their hand to display the Control Center, which includes notifications, shortcuts and more.

One of the main features is the ability to convert existing images into spatial photos. This new feature uses machine learning to create additional angles, which is much different from the traditional method of taking photos with the iPhone 15 Pro or the Vision Pro itself.

Practical rather than flashy AI

Apple lags behind its peers when it comes to artificial intelligence, so the company may feel compelled to do everything it can to impress fans and shareholders. But that doesn't mean promising too much.

There are rumors that the company has shifted many of its employees to work with generative AI after the electric car fiasco, but all indications are that Apple is far ahead in this area. So the most logical choice would be to partner with an authority like OpenAI.