Apple WWDC super summary: GPT-4o joins iOS 18, Vision Pro is confirmed in China, starting from 29,999!

If it weren’t for the final stage of this WWDC24 (Apple Worldwide Developers Conference), where Apple redefined AI and replaced “Artificial Intelligence” with “Apple Intelligence”, then the highlight of Apple’s annual event would have become “The iPad finally has an Calculator App” is an April Fool’s Day joke level update.

But fortunately, Apple's "homophonic stalk" can withstand scrutiny and consideration. There is no "changing the world", no "changing the sky overnight", and no "humanity is a total failure". Apple's AI will not make you unemployed or make you anxious, it just wants to make your iPhone, iPad and Mac more usable. smarter.

Of course, there will be a little anxiety. After all, only the latest devices will have a better Apple AI experience, but the latest devices also have the most expensive prices.

So, what is the difference between Fruity AI?

Before looking at Apple smart phones, as a carbon-based creature, we have summarized the key points of iOS 18 updates as usual. We will take you through the system upgrades first, and then welcome the prelude to the silicon-based era:

  • Desktop: Customizable sorting and unified desktop colors
  • Control Center: More control options can be added
  • Lock screen interface: flashlight and camera can be replaced with other functions
  • Privacy: Launch of “App Lock”
  • iMessage: Customization options for font styles and emoticons have been added, and you can set them to be sent later.
  • Mail: Automatically organize and categorize
  • Map: new topographic map
  • Wallet: tap to cash function, two new Apple pay payment methods
  • Notes: Search function to find content from past notes
  • Game Mode: Coming to iPhone soon
  • Photos: Introducing the smart function "Selected Collection" to classify and search photos more accurately

Apple intelligence, Apple AI’s answer sheet

This is personal intelligence and Apple’s next big move.

Apple has high expectations for Apple Intelligence, which they call a new personal intelligence system that integrates generative models into iPhones, iPads and Apple computers.

Note that the important point here is that Apple Smart is a system-level product rather than a function or service. This means that its strategic position is completely different and is not on the same level as Siri or Apple Music.

Officially, the system leverages advanced artificial intelligence and machine learning to enhance the user experience by understanding personal context, prioritizing notifications, providing smart writing tools, creating custom images, and automating actions across apps.

To put it simply, your iPhone, iPad and Mac are really smart and can actively think and understand users. Yes, my previous thoughts were all false.

Before talking about specific functions, Apple smart phone is Apple’s product after all, so it naturally has traditional entertainment capabilities. Let’s talk about the two biggest highlights first:

  • privacy protection
  • Seamless operation between Apple devices

At Apple, our goal has always been to design powerful personal products that enrich people's lives by making it as simple and easy as possible for them to do the things that matter most.

Apple intelligence built into iPhone, iPad, and Mac makes it easy to complete tasks such as writing, notification management, and self-expression.

Apple intelligence will enable your iPhone, iPad and Mac to understand and create language and images, using the simplest interaction methods to complete more complex command tasks.

The smart writing tool in it can proofread text and rewrite different versions until the tone and wording are just right. In any scenario that requires writing, you can use it to find the right wording, such as being friendlier or more professional.

But when you don't want to be friendly or professional, you can also customize your writing style, such as "write like a poem", and Apple Smart will write the poem in one step.

With the enhanced language function, users can summarize the content of the entire lecture/meeting/speech in a few seconds and obtain a condensed version of the longer group discussion. Be familiar with it. This function is not only available on Apple, but also on ChatGPT. In fact, Feishu, There are AI tools such as WPS and Kimi, and they have functions that everyone knows.

Of course, the advantage of being integrated at the system level is that this writing tool can be used on almost any interface that requires text creation, including third-party applications. This is the inherent advantage of being born in the Apple family.

Large language models built into Apple Intelligence provide deep natural language understanding to help you automatically manage message notifications.

For example, iPhone can prioritize important notifications and reduce the distraction of non-urgent messages, while ensuring you don’t miss something important.

This echoes what was said before, the device really knows how to think this time.

With a little thought, the phone prioritizes notifications at the top of the stack, making the most important things visible at first glance. Notifications are also aggregated in real time so users can browse faster.

Prioritize messages in email, which puts messages with higher time priority at the top of your inbox, such as an invitation due today or a check-in reminder for this afternoon's flight.

With Apple Smart, you can display a summary of a long email in the Mail app, get straight to the point, and see important information points at a glance.

In addition to playing with text, Apple smart phones also support the text drawing function to make the iMessage conversation process more interesting.

For example, when you wish a friend a happy birthday, you can create an image greeting card based on the friend's image surrounded by cakes, balloons and flowers to make the atmosphere more festive.

Of course, to be honest, Apple’s smart graphics are not very good, and your friends may not feel happy when they see them.

Currently, during the conversation, this function supports the generation of pictures in three styles: hand-drawn, illustration, and animation, and this function is built into all apps in the entire system, such as Memo, Boundless Notes, etc.

If the above-mentioned Apple smart performance can only be said to be hovering near the passing line, which is better than nothing, Apple’s real strength lies below.

Apple intelligence simplifies the experience across multiple apps.

Whether it’s calling up a file a coworker shared last week or playing a blog post my wife shared the other day, Apple intelligence orchestrates these and hundreds of other actions to help users get more done while dramatically improving efficiency.

In addition, an important part of Apple intelligence is the understanding of personal situations.

Apple Intelligence is based on personal information and usage context, and can retrieve and analyze relevant data in applications and reference content on the screen, such as emails being viewed or calendar events.

Apple gave us this example at WWDC24: Let's say one of my meetings is rescheduled to late afternoon, and I want to know if this will affect my ability to make it to my daughter's show on time.

At this time, Apple smart can come in handy. It knows: who my daughter is, the details of the show she sent a few days ago, the time and location of my meeting, and the estimated duration of the trip between my office and the theater.

This scenario explains very well why Apple Smart is a system, and why it truly has the ability to understand users, because it connects many different application data of users, knows the logic of combining these data, and derives Users' problems and needs, and solutions are given.

Ai Faner and APPSO believe that this is the real power of Apple’s intelligence, and it is also something that other mobile phone AIs cannot match.

But problems arise. After all, it would be a bit scary to hand over all the details of life to someone else's AI cloud for storage and analysis. Therefore, Apple believes that "powerful intelligence and powerful privacy should go hand in hand."

First of all, the core of the personal intelligence system is actually the processing power on the device. Apple said that its Apple intelligence has been integrated into iPhone, iPad and Mac as well as applications, allowing it to "understand personal data without collecting personal data." .

Thanks to Apple's unique hardware and software systems built into the chip, the device provides the processing power needed to deeply integrate deep and large models.

In other words, A17 Pro and Apple's M series chips provide the basis of computing power for Apple's smart phones.

In other words, other models may not be able to benefit from Apple smart phones.

According to Apple, when a user makes a request, Apple Intelligence will use its semantic index to identify relevant personal data and, combined with the context of use, provide it to the corresponding model to handle the task.

Usually, if we want to use larger models, we have to turn to cloud servers. But the problem is that these servers may store data without our knowledge, and even if a company claims that they will not mess with your data, it is actually difficult for us as users to verify this.

However, this problem may not occur on Apple smartphones. Apple says that when you use an Apple device like an iPhone, you control where your data is stored and who can access it.

Apple also wants to extend the privacy and security of iPhone to the cloud, while also providing good AI services. This is private cloud computing.

When a user makes a request, Apple's smartphone will first see if it can be processed on the device.

If more computing power is needed, private cloud computing will be used to send only task-related data and then process it on the Apple chip server so that your data will not be stored or monopolized by Apple.

Apple also said that private cloud computing encryption ensures that iPhones, iPads and Macs cannot communicate with servers without software being publicly recorded and inspected, which sets a new standard for AI privacy protection.

When others consider whether AI is useful, Apple will give priority to whether AI is safe or not.

With the big model on the phone, your Siri becomes smarter

Siri has been groping for thirteen years on the road to becoming "smart", but it is not until today that we have witnessed the return of its original intention.

The emergence of GPT-4o rewrote the history of human-computer interaction overnight, directly overturning all voice assistants.

Apple takes a look at this momentum and thinks, if you can’t beat it, join in. With the support of Apple’s smart phone, Siri on your phone will not only become smarter, but your fluent conversational ability will also usher in a qualitative leap.

For example, if you want to go to the beach on the weekend but don't know what the local weather is like, you can just ask Siri to get the answer you want. Judging from the demonstration effect, this method of communication is like chatting with your weather assistant, which is both convenient and comfortable.

In addition, Siri supports switching between text and voice at will. For example, you can easily call Siri by typing at the bottom of the screen.

During the communication process, AI+ Siri has stronger contextual understanding capabilities, and its ability to understand personal situations has also been greatly improved.

For example, when you want to pick someone up at the airport, the new version of Siri can help you plan a route and help you book a restaurant in advance based on information from your usual chat content.

At the press conference, Apple also officially announced its cooperation with OpenAI.

In the future, ChatGPT will be integrated into Siri and integrated into system-wide writing tools. Users do not need to register an account. You can use this feature directly for free.

ChatGPT paid subscribers can connect their accounts directly in these operating systems and enjoy convenient access to paid features.

Aifaner and APPSO also saw OpenAI CEO Sam Altman at the Apple conference. However, Altman did not appear in the pre-recorded conference video.

He said on social platform

Siri's original intention is to make life simpler, but in the past we often needed to spend more time teaching Siri how to understand our questions.

We hope that after the new version of Siri is officially launched, it can truly become what Apple's marketing director Phil Schiller described – an intelligent assistant that can help you get things done through voice commands.

It can be said that the combination of iOS 18 and ChatGPT is a long-awaited win for everyone, and it is also a big step to save Siri. It is precisely because of the addition of Apple Smart and ChatGPT that we can have iPhone, iPad and Mac in our hands. It is not an exaggeration to say that it is an epic update to be reborn.

Is iOS being taken over by AI? There is no fanfare, but it has penetrated deeply into your and my lives.

iOS 18 also has some new ideas for some system-level applications.

The mail function on iOS 18 can control and manage incoming emails through device classification. The classification function can block the user's new messages and help all personal accounts keep the latest message status without missing any important information. .

Among them, the messages in the "main category" allow users to focus on the most important things. The information in this category mainly comes from emails from acquaintances and friends and more urgent information.

The rest will be listed as "new categories," such as receipts and order confirmation transactions, newsletter updates, social media notifications, and promotions in marketing and sales messages.

Mail for iOS 18 also creates a new summary view that brings together all relevant emails users receive from businesses, making it easier to interact with these similar messages. We can get all related messages in the same interface, view content related to these contents.

Apple's official Maps App has added a new terrain map on iOS 18.

There are many new details in the topographical maps, including detailed trail networks and hiking routes, and these new map information can be saved on mobile phones for offline access.

Users can also use continuous intelligent voice prompts and create their own hiking routes, which can still be used normally in an environment without network.

The update of the wallet app focuses on convenience.

Apple said at the press conference that they will launch a fast and private way to pay, called "Tap to Cash", which will allow you to pay face-to-face without sharing your phone number or email address.

Users only need to put their phones together to make a successful payment.

Judging from the demonstration video of the press conference, this is a fast private-to-private transfer method. The animation interaction during transfer is very high-quality, very similar to the animation effect of AirDrop on iOS 17.

In addition, Apple said it is currently adding two new online Apple Pay methods to allow customers around the world to redeem rewards from banks and card providers.

For example, the event ticket function has new functions and designs. Based on the ticket information, users will be able to see various information related to the performance venue on their mobile phones. Through intelligent recommendations, performance-related apps will also appear in the recommendations.

The Internet celebrity application "Notes" some time ago has also been updated. Now Notes can record the user's daily mood, and helps users track related matters by displaying insights views of personal calendars, arrangements and other statistical data.

The update of "Game Mode" can improve the gaming experience for game enthusiasts. According to Apple, it is "bringing an immersive" experience.

When Game Mode is now turned on, the device will minimize background activity, maximizing game frame rates and improving the responsiveness of AirPods and game controllers.

Apple added a similar game mode to macOS Sonoma last year. This feature is now introduced on iOS. It actually allows more players to join the Apple Gaming ecosystem through the improvement of the gaming experience.

Take photos and albums:

For many people, photo albums are the best way to preserve memories.

iOS 18 provides us with a new photo album interface. We can directly swipe to select the date of the photo, quickly narrow the range, and even intelligently filter out screenshots to find the photos we want, keeping the ever-increasing gallery neatly organized.

In the photo album app, you can also customize character groups and classify them according to travel information. It supports dynamic posters and other forms to display photos, allowing us to recall the moment when we took pictures with one click, and we can also share the entire "selected collection" at once.

AI updates for iMessages:

In recent years, almost every generation of iOS updates has brought new iMessage features, and iOS 18 is expected to be no exception.

In addition to AI suggested replies, iMessage will also support adding animation effects to single words. Previously, iMessage has been able to add animation effects such as full screen, laser light, confetti, etc. to the entire conversation bubble. Users can now use the new function to create their own expressions symbol.

In addition, the new messaging feature will provide suggested replies generated by Ajax LLM on Apple devices, which is equivalent to having an intelligent assistant to help you handle trivial matters.

Safari

Although Safari was criticized when it was first launched, it has gradually become more and more usable in subsequent updates.

The addition of AI has added a function called Reader to Safari, which can summarize the content and help us grasp the core content of the article faster, which is a bit like "quantum speed reading".

In addition, page tools are integrated in the address bar. Users can listen to the blog directly with just one click, which is similar to some convenient plug-in functions.

app lock

Privacy is the most important issue in life today, and App Lock is another important update for privacy protection in iOS 18.

iOS 18 now supports locking or hiding an App. Users must use Face ID passwords and other methods when unlocking, thereby further enhancing privacy protection capabilities.

In the past, apps would ask for permission to search your contacts, but iOS 18 returns more control over this permission to the user.

User interface and control center

In addition to the upgrade of AI functions, iOS 18 will also make major improvements in the user interface and interactive experience.

iOS 18 can arrange App icons freely without being restricted by the current fixed grid layout. At the same time, iOS18 also further opens up custom app styles, adds a dark mode, and supports changing the color of app icons.

For example, iOS 18 can recommend suitable colors to match wallpapers to help users create the look they want, making the home screen truly belong to the user.

iOS 18 not only gives the overall interface a brand new feel, but also redesigns the control center.

In addition to the multi-page layout of the control center, third-party developers can provide more creative components.

The control center adds more control options, and users can freely adjust the layout and size of the options, making the categorized layout more organized.

In addition, users can also customize the applications displayed on the lock screen. For example, the camera and flashlight can be replaced with other control functions.

iPadOS

Like iOS 18, iPadOS 18 also supports custom screens and allows users to set application icons arbitrarily.

In the Control Center, iPadOS 18 also supports the creation of multiple lists and views, which can be arranged however you want.

14 years after its introduction, the iPad finally has a built-in calculator, which can be used with Apple Pencil to perform handwriting calculations in one go.

At the same time, Apple also launched Smart Script, which not only uses machine learning to make your handwriting look more beautiful, but can also imitate your handwriting style and even automatically check spelling.

macOS

The latest release of macOS 15 is called Sequoia. Craig Federighi, Apple’s senior vice president of software engineering, described it this way:

The combination of powerful Apple silicon and the ease-of-use of macOS makes Mac devices more powerful than ever.

However, after seeing the new features, many viewers unanimously thought of distant competitors and believed that synchronized mirroring and split-screen functions were very similar to those of other manufacturers.

The new iPhone mirroring function supports wireless mirroring of iPhone screen to Mac, and we can fully control iPhone directly from Mac.

Not only will wallpapers and icons be displayed simultaneously, we can also slide to switch pages, open and browse all applications directly on the Mac home screen. Of course, the keyboard and trackpad can also interact together, and even iPhone audio can be played on Mac, and file drag and drop transfer is also very intuitive.

Another very practical feature is the intelligent multi-window management function. We only need to drag the window to the edge of the screen, and the window will automatically adsorb and resize, simplifying the layout and management of the workspace.

For gamers, Mac is often the first option to be eliminated, and Apple has also made a lot of efforts to bid farewell to the title of "cannot game".

This time, its game development kit Game Porting Toolkit will be updated to version 2.0. With the support of Xcode, the game process will be further simplified. I believe we can see more games on Mac in the near future.

But in fact, as we mentioned earlier, Apple's advantage lies in opening up users' many different application data and combining the data as needed. The advantages of this intelligent system that connects applications are reflected in "convenience" in life scenarios and "efficiency" in work scenarios. This may be the true meaning of Apple’s intelligence being “smarter” than AI.

Apple Vision Pro

Apple announced at a press conference today that Vision Pro will be available in new countries and regions. Users in mainland China, Hong Kong, Japan and Singapore can start testing Apple Vision Pro at 9 a.m. (Beijing time) on Friday, June 14. The Pro is available for pre-order and will be officially released on Friday, June 28th.

Prices start at ¥29,999 and are available in 256GB, 512GB and 1TB storage capacity options.

Also released with the Bank of China, visionOS 2, based on the first-generation system, plays with the concept of spatial computing more thoroughly.

First, Vision Pro can use an ordinary 2D photo to generate a spatial image with a sense of depth, and it can be shared with family and friends online.

Second, the spatial gestures are more comprehensive. You can open the home screen by raising your hand and tapping with two fingers. You can open the control center by flipping your palm and tapping with two fingers.

In addition, the Mac's virtual screen has also been optimized and upgraded. Now the screen projected in Vision Pro not only has a higher resolution, but can also choose from three sizes, and can even become a surround ultrawide screen, which is equivalent to two 4K monitors side by side. Place.

There are more application scenarios and more comprehensive "spatial functions". Although the price is still far away from us, Vision Pro has successfully brought the concept of "spatial computing" into our lives.

However, many people who stay up late to watch WWDC24 will have a "sense of division". On the one hand, the updates to iOS18 and other systems are patchwork and icing on the cake. There are no real Amazing updates. Some "dessert-level" updates are just for people to think about. My heart smiles.

Today, the problem of mobile phone systems is not that there are too few functions, but that there are too many functions. System updates have almost reached a dead end. Only Apple has strong appeal. People will also care about what iOS updates. Apart from Coolan, Android updates next door. Apart from users, almost no one cares.

At this time, AI has become an unparalleled hero in people's imagination, wearing golden armor and stepping on auspicious clouds. Everyone's favorite system should be the Zenith Star technology carrier that is omnipotent, wise and near-demon, and is excellent in calligraphy and painting. However, Apple still brings us back to reality:

Wake up, the best AI device in 2024 will still be a mobile phone, and the best AI mobile phone in 2024 will be the iPhone.

Author: Liu Xuewen, Xiao Fanbo, Wang Meng, Mo Chongyu

# Welcome to follow the official WeChat public account of Aifaner: Aifaner (WeChat ID: ifanr). More exciting content will be provided to you as soon as possible.

Ai Faner | Original link · View comments · Sina Weibo