In the era of generative AI, this Snapdragon new generation flagship chip has new tasks

Imagine when a mobile phone is no longer just a tool for making calls and surfing the Internet, but becomes a versatile intelligent terminal in the AI ​​era: it can be your personal intelligent assistant, an imaging workstation, an AI drawing board, or a simultaneous interpreter. official.

It sounds ideal, but this future is actually not far away. When you take a look at the many new flagship phones launched this year, you will find that AI functions have long been integrated into them and become standard small functions.

Starting in 2023, major mobile phone manufacturers have been working hard in the field of AI, trying to seize the future commanding heights of "AI terminals", mobile products. However, the source of this change actually starts with the underlying innovation led by chip manufacturers. As the driving force behind this change, Qualcomm has already begun to move from "mobile phone chips" to "smart terminal chips" and starts from the design of the underlying architecture to provide powerful AI computing power for flagship mobile phones.

Today, the Snapdragon 8 series has successfully helped many manufacturers deploy large end-to-end models on flagship phones, making AI phones no longer just in the conceptual stage. But this time, they plan to go one step further.

The continued evolution of the Snapdragon 8 series allows mobile phone manufacturers to quickly enter the AI ​​era

The wave of new Android mobile phones in the past half year can be said to be very lively: flagship models of major brands are released first, and even before the mobile phones are released, AI functions have been released in a high-profile manner, and everyone is shouting "All in AI". slogan.

An important driver of this AI craze is the release of the new Snapdragon 8 series chips. As a chip optimized for generative AI on mobile devices, the Snapdragon 8 series provides strong support for mobile phone manufacturers to enter the AI ​​track through comprehensive innovation at the software and hardware levels.

Snapdragon's evolution in the AI ​​field is not a simple increase in computing power, but is achieved through underlying technological innovations in each link: the upgraded Hexagon, as a dedicated AI neural network processor, greatly improves power consumption while lowering power consumption. improve AI computing performance.

The Snapdragon 8 series also introduces cutting-edge AI technologies such as Micro Inferencing at the hardware level, which divides different levels of the neural network on the timeline, allowing multiple slices to be calculated in parallel at the same time, thereby ensuring chip processing The processor always maintains efficient operation, greatly improving the efficiency of AI reasoning.

In October 2023, Qualcomm released the third-generation Snapdragon 8 chip. Its AI performance has nearly doubled compared to the previous generation. It supports general large models including Meta Llama2, ChatGPT and other general models, and the inference speed is as high as 20 tokens per second. Less than 48 hours after the launch of the third-generation Snapdragon 8, the first Xiaomi Mi 14 series was officially released, and it was announced that the self-developed 6 billion parameter large model had successfully run through. The upgraded Xiao Ai can not only accurately understand various user instructions, but can also complete complex tasks such as writing speeches, product reviews, and writing blessing messages.

The Snapdragon 8 series' support for the new features of INT4 can also help OPPO's AI strategy. OPPO can use INT4 to make the original 28GB memory model now run through in less than 4GB, greatly improving memory bandwidth efficiency and achieving high efficiency. Device-side deployment. OPPO Find X7 Ultra, the flagship of 2024, successfully ran the full-blooded AndesGPT large model with 7 billion parameters locally. While greatly reducing resource requirements, the output effect of the AI ​​model was almost unaffected.

Among the new features supported by the third-generation Snapdragon 8 chip, AI photo expansion is also a highlight. Users can use AI to understand the details and structure of images without relying on the network and cloud computing to achieve intelligent and creative AI expansion. picture. Soon, this function became popular. After Xiaomi 14 announced that it supports AI image expansion function, many manufacturers have also followed suit.

Honor Magic6 Pro, equipped with the third-generation Snapdragon 8, uses its own “magic model”.

Among them, the "Smart Filmmaking" function allows users to just tell the scene they want, such as "Help me make a cute short video of my cat's memories this month." AI can automatically summarize the materials on the phone and intelligently edit them into Short film, with music and text that best suits the mood. The "drag schedule" function allows users to simply drag text containing schedule information to the edge of the screen, and the system will recognize the user's intention and automatically create a schedule in less than 1 second.

Basically, as long as everyone sees the label of "Snapdragon 8" now, it is basically deeply bound to the keywords of "flagship, top performance, new AI features".

Since the birth of the Snapdragon 8 series, almost every newly released flagship phone has continued to add amazing new AI features. In aspects such as imaging, games, wireless connections, and audio, which are the most intuitive for users, they have also worked together to achieve leap-forward upgrades.

The new generation of third-generation Snapdragon 8s has new tasks

The advent of the third-generation Snapdragon 8 has helped mobile phone manufacturers complete the breakthrough of AI mobile phones from scratch. The newly launched third-generation Snapdragon 8s shoulders the important task of further bringing generative AI applications to the public.

The third-generation Snapdragon 8s inherits the same CPU architecture as the third-generation Snapdragon 8 flagship platform and is also equipped with the latest Hexagon NPU neural network processor, which also maintains flagship high standards in terms of AI performance. This means that mobile phone manufacturers can equip more models with different positioning and cutting-edge generative AI capabilities, truly realizing the further popularization of generative AI applications.

The third-generation Snapdragon 8s supports 10 billion-level large language models. And unlike other manufacturers' single AI modules, Qualcomm's unique heterogeneous computing features allow various modules such as CPU, GPU, and ISP to have AI capabilities. Each of them is responsible for their own areas of expertise, which is equivalent to using the power of the entire platform to complete the ultimate goal. Best performance for large model AI calculations.

At present, Qualcomm has begun in-depth cooperation with a number of leading Chinese mobile phone manufacturers to fully unleash the potential of the third-generation Snapdragon 8s in the AI ​​field through joint optimization of software and hardware. It is foreseeable that in the new flagship models released in 2024, the full-blooded version of the local large language model will become a new standard that everyone can experience, greatly accelerating the penetration and implementation of AI in the mobile phone market.

Since the development of mobile phone chips, it has evolved from a separate "processor" to a "platform". With the support of the new platform of the third generation Snapdragon 8s, various functions of the mobile phone such as imaging, games, smart assistants, and connections have been fully enhanced by AI.

For example, the perception capabilities of the third-generation Snapdragon 8s make mobile phones more intelligent and flexible: it not only supports fast response to common scenarios such as face unlocking, QR code scanning, and mobile payment, but also continuously learns the user's usage habits and behavior through AI. Preferences make the phone more like an AI assistant that accompanies and learns at all times, truly "getting to know you and the world."

In aspects such as imaging and gaming, which provide the most intuitive mobile AI experience, the third-generation Snapdragon 8 has worked with major manufacturers to achieve leap-forward upgrades. For example, black technologies such as AI segmentation and AI noise reduction in computational photography, as well as AI light tracing, AI super-resolution and other technologies in the gaming field, have raised the performance of mobile images and games to a whole new level.

Taking imaging as an example, the third-generation Snapdragon 8s integrates a cognitive 18-bit triple ISP, which allows the camera to process billions of pixels per second through up to 18-bit data sampling. Equipped with the second-generation image segmentation function, it supports real-time semantic segmentation of photos and videos, bringing an improvement of nearly 2.5 times compared to competing products. When all this is combined with the chip's powerful AI processor, the camera can truly begin to "see and understand the world." Whether it is the image quality performance of low-light shooting or AI image recognition, image retouching, image enlarging and other functions, quality will be achieved. leap.

Of course, the reason why it is called "cognitive" is because in the second generation of Snapdragon 8, it implemented a direct connection through Hexagon to directly connect the ISP to the Hexagon NPU, allowing the ISP to have powerful AI analysis capabilities, so as to During the shooting process, AI optimization is advanced to achieve real-time semantic segmentation, so that every shooting detail, even the reflection of glasses, can be more finely optimized, with real-time feedback, thus greatly improving the imaging quality and shooting experience of mobile phones. This is the hidden merit and fame of the collaboration between Qualcomm AI Engine and ISP.

As the new-generation flagship platform in the Snapdragon 8 series, the third-generation Snapdragon 8s not only provides an excellent experience in multiple fields such as AI, imaging, gaming, and connectivity, but it is also a pioneer product that supports Snapdragon Seamless technology. Accelerate the interconnection of terminals of various types and brands.

For example, in terms of audio-visual entertainment, users can start watching videos on their mobile phones. Seamless technology can seamlessly switch between mobile phones and large-screen devices such as TVs or tablets, and continue playing on the big screen; in office scenarios, users can start watching videos on their mobile phones. When processing documents, Seamless technology allows the working state to be seamlessly switched to large-screen devices such as laptops to continue editing. The new top mobile platform third generation Snapdragon 8, the new top PC platform Snapdragon X Elite and Qualcomm's wearable platform and audio platform all support Snapdragon Seamless, and will be expanded to XR, automotive and IoT platforms in the future.

In terms of positioning, the third-generation Snapdragon 8s has chosen the role of "new generation flagship" compared to the positioning of the third-generation Snapdragon 8 as "the top flagship innovation benchmark". At a critical period for the transformation of Chinese mobile phone manufacturers and the initial development of large-scale end-to-end models, this flexible and versatile new-generation flagship chip is a key part of realizing the grand vision of "AI popularization" and accelerating the development of AI. The popularity in China has moved from a small number of users to a larger number of users.

A possible future—ubiquitous AI

In 2023, you suddenly find that your mobile assistant is better to use. Many mothers have begun to use their mobile phones to smartly edit videos, and students can also use AI to draw and create. Office workers take out their mobile phones to record during meetings, and the meeting minutes and key contents are sorted out in the blink of an eye. But this is not enough.

According to a McKinsey report on "The Economic Potential of Generative Artificial Intelligence", for many office workers, 60%-70% of the work in the future can be automatically completed for you using AI. AI will no longer be the privilege of certain specific fields or high-end products, but will be deeply integrated into every aspect of our lives.

Now, mobile phone hardware has entered a new era, ushering in the explosive AI ecosystem, and the quality of the AI ​​experience has become a new track for manufacturers to compete.

In the future envisioned by Qualcomm, the AI ​​phone in everyone's hands can be your mobile imaging workstation for intelligent editing of photos and videos, or it can be an AI drawing tablet that allows you to create works of art at your fingertips; at the same time, it It is a game console that brings an immersive experience of real-time ray tracing and surround sound effects; finally, it is an all-round intelligent assistant that observes and learns about the world with you, while also protecting your privacy and security at all times.

Qualcomm is currently accelerating the explosion of the AI ​​ecosystem. And this acceleration is not just at the hardware level: for developers, the launch of Qualcomm AI Stack and AI Hub has also greatly lowered the threshold for AI development. These two powerful AI open platforms not only integrate AI capabilities in multiple fields such as natural language processing, speech recognition, and computer vision, but also include a fully optimized generative AI large language model library.

Developers no longer need to spend energy on the adaptation of various device platforms and tedious AI performance scheduling. Developers can deploy on Snapdragon and Qualcomm platforms simply and efficiently, using Qualcomm AI Hub to provide a unified development framework and tool chain to achieve high-performance, low-power AI computing through dedicated hardware such as NPU and heterogeneous computing architecture.

To put it simply, future software developers only need a few lines of code to play with large AI models, and the adaptation to different devices is also simple and worry-free, saving a lot of time and workload, allowing them to quickly and flexibly create their own unique products. . Mobile phone manufacturers can also focus more on creating new interaction methods in the AI ​​era without being limited by issues such as computing power, power consumption, and scheduling and collaboration of various sensors.

In the foreseeable future, your car assistant can also help you plan travel arrangements with one click, your mobile phone can prepare advertising images required by the company, and mobile phone voice assistants have begun to become smarter and become encyclopedias. In the future, you The glasses will act as your personal butler 24 hours a day to remind you of important matters. In the field of AI terminals, perhaps we will not wait for the so-called "iPhone moment" because AI has already begun to penetrate into every aspect of our lives.

When we no longer talk about how amazing AI is every day, but enjoy it all naturally, AI will truly permeate everyone's life.

Currently, in the Chinese market alone, Snapdragon's brand awareness reaches 85%. Consumers consider Snapdragon to be the industry-leading processor at almost every price point. As the leader, Qualcomm is also giving the Snapdragon 8 series a new role – to become the leader of all things intelligent in the AI ​​era, leading AI terminals into our lives.

The greater universe is included within human beings themselves.

# Welcome to follow the official WeChat public account of aifaner: aifaner (WeChat ID: ifanr). More exciting content will be provided to you as soon as possible.

Ai Faner | Original link · View comments · Sina Weibo