Qualcomm Plus Layout Generative AI, Unlocking New Imagination Space for Intelligent Terminals

Global Network Technology Reporter Zheng XiangqiAt present, generative AI, as a new technological singularity, is expected to become a link point for the smooth transition from mobile connectivity to the Internet of Things. According to relevant research reports, the market size of generative AI will increase from $40 billion in 2022 to $1

Global Network Technology Reporter Zheng XiangqiAt present, generative AI, as a new technological singularity, is expected to become a link point for the smooth transition from mobile connectivity to the Internet of Things. According to relevant research reports, the market size of generative AI will increase from $40 billion in 2022 to $1.3 trillion in 2032 over the next 10 years.

As a leading manufacturer in the field of intelligent terminal chips, Qualcomm is also poised to break new ground in the wave of generative AI, empowering terminal side generative AI to enter the "ordinary people's homes" and providing more end users with new experiences in life, work, entertainment, and other scenarios.

During the recent 2023 Qualcomm Snapdragon Summit, Qualcomm CEO Armon stated, "We have entered a new era of generative AI and will also create a new cycle in the mobile and computing industries. The transformation brought about by generative AI will be unprecedented. It will change our thinking and innovation in using terminals, change the way we innovate, and change the way we search and interact with terminals

Based on this, Qualcomm has also implemented a series of layouts for generative AI. At this summit, Qualcomm launched the Snapdragon XElite, a computing processor designed for PCs. It is reported that this platform adopts a customized integrated Qualcomm OryonCPU, which will significantly improve the PC experience and usher in a new era of computing with leading CPU performance, terminal side AI inference, and high-efficient PC processors that support multi day battery life.

Alex Katuzan, Senior Vice President and General Manager of Mobile, Computing, and XR Business at Qualcomm Technologies, revealed that Snapdragon XElite is specifically designed for AI and supports generative AI models with over 13 billion parameters running on the terminal side. The terminal side chat assistant for Windows 11 PC can process 30 tokens per second, providing fast and accurate responses.

If this measure is applied to specific situations, ordinary people can read about 200 to 300 words per minute, which is equivalent to processing 5 to 7 tokens per second. However, the writing speed of Snapdragon terminal AI is faster than people's reading speed. Therefore, when users request digital assistants to help draft a memo or travel itinerary, they can almost get answers in real-time.

As Anmeng said, PC is being redefined by AI and generative AI. With the application of Snapdragon XElite in a series of PC brands, more PC users will gain strong productivity, rich creativity, and ubiquitous immersive entertainment experiences. It is reported that the PC equipped with Snapdragon XElite is expected to be launched in mid-2024.

In terms of smartphones, Katuzan believes that with the help of terminal side AI models, smartphones will also become more personalized. It will become a true digital assistant, combining a conversational terminal side assistant with a multimodal generative model that can understand text, image, and voice input, allowing smartphones to provide more meaningful answers and help users complete tasks. Mobile phones will shift from being the most dependent technology product for users to becoming partners who can help them handle everything.

The latest release of the third-generation Snapdragon 8 will undoubtedly accelerate the implementation of this process. As Qualcomm's first mobile platform specifically designed for generative AI, the third-generation Snapdragon 8 can run generative AI models with up to 10 billion parameters and can run large language models at a speed of 20 tokens per second.

Katuzan also stated that by running these large models on the terminal side, users will no longer have to rely entirely on the cloud. On the third generation Snapdragon 8, AI auxiliary features will respond faster and more efficiently, and due to running on the terminal side, privacy and security will also be improved.

It is reported that the third-generation Snapdragon 8 will be widely adopted on terminals of many OEM manufacturers and smartphone brands, providing consumers with industry-leading AI, imaging features, console level gaming experience, as well as professional quality audio and fast connectivity. At present, the Xiaomi 14 series flagship phone, which debuted the third generation Snapdragon 8, has been officially launched recently. The upcoming Honor Magic6 series will also be equipped with the third-generation Snapdragon 8 mobile platform, supporting an end-to-end AI large model with 7 billion parameters.

Terminal side generative AI is crucial for creating a powerful, fast, personalized, efficient, secure, and highly optimized experience. "Anmeng stated that based on Qualcomm's years of AI research and development, including high-performance CPU, NPU, and GPU combinations in terminals, as well as support for local operation of many leading models, Qualcomm can bring the advantages of generative AI to global users and different terminal categories.

It is worth mentioning that during the Snapdragon Summit, Qualcomm also released the first generation Qualcomm S7 and S7Pro audio platforms designed for earplugs, headphones, and speakers, integrating high-performance, low-power computing, terminal side AI, and advanced connectivity; And Snapdragon Seamless technology, which can seamlessly connect multiple terminals across operating systems, further empowers multiple end users with a new experience of intelligent interconnection.

Nowadays, Snapdragon has become the core of nearly 3 billion terminals worldwide, covering a range of fields such as smartphones, XR devices, laptops, and automobiles. As Qualcomm's layout of generative AI deepens, as Anmeng said, the future Snapdragon enabled generative AI experience will be ubiquitous. The imagination space brought by Snapdragon to the terminal industry will also be infinitely vast.

Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.(Email:[email protected])