During the Microsoft Build 2023, Qualcomm Technologies, Inc. showcased its latest innovations in on-device AI. Among which generative AI running on the computing platforms Snapdragonas well as new paths for developers building applications for Snapdragon-powered Windows 11 PCs.
Qualcomm and Microsoft: partnership to make generative AI mainstream
“For generative AI to truly go mainstream, much of the inference will need to run on edge devices.” he stated Ziad Asghar, senior vice president of product management di Qualcomm Technologies, Inc. “Our best-in-class AI hardware and software enables developers to take full advantage of our powerful AI capabilities. Delivering amazing new user experiences on Snapdragon-enabled laptops, phones and other devices.”
The future of AI must include both AI on device that the one on cloud. Running AI applications on the device improves cost effectiveness, privacy, personalization and latency. The platforms Snapdragon they include a dedicated Qualcomm AI Engine that processes AI workloads more efficiently than pure CPU or GPU processing. Making on-device AI possible even in small, thin and light devices.
Build 2023, what Qualcomm has to offer
On the occasion of Microsoft Build, Qualcomm Technologies will showcase and offer tools to help develop generative AI on the next generation of Windows 11 PCs. Stable Diffusion, a text-to-image generative AI model with over 1 billion parameters, is now running entirely on-device, and the company says it sees a clear path for running models with up to 10 billion parameters on devices in the coming months, including large language models (LLM).
To enhance the Qualcomm AI Stack and help developers build the next generation of on-device AI experiences, the Qualcomm AI Engine Direct SDK will be made publicly available for the first time at the Microsoft Build. With ONNX Runtime and Qualcomm AI Stack, you can run AI workloads on Snapdragon 8cx Gen 3 AI Engine on both Surface Pro 9 5G and Lenovo ThinkPad x13s.
“To extend AI to the vast universe of devices and applications requires both the cloud and device computing,” he said. Pavan Davuluri, Corporate VP, Windows Silicon and System Integration di Microsoft. “By bringing together Microsoft’s leadership in cloud AI and Windows platform capabilities with Qualcomm Technologies’ expertise in on-device AI, we will accelerate opportunities for generative AI experiences.”
Qualcomm Technologies will also demonstrate, during the Microsoft Build, the dramatic performance improvements available when popular applications are built natively for Snapdragon, and will debut a new developer portal that compiles the The most important tools, resources, and support for Windows development on Snapdragon in one easy-to-use location.