Qualcomm partners Mistral AI, bringing its increasingly popular LLMs on-device inside your Snapdragon platform. Photo: HWZ.
Qualcomm and Mistral AI have jointly announced that they are partnering up to bring Mistral’s generative AI models into Qualcomm’s Snapdragon chipset platforms.
The Mistral AI partnership was done in a pre-recorded announcement screened at Snapdragon Summit 2024. Photo: HWZ.
According to the announcement made at Snapdragon Summit 2024, the Ministral 3B and Ministral 8B large language models (LLMs) will be available on the Snapdragon 8 Elite, Snapdragon Cockpit Elite, Snapdragon Ride Elite, and Snapdragon X Series platforms.
This means Mistral AI's new LLMs are available on Qualcomm-powered smartphones, connected cars, and AI PCs, with Ministral 3B making its first-ever commercial debut for on-device usage.
The core perk of including Mistral AI’s compact LLMs on-device is that the user can run these generative AI models with privacy, immediacy, and reliability.
Of course, it falls upon manufacturers to tap into Mistral AI’s LLMs to make them useful for end-users like us.
Qualcomm said that new Mistral AI models can be found on its Qualcomm AI Hub at a later date. For the time being, Mistral AI’s Mistral 7B v0.3 is available for developers to use.
For those not in the know, Mistral AI is an AI development company founded by Meta and Google DeepMind ex-employees in 2023. The company is responsible for large language models used by several tech companies, such as its 123-billion parameter Mistral Large 2 that IBM uses, as well as other LLMs used by SAP, Microsoft Azure, and NVIDIA’s AI Foundry.
Solar LLM is now available on-device for Qualcomm's premium PC chipset platform, Snapdragon X Elite. Photo: HWZ.
Qualcomm's collaboration with makers of AI LLMs deepens, with the third and final day of the keynote stringing together various AI partners and their effort to offer more LLMs on-device. For instance, Upstage.ai, know for its Solar LLMs and Document AI processing tool, is now supported on the Snapdragon X Elite platforms.
(From L to R, not including moderator): Durga Malladi (SVP, GM, Technology Planning and Edge Solutions at Qualcomm), Eric Dulkeith, PhD. (Stragetic Partnerships and Alliances for R&D at IBM), Rob Boetticher (Global Technology leader Automotive + Manufacturing at AWS), and Lucy Park (co-founder and CPO at Upstage).
Our articles may contain affiliate links. If you buy through these links, we may earn a small commission.