AI tools usually require access to cloud computing to have enough power to run, but your future AI usage will ultimately require no more than is available on your device if Qualcomm has its way. The tech giant has unveiled a new system, the Qualcomm AI Orchestrator, aimed at integrating AI tools and experiences and keeping the process on your devices.
Qualcomm AI Orchestrator integrates all your AI uses, including what you do on your computer, mobile device, and even in your car. The orchestrator takes into account personal preferences and the surrounding context when executing to make the most of what different accessible AI apps and services can offer.
It’s the individual customization aspect that stands out as the AI Orchestrator’s biggest appeal. The AI uses information on your device about your contacts, where you regularly travel, what you do in a day and even your favorite apps to personalize the experience and create a personalized knowledge graph. For example, if you have an app that you rely on to reserve seats at a restaurant, the AI Orchestrator will use that app when recommending places to go and reserving a time when you request it. It’s a more proactive approach than the standard question and answer system you may be familiar with when performing text or voice searches.
The entire process is faster and safer because the AI is running on the device. That means you can store personal information without having to worry about it being stolen or shared from a cloud server by malicious actors. It also makes the AI respond to you faster, even if it takes more power for multimodal voice and video interactions.
Orchestrated life
“Imagine a scenario where you start your day with a bunch of notifications on your phone,” Qualcomm described in a blog post. “You only have time to read them during your lunch break, so instead of reading all the notifications yourself, your generative AI assistant automatically creates a notification summary and can pick out the most important ones.”
The Qualcomm AI Orchestrator is essentially the conductor’s ‘orchestrator’ of AI instruments, not just within a device but across multiple interfaces. So the AI that your phone uses to set up your dinner reservation is also linked to your car navigation and your calendar on your home computer, so you can go to the restaurant and get an alert that you won’t be responding to emails at that moment. time.
In some ways, this sounds a lot like the personal intelligence and contextual relevance that Apple Intelligence will bring to Siri in the coming months. The difference is that Apple Intelligence only supports certain iPhones, Macs and iPads. Qualcomm AI Orchestrator could end up on all kinds of devices with the latest Qualcomm chips.
Qualcomm hopes to further expand the orchestrator as AI tools continue to evolve. It can ultimately help keep your smart home devices working and even take over the phone calls with customer service representatives you don’t want to make. Even if Qualcomm’s dream of redefining the way you interact with AI doesn’t come to fruition anytime soon, the concept of interconnected on-device AI processing could prove popular enough that others will take a cue from Qualcomm in their next line of AI products.