WTF?! The lack of context awareness is one of the major weaknesses of recent AI implementations. A recent patent filed by Microsoft proposes solving this problem with a set of sensors on a wearable device to create a smarter personal assistant.
Microsoft recently filed a patent in the US describing an AI-powered digital assistant built into a backpack. Should the patent ever become a reality, the device would attempt to solve several problems currently faced by AI assistants.
The backpack would use speakers, a camera, GPS, and pressure sensors embedded in the straps to sense the environment while also receiving user commands through a microphone. Microsoft suggests the information could give the assistant a level of environmental awareness lacking in similar tools in mobile devices and home speakers, and help it better understand commands and provide more relevant responses.
For example, the camera could scan a poster advertising an event, and users could ask the assistant to enter the date of the event into their schedule. The patent also describes a situation where a customer in a grocery store holds a banana while the assistant provides information on banana prices from nearby vendors.
Microsoft has opted for the backpack form factor to allow for a completely hands-free experience. Mobile devices already have the general functionality of the patent, but require users to be looking at a screen and using at least one hand. The company is also comparing the backpack’s capabilities to home assistants like Apple’s Home Pod, with the added benefit of being able to be used outdoors.
In addition, the backpack could carry a computer, tablet, or other device that could sync with the assistant and give it extra processing power. It could also connect wirelessly to cloud services and other mobile systems that the wearer uses.
The idea is reminiscent of previous attempts to make complex digital systems fully mobile and wearable using backpacks. A few years ago, companies like MSI, Zotac, and HP started producing similar products with VR-enabled PCs. Zotac revealed unveils its latest model this week, suggesting the form factor is commercially viable.
As always, this is a patent only. There is no guarantee that Microsoft’s idea will ever become available. However, it raises some interesting questions about the prospect of a fully mobile, hands-free, AI-powered digital assistant that will be with us all the time. Is a backpack the best form factor for the job, or could another wearable device accomplish the same goal?