Microsoft’s ChatGPT-powered Bing AI just got a really useful new feature
Microsoft is in the process of adding a new feature to its Bing chatbot that will considerably increase the utility value of the AI, namely image recognition.
Bing Vision is being tested with a small number of chatbot users at present, as Neowin reports, and it lets those folks upload an image for a query. In other words, instead of typing text, you can sling the AI a picture, and itâll identify it and provide information on the image.
Neowin flags up some of the people on Twitter whoâve got to play with Bing Vision, and their results include the chatbot identifying an Egyptian temple from a photo, which is a good example of how you might be able to use the facility.
Oh, how cool is that! Just noticed that I have access to #Bing chat’s image features! @MParakhin reading German text from images needs some work. âșïž #ai pic.twitter.com/04JfV66PALJune 23, 2023
In another instance, a scan of a maths equation was fed to the chatbot which correctly identified it as the âSchrodinger equationâ, and thereâs a further example where a humorous cartoon is analyzed and explained by the AI.
If you havenât yet had the opportunity to get Bing AI to flex its image recognition muscles, thatâs because only a niche set of users are getting the feature right now, as mentioned at the outset. Weâre told by Microsoftâs head of advertising and web services, Mikhail Parakhin, that itâs currently just over 10% of the user base.
Analysis: Bing Vision is coming to everyone soon
Youâre pretty lucky if youâve got this image recognition system enabled, then, as not many folks have at this point. Do note that it is only available on desktop PCs, by the way, as Bing Vision isnât yet being offered on mobile devices.
Clearly, this is a useful extra string to the bow of the AI that can help in all sorts of potential ways for image-based queries, as we can see from those whoâve already tried it out on Twitter.
See a picture of a beautiful beach, lake, mountain, or town, and wonder where it is? Chuck that image at Bing and it should hopefully be able to tell you not just the location, but further details, say, on how you might plan a trip there.
The feature should be much more broadly rolled out in a few weeks, Parakhin tells us, and that will include mobile users too â in fact, it should arrive for everyone by then. Good stuff.
Microsoft is working at a pretty fast pace to expand the capabilities of Bing AI, which isnât surprising given that AI is the talk of the town right now. Microsoft just ushered in voice input for desktop PCs (previously this was mobile-only), as well as improving this feature for mobiles (and adding an iOS widget for Bing Chat, to boot).