Facebook and Instagram can now use AI to answer questions about your photos and edit them too

Mark Zuckerberg announced a bunch of cool AI features at Meta Connect 2024 that apply to Meta AI, the chatbot found in his popular social media apps like Facebook, Instagram DM, WhatsApp, and Messenger. One of the coolest new features he unveiled is the ability to ask questions about and edit photos in Meta AI.

Meta AI is now multi-modal, meaning it can “see” photos in your chats and answer questions about them. So you can simply drop a picture of a bird into your chat with Meta AI and ask it what kind of bird you’re looking at and it will give you the correct answer. But it goes beyond just identifying animals and plants. Show it a picture of a meal and ask it how you would make it and it will give you a list of instructions and ingredients.