OpenAI’s ChatGPT will ‘see, hear and speak’ in major update

NEW YORK (Reuters): OpenAI’s ChatGPT is getting a major update that will enable the viral chatbot to have voice conversations with users and interact using images, moving it closer to popular artificial intelligence (AI) assistants like Apple’s Siri.

The voice feature “opens doors to many creative and accessibility-focused applications”, OpenAI said in a blog post on Monday.

Similar AI services like Siri, Google (GOOGL.O) voice assistant and Amazon.com’s (AMZN.O) Alexa are integrated with the devices they run on and are often used to set alarms and reminders, and deliver information off the internet.

Since its debut last year, ChatGPT has been adopted by companies for a wide range of tasks from summarizing documents to writing computer code, setting off a race amongst Big Tech companies to launch their own offerings based on generative AI.

ChatGPT’s new voice feature can also narrate bedtime stories, settle debates at the dinner table, and speak out loud text input from users.

The technology behind it is being used by Spotify (SPOT.N) for the platform’s podcasters to translate their content in different languages, OpenAI said.

With images support, users can take pictures of things around them and ask the chatbot to “troubleshoot why your grill won’t start, explore the contents of your fridge to plan a meal, or analyze a complex graph for work-related data”.

Alphabet’s Google Lens is currently the popular choice to gain information on images.

The new ChatGPT features will be released for subscribers of its Plus and Enterprise plans over the next two weeks.