OpenAI has introduced a new ChatGPT feature - from now on, the chatbot will have "eyes" and will be able to respond to video and voice in real time thanks to the Advanced Voice mode.
The feature will allow users to turn on the camera on their device and show the chatbot everything that is happening around them. Users will be able to ask questions based on what is happening in the frame.
Now you can chat with ChatGPT over video and voice in real time. pic.twitter.com/6LySLJcFy5
— OpenAI (@OpenAI) December 12, 2024
During the presentation of the new feature, a coffee set was placed on the table and the chatbot was asked to explain the brewing process. The bot explained in detail what to do step by step and in what sequence, and answered clarifying questions.
Moreover, you can share your screen with the chatbot. ChatGPT will be able to see everything that is happening on the device screen and answer contextual questions. For example, when you open a messenger, the chatbot can help you write a reply to a message.
Screenshare while using Advanced Voice for instant feedback on whatever you’re looking at. pic.twitter.com/d4Xm36dwOX
— OpenAI (@OpenAI) December 12, 2024
The new feature will be available in ChatGPT Plus and Pro tariff plans next week. For business and education, this innovation will be implemented in early 2025.