OpenAI has just released GPT-4o, an updated version and a faster language model that’s free for all ChatGPT users. Mira Murati, OpenAI’s Chief Technology Officer, announced the release during a livestream last Monday, highlighting its significantly enhanced speed and expanded capabilities in text, vision, and audio processing. Murati assured that GPT-4o will be freely accessible to all users, with premium subscribers enjoying increased capacity limits up to five times that of free users.
According to a blog post by OpenAI, GPT-4o’s functionalities will be gradually introduced, with its text and image processing features being integrated into ChatGPT starting Monday.
Introducing GPT-4o
OpenAI CEO, Sam Altman, emphasised that GPT-4o is inherently multimodal, meaning it can interpret and generate content from voice commands, speech, text inputs, and images. Altman also noted that developers interested in experimenting with GPT-4o will have access to its API, which offers twice the speed at half the cost compared to the previous GPT-4 Turbo version.
The new model brings exciting enhancements to ChatGPT’s voice mode, transforming it into a real-time voice assistant akin to the one portrayed in the movie “Her,” capable of actively responding to and perceiving its environment. This contrasts with the previous voice mode, which was more limited in its capabilities and responsiveness.
To make advanced artificial intelligence more accessible and useful worldwide, GPT-4o’s language capabilities are likewise improved across quality and speed. ChatGPT also now supports more than 50 languages across sign-up and login, user settings, and more.
Bringing More Intelligence and Advanced AI Tools for Free
OpenAI’s mission includes making advanced artificial intelligence tools available to as many people as possible. When using GPT-4o, ChatGPT Free users will now have access to features such as:
- Experience GPT-4 level intelligence
- Get responses from both the model and the web
- Analyse data and create charts
- Chat about photos you take
- Upload files for assistance summarising, writing or analysing
- Discover and use GPTs and the GPT Store
- Build a more helpful experience with Memory
Streamline Your Workflow in the New Desktop App
OpenAI is also introducing a new ChatGPT desktop application tailored for macOS, catering to both free and paid users alike. This app is engineered to seamlessly integrate with your computer activities. Users can promptly pose inquiries to ChatGPT by using a straightforward keyboard shortcut (Option + Space). Additionally, within the app, you can capture and discuss screenshots effortlessly.
Moreover, users can now engage in voice dialogues with ChatGPT directly from the computer. Initially, you can access the Voice Mode feature, which has been part of ChatGPT since its inception. In the future, anticipate the integration of GPT-4o’s advanced audio and video functionalities. Brainstorming ideas for your business, gearing up for an interview, or simply discussing a topic has never been easier, as users can simply tap the headphone icon located in the bottom right corner of the desktop application to initiate a voice conversation. Furthermore, OpenAI is also set to release an improved user interface for ChatGPT—a new look and feel designed to be friendlier and more conversational.
Leading up to the launch of GPT-4o, speculation swirled regarding OpenAI’s plans, ranging from the development of an AI search engine to the integration of a voice assistant within GPT-4 or the launching of an entirely new and improved model, GPT-5. The timing of this release concurs strategically with Google I/O, where Google is expected to introduce various AI products developed by its Gemini team.
OpenAI reported that over 100 million individuals are presently using ChatGPT. However, with an enhanced ChatGPT experience, including desktop interaction and improved voice conversations, the appeal of its technology could extend to an even larger user base. This initiative coincides with the trend of AI integrations into mainstream consumer products by tech giants such as Google and Meta, seen in platforms like Instagram and Google Assistant. These developments may further broaden the accessibility and reach of their respective technologies.