OpenAI today announced an improved version of its most capable artificial intelligence model to dateāone that takes even more time to deliberate over questionsājust a day after Google announced its first model of this type.
OpenAIās new model, called o3, replaces o1, which the company introduced in September. Like o1, the new model spends time ruminating over a problem in order to deliver better answers to questions that require step-by-step logical reasoning. (OpenAI chose to skip the āo2ā moniker because it’s already the name of a mobile carrier in the UK.)
āWe view this as the beginning of the next phase of AI,ā said OpenAI CEO Sam Altman on a livestream Friday. āWhere you can use these models to do increasingly complex tasks that require a lot of reasoning.ā
The o3 model scores much higher on several measures than its predecessor, OpenAI says, including ones that measure complex coding-related skills and advanced math and science competency. It is three times better than o1 at answering questions posed by ARC-AGI, a benchmark designed to test an AI modelsā ability to reason over extremely difficult mathematical and logic problems theyāre encountering for the first time.
Google is pursuing a similar line of research. Noam Shazeer, a Google researcher, yesterday revealed in a post on X that the company has developed its own reasoning model, called Gemini 2.0 Flash Thinking. Googleās CEO, Sundar Pichai, called it āour most thoughtful model yetā in his own post. Googleās new model achieved a high score on SWE-Bench, a test that measures a modelsā agentic abilities.
However, OpenAIās new o3 model is 20 percent better than o1. āo3 blew it out of the water,ā says Ofir Press, a post-doctoral researcher at Princeton University who helped develop SWE-Bench. āVery surprising increase, not sure how they did it.ā
The two dueling models show competition between OpenAI and Google to be fiercer than ever. It is crucial for OpenAI to demonstrate that it can keep making advances as it seeks to attract more investment and build a profitable business. Google is meanwhile desperate to show that it remains at the forefront of AI research.
The new models also show how AI companies are increasingly looking beyond simply scaling up AI models in order to wring greater intelligence out of them.
