Elon Musk’s AI company released Grok 3, its latest flagship AI chatbot, on Monday. Grok, xAI’s answer to models like OpenAI’s GPT-4o and Google’s Gemini, can analyze images and respond to questions while powering a number of features in Musk-owned social network X.
Musk previously referred to Grok as “scary smart.” Grok 3’s development was accelerated by its Colossus supercomputer which was built in just eight months. The system, powered by 100,000 Nvidia H100 GPUs, provided 200 million GPU-hours for training—10 times more than its predecessor, Grok 2. In order to make this happen, xAI used an enormous training center in Memphis, Tennessee.
READ: Elon Musk’s xAI to launch chatbot Grok 3 (February 17, 2025)
“Grok 3 is an order of magnitude more capable than Grok 2,” Musk said during a live-streamed presentation on Feb. 17, and added that it is a “maximally truth seeking AI,” even when the truth is what he referred to as “at odds with political correctness.”
Technically, Grok 3 is a family of models. A smaller version of Grok 3, Grok 3 Mini, responds to questions more quickly at the cost of some accuracy. Not all the models and related features of Grok 3 are available yet as some are still in beta phase but the initial features rolled out on Monday.
xAI claims that Grok 3 beats GPT-4o on benchmarks including AIME—which evaluates a model’s performance on a sampling of math questions— and GPQA—which assesses models using PhD-level physics, biology, and chemistry problems.
READ: China disrupts AI market with DeepSeek: A better, cheaper version of ChatGPT? (January 27, 2025)
According to xAI, an early iteration of Grok 3 has also been given better ratings than its competitors on Chatbot Arena, a crowdsourced website that pits different AI models against each other in blind tests.
“We should emphasize that this is kind of a beta, meaning that you should expect some imperfections at first, but we will improve it rapidly, almost every day,” Musk added while also stating that voice assistance would be released for this model at a later time.