Elon Musk hints at 3 trillion-parameter Grok model, promises dramatically better performance

Elon Musk announced on September 14 that Grok 4.8, a 2.5 trillion-parameter AI model, is wrapping up its initial training run this week and entering the reinforcement learning phase. The update comes barely a month after xAI shipped Grok 4.6, which carried 1.5 trillion parameters, and it signals that the company’s breakneck release cadence isn’t slowing down anytime soon. What makes this interesting isn’t just the 2.5 trillion figure. Musk has previously stated that the Grok 3 and Grok 4 models were built on a 3 trillion-parameter architecture, and that each subsequent release is “dramatically better” thanks to improvements in scale, data quality, and architectural design. The scaling ladder from 1.5T to 10T To appreciate how quickly xAI is moving, consider the timeline. Grok 4.6 shipped on August 12 with 1.5 trillion parameters. The next version, Grok 4.7, was supposed to land somewhere around 2.1 trillion parameters but hit delays. Now Grok 4.8 is finishing training at 2.5 trillion, leapfrogging the troubled 4.7 release in both parameter count and apparent readiness. That kind of iteration speed requires serious computational muscle. xAI has been leaning on Colossus 2, its superc...