Mistral AI releases Large 4, an open-weight model built for cybersecurity

The French startup's trillion-parameter model can be downloaded and run privately, a pitch aimed at organisations wary of relying on closed AI services French AI startup Mistral released its Large 4 model to the public on October 29. The company says it is designed to help organisations find and fix cybersecurity vulnerabilities. The bigger story is how you get it. Closed models such as Google’s Gemini are mainly accessed through online services. Mistral Large 4 can be downloaded and run independently by anyone, which makes it unusual at this scale. What Mistral actually shipped Mistral Large 4, shortened to ML4 and nicknamed “Le Chonk,” has roughly 1 trillion total parameters. Only 52 billion parameters are active for any given token, so most of the model sits idle on each step. The model can run on as few as four Nvidia B200 or B300 GPUs. For a trillion-parameter system, that is a surprisingly modest footprint. ML4 supports a 1M-token context window and fluency in over 160 languages. A context window is how much text a model can consider at once. At a million tokens, it can take in very large codebases or document sets in a single pass, which matters when hunting for flaws. The w...