Yandex releases 80B-parameter AI model under open license for commercial use

Yandex has released a large language model called AliceAI-Foundation-80B-A3B-Base, an 80 billion-parameter system built for both commercial deployment and academic research. The model is now available on Hugging Face under an Apache 2.0 license, meaning anyone can use it, modify it, or build a product on top of it without paying Yandex a licensing fee. A big model that runs lean The headline number is 80 billion parameters, but the more interesting number is 3 billion. That is how many parameters the model actually activates for any given token, thanks to a Mixture-of-Experts architecture. The routing system selects the top 10 experts per token from a pool of 512, plus one shared expert that is always active. The model was trained from scratch on approximately 18 trillion tokens and supports a context window of up to 262,144 tokens. Architecture-wise, it runs across 48 layers using a hybrid of Kimi Delta Attention and gated attention. Yandex benchmarked the model against DeepSeek variants and found that AliceAI-Foundation-80B-A3B-Base outperforms DeepSeek-V4-Flash-Base on two new Russian-language benchmarks the company introduced alongside the release: WikiWebFacts and HardMultiQA....