Sapient open-sources HRM-Text model, advancing recurrent reasoning on a $1,500 budget

1 week ago 25



A Singapore-based AGI research company called Sapient Intelligence has released the full weights, pretraining code, and data pipeline for HRM-Text, a language model built on what it calls a Hierarchical Reasoning Model architecture. The entire package is available under the Apache 2.0 license on Hugging Face and GitHub, which means anyone can use it, modify it, or build on it commercially. The notable part isn’t just the open-source gesture. It’s the economics. HRM-Text, which has approximately 1 billion parameters, was pretrained on around 40 billion tokens and cost an estimated $1,000 to $1,500 on modest hardware. For context, frontier models from the major labs typically train on trillions of tokens using compute budgets that run into tens or hundreds of millions of dollars. How it actually works The model uses what the company describes as a hierarchical latent recurrent architecture. The high-level module handles slow, abstract reasoning, cycling through 2 “H-cycles” per pass. The low-level module handles fast, detailed processing, running 3 to 6 “L-cycles” per pass. Together, these modules allow the model to iterate on its own reasoning multiple times before producing an outp...

Read Entire Article