Researchers shrink AI model while enhancing its intelligence

Making something smaller and better at the same time sounds like a violation of basic physics. But researchers at the University of Edinburgh, working with NVIDIA, have pulled it off with large language models. Their technique, called Dynamic Memory Sparsification (DMS), compresses a critical piece of AI infrastructure by 8x while somehow making the models score higher on difficult benchmarks. If AI models can run just as well, or better, with a fraction of the memory, the door opens to deploying serious reasoning capabilities on devices that currently can’t handle them, including wearables, smart home hardware, and edge devices. How DMS actually works To understand the breakthrough, you need to know about the key-value (KV) cache. When an AI model reasons through a problem, it stores intermediate results in this cache, essentially a working memory that lets the model keep track of its own thought process. The longer and more complex the reasoning chain, the bigger that cache grows, and the more computational resources it demands. DMS takes a scalpel to this process. Instead of keeping every token in the cache, it selectively retains only the ones that matter most and drops the res...