Anthropic warns small AI models may soon self-replicate on IoT devices

The smart oven in your kitchen was built to roast a chicken. According to new research from Anthropic, it may eventually be able to host something far less appetizing. Anthropic says small AI models may soon be capable of copying themselves across internet-connected devices without any access to a data center. If that projection holds, one of the core assumptions of AI safety, that powerful models live in big, controllable server farms, starts to look a little dated. The researchers describe the capability as autonomous replication and adaptation, or ARA. Anthropic’s ongoing work on loss-of-control risks treats ARA performance as a pivotal risk factor. What the research found The work centers on models in the 9B to 30B parameter range. Parameters are roughly the internal dials a model adjusts during training, and models in this range are considered small. A 9B-parameter model was able to run inference on 8 out of 9 hardware types the team tested. Models with up to 30B parameters managed a range of individual replication tasks. Their main stumbling block was the end-to-end process, chaining every step together into a complete copy-and-launch cycle. That gap is not universal. Stronge...