AA-Robotics v0.1 puts frontier language models in charge of a robot arm

Artificial Analysis finds GPT-6 Astra leads its first embodied benchmark, but every model remains far slower than a human Large language models can write essays, debug code and summarize earnings calls. Now someone has handed them a robot arm and asked them to write “hello world” with a pen. On October 14, 2026, Artificial Analysis released AA-Robotics v0.1. The research preview tests how well frontier language models understand, plan and act in the physical world. How the benchmark works The setup is intentionally simple. Each model gets control of a Hiwonder NexArm, a 6-axis robot arm. It also gets a single, plainly stated objective. The models operate through a coding-agent interface connected to a simple HTTP API. For eyes, the system relies on four cameras that feed visual information back to the model. The tasks run zero-shot. Each model attempts every task without prior practice or task-specific training. Artificial Analysis is publishing results for its first eight tasks. Examples include pouring water, stacking blocks and writing “hello world.” A complete success earns 100 points, and partial credit rewards progress on attempts that stop short of the finish line. The leade...