Harvard and MIT researchers launch MatrAIx, a simulation with 8.3 billion AI personas

A team of researchers from Harvard and MIT just built a digital mirror of humanity. MatrAIx, a new AI evaluation infrastructure, contains 8.3 billion AI personas, roughly one for every person on Earth, each defined across 1,290 categorical dimensions. The system’s purpose: test AI products against a synthetic population that behaves like the real one. In validation trials, the personas stuck to their assigned behavioral traits 91.5% of the time, hitting 366 out of 400 trials across ten different behavioral attributes. What MatrAIx actually does The core of the project is a database called Persona 8B. Think of it as a census of synthetic humans, where each record captures not just basic demographics but a sprawling profile across 1,290 dimensions. The researchers constructed four distinct interactive environments for testing: Survey, AI Chatbot, Web, and App. These settings let developers evaluate how AI systems perform when interacting with diverse user types across realistic scenarios. Across those environments, the team assembled more than 1,000 tasks spanning over 25 domains. They ran a total of 18,189 evaluation trials across eight representative tasks. The team and the data re...