A Test Built to Resist Cheating

Most AI benchmarks eventually get memorized. Models train on enough similar data that scoring well stops proving genuine reasoning. The ARC AGI benchmark was built specifically to resist this. Created by François Chollet, creator of Keras, and Mike Knoop, co-founder of Zapier, this benchmark series measures something narrower and harder than most tests attempt. Not what a model knows, but how efficiently it can learn something entirely new.

ARC-AGI-1 launched in 2019. It took five years to meaningfully move the needle. Then came ARC-AGI-2 in 2025, and ARC-AGI-3 in 2026, each one exposing a different weakness in how frontier models actually reason.