The Intelligence That Did Not Come with a Manual Peer inside the mind of an AI and you will not find fully formed thoughts or intentions written in plain English. What you will find is vast arrays of numbers combining together in ways that somehow produce intelligence. How exactly that happens is, remarkably, something we genuinely do not fully understand — even the researchers who build these systems. That is the problem that AI interpretability is trying to solve: mapping meaning onto those numbers, and shining a light inside the black box. AI interpretability is, in the words of Neel Nanda, who leads the Language Model Interpretability team at Google…