Mapping the Terrain of Agents