Evo 2 was trained with 40 billion parameters on 9.3 trillion tokens, and its training code, data, and model parameters are fully open-source.