Evo 2 was trained with 40 billion parameters on 9.3 trillion tokens, and its training code, data, and model parameters are fully open-source.
(Please use a modern browser to see the interactive version of this visualization)