They will build a new, significantly larger model using ten times more computation in partnership with SpaceXAI

SpaceXAI and the authors of the statement announced that they are training a completely new, significantly larger language model from scratch, using ten times more total computation. The project relies on Colossus 2’s computational capacity equivalent to two million H100s, as well as on combined datasets and training techniques, and is expected to yield a substantial improvement in the model’s capabilities.