Prime Intellect, 0G Labs, and PyTorch have each integrated the DiLoCo algorithm into their AI systems, marking a coordinated shift toward decentralized training. This method distributes model training ...