GoKawiilMeta details Prometheus supercluster used to train Muse foundational models
Meta says the first phase of its gigawatt-scale Prometheus supercluster in New Albany, Ohio is complete and was used to train its Muse family of foundational models, including the new Muse Wonder models. The company plans to scale the cluster toward roughly one million GPUs and says it uses closed-loop liquid cooling, having achieved over 85% goodput in pre-training and over 90% in reinforcement learning runs for Muse Wonder.