Meta details its two new data center scale clusters, both containing 24,576 Nvidia H100 GPUs that the company is using for AI workloads like training Llama 3 (Charlotte Trueman/DatacenterDynamics)

https://ift.tt/uKPsgkN

Charlotte Trueman / DatacenterDynamics:
Meta details its two new data center scale clusters, both containing 24,576 Nvidia H100 GPUs that the company is using for AI workloads like training Llama 3  —  Have been built to support AI research and development  —  Meta has shared the details of the hardware, network, storage, design …

from Techmeme https://ift.tt/B2kF9rM