AMD scores big win with thousands of Instinct MI300x shipped to one of world’s largest privately held cloud computing platforms
AMD‘s Instinct MI300X is a beast of an AI accelerator – built on the company’s third-generation CDNA architecture and TSMC’s advanced 5nm and 6nm processes, it features 19,456 stream processors, 192GB of HBM3 memory, 304 compute units, 1,216 matrix cores, and a thermal design power (TDP) of 750 watts. In one of the first benchmark tests it absolutely obliterated Nvidia’s RTX 4090.
Vultr, a leading privately held cloud computing platform, has announced plans to integrate AMD’s high-performance hardware with its scalable cloud infrastructure. The aim is to manage GPU-accelerated workloads more effectively, offering seamless performance across both data centers and edge computing.
“Innovation thrives in an open ecosystem,” said J.J. Kardwell, CEO of Vultr. “The future of enterprise AI workloads is in open environments that allow for flexibility, scalability, and security. AMD accelerators give our customers unparalleled cost-to-performance. The balance of high memory with low power requirements furthers sustainability efforts and gives our customers the capabilities to efficiently drive innovation and growth through AI.”
GPU-accelerated Kubernetes
Vultr’s collaboration with AMD seeks to provide enterprises access to a world-class AI development environment. AMD’s architecture, combined with Vultr’s platform, will enable businesses to work with open-source, pre-trained models, streamlining AI project development.
“We are proud of our close collaboration with Vultr, as its cloud platform is designed to manage high-performance AI training and inferencing tasks and provide improved overall efficiency,” said Negin Oliver, corporate vice president of business development, Data Center GPU Business Unit, AMD.
“With the adoption of AMD Instinct MI300X accelerators and ROCm open software for these latest deployments, Vultr’s customers will benefit from having a truly optimized system tasked to manage a wide range of AI-intensive workloads.”
This partnership also optimizes Vultr’s infrastructure for GPU-accelerated Kubernetes clusters, capable of handling complex workloads globally. Vultr hasn’t revealed exactly how many Instinct MI300X units it has ordered, only that the initial cluster is in the “thousands.”
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
More from TechRadar Pro
AMD‘s Instinct MI300X is a beast of an AI accelerator – built on the company’s third-generation CDNA architecture and TSMC’s advanced 5nm and 6nm processes, it features 19,456 stream processors, 192GB of HBM3 memory, 304 compute units, 1,216 matrix cores, and a thermal design power (TDP) of 750 watts. In…
Recent Posts
Archives
- November 2024
- October 2024
- September 2024
- August 2024
- July 2024
- June 2024
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- September 2018
- December 2011