Dell has announced its partnership with AMD to expand its generative AI portfolio and offer more choice to its customers. The company is introducing a new version of its PowerEdge XE9680 server fitted with eight AMD Instinct MI300X accelerators, alongside the Nvidia-powered version. This server will allow businesses to train and run their own in-house large language models (LLMs) with high-bandwidth memory and over 21 petaFLOPS of performance. Dell is also embracing standards-based networking and advocating for an open approach, in contrast to Nvidia’s approach. Alongside the hardware, Dell has introduced a new standard called Dell Validated Design for Generative AI with AMD, which provides a framework for organizations to run their own hardware and networking architecture for LLMs.
Key Points:
- Dell has teamed up with AMD to expand its generative AI portfolio and provide more options to customers.
- The company is launching a new version of its PowerEdge XE9680 server with eight AMD Instinct MI300X accelerators.
- Dell is embracing standards-based networking and advocating for an open approach, in contrast to Nvidia.
- Alongside the hardware, Dell has introduced a new standard called Dell Validated Design for Generative AI with AMD.
Dell’s partnership with AMD allows the company to offer a wider range of choices to its customers in the AI space. By introducing a server with AMD accelerators alongside its Nvidia-powered version, Dell provides businesses with more options when it comes to training and running their own in-house large language models. With high-bandwidth memory and high performance capabilities, the new server is designed to meet the demands of AI workloads.
In addition to the hardware, Dell is also adopting an open approach to AI infrastructure. By embracing standards-based networking and advocating for an open approach, the company is positioning itself as an alternative to Nvidia, which has a more closed approach. Dell wants businesses to take an open approach across compute, fabric, and storage components needed to power generative AI models in-house.
To support its customers in implementing generative AI platforms, Dell has introduced the Dell Validated Design for Generative AI with AMD. This standard provides a framework for organizations to run their own hardware and networking architecture for large language models. It also uses AMD ROCm powered AI frameworks, which are compatible with the AMD accelerators and popular AI frameworks such as PyTorch, TensorFlow, and OpenAI Triton.
The new hardware and services from Dell are set to be available in the first half of next year. With its partnership with AMD and commitment to an open approach, Dell aims to provide its customers with more choice and flexibility when it comes to AI infrastructure.