Dell expands generative AI portfolio with AMD

Dell Technologies has added AMD Instinct MI300X accelerator-based products to its generative AI offerings.

With this portfolio expansion, Dell and AMD aim to provide customers with an enhanced array of options to power their AI and GenAI workloads.

The newly-introduced Dell PowerEdge XE9680, touted as the fastest ramping solution in Dell’s history, will support the AMD Instinct MI300X accelerator. It offers enterprises high-performance capabilities, allowing them to extract value from their data and gain a competitive edge through customised large language models (LLMs).

Featuring eight MI300X GPUs with 192GB of 5.3 TB/s high bandwidth memory (HBM3) per GPU, the PowerEdge XE9680 with MI300X is set to democratise access to generative AI. This system will enable enterprises to train larger models, reduce data centre footprints, lower total cost of ownership, and achieve significant performance leaps with over 21 petaflops of FP16 performance.

In addition to the support for AMD MI300X Instinct Accelerator, Dell has unveiled the next phase of Dell generative AI solutions with the introduction of Dell Validated Design for Generative AI with AMD. This design simplifies the deployment of trustworthy generative AI by incorporating AMD ROCm powered AI frameworks, set to be available in the first half of 2024. It will encompass open-source LLMs, leveraging AMD ROCm — an open-source stack of drivers, dev toolkits, and APIs for AMD Instinct accelerators.

The PowerEdge XE9680 stands as a performance powerhouse while prioritising security and simplicity. Dell’s OpenManage Enterprise software streamlines generative AI infrastructure deployment, complemented by CloudIQ software offering intelligent automation. Backed by integrated cyber recovery and a comprehensive Zero Trust approach, the PowerEdge XE9680 ensures heightened security measures.

Leveraging the AMD Instinct Platform, the PowerEdge XE9680 enables near-linear scaling and low latency distributed GenAI training and inferencing.

The PowerEdge XE9680 with AMD Instinct MI300X accelerators and Dell Validated Design for Generative AI with AMD will be available from the first half of 2024.