[ad_1]
New Delhi: AMD has introduced new accelerators and processors for working giant language fashions or LLMs, as graphics chip maker Nvidia leads the generative AI chips race. The AMD Intuition MI300X chip presents industry-leading reminiscence bandwidth for generative AI and management efficiency for big language mannequin (LLM) coaching and inferencing whereas because the AMD Intuition MI300A accelerated processing unit (APU) combines newest AMD CDNA 3 structure and “Zen 4” CPUs to ship breakthrough efficiency for HPC and AI workloads.
“AMD Intuition MI300 Collection accelerators are designed with our most superior applied sciences, delivering management efficiency, and can be in giant scale cloud and enterprise deployments,” stated Victor Peng, president, AMD.
“By leveraging our management {hardware}, software program and open ecosystem strategy, cloud suppliers, OEMs and ODMs are bringing to market applied sciences that empower enterprises to undertake and deploy AI-powered options,” Peng added.
Prospects leveraging the newest AMD Intuition accelerator portfolio embody Dell Applied sciences, Hewlett Packard Enterprise, Lenovo, Meta, Microsoft, Oracle, Supermicro and others.
AMD Intuition MI300X delivers practically 40 per cent extra compute models, 1.5x extra reminiscence capability, 1.7x extra peak theoretical reminiscence bandwidth in addition to help for brand spanking new math codecs resembling FP8 and sparsity — all geared in the direction of AI and HPC workloads.
AMD Intuition MI300X accelerators characteristic class 192GB reminiscence capability in addition to 5.3 TB per second peak reminiscence bandwidth, to ship the efficiency wanted for more and more demanding AI workloads, stated the corporate.
The AMD Intuition Platform is a management generative AI platform constructed on an {industry} normal OCP design with eight MI300X accelerators to supply an {industry} main 1.5TB of HBM3 reminiscence capability.
