AMD (AMD) Advancing AI 2024 summary

Strategic vision and AI industry outlook

• Emphasized high-performance computing as foundational for modern AI, with a focus on energy efficiency, open software, and ecosystem partnerships.

• Outlined four key themes: best compute engines, open developer-friendly software, co-innovation with partners, and comprehensive solutions from chip to data center.

• Projected the data center AI accelerator market to grow to $500B by 2028, driven by rapid AI adoption and larger models.

• Highlighted the importance of open standards and collaboration across the industry to accelerate AI innovation.

• Stressed the role of AI in transforming industries, enhancing productivity, and enabling new experiences over the next decade.

Product launches and technology advancements

• Introduced 5th Gen EPYC CPUs (Turin) with Zen 5 core, offering up to 192 cores, 5 GHz frequency, and industry-leading performance per core and per socket.

• Demonstrated significant performance gains over competitors in AI, analytics, databases, and supercomputing workloads.

• Launched MI325X Instinct accelerator with 256GB HBM3E memory, 6TBps bandwidth, and up to 40% better inference performance than competitors.

• Previewed MI350 series with CDNA 4 architecture, 288GB HBM3E, new FP4/FP6 data types, and a 35x generational AI performance leap, launching in 2H 2025.

• Announced new networking products: Salina 400 DPU and Pollara 400 AI NIC, supporting Ultra Ethernet Consortium standards for high-performance AI networking.

Customer and partner collaborations

• Google Cloud, Oracle, Meta, and Microsoft shared success stories deploying EPYC CPUs and Instinct GPUs for AI and cloud workloads, citing performance, efficiency, and TCO benefits.

• Meta deployed over 1.5 million EPYC CPUs and rapidly adopted MI300X for Llama 405B inference, citing large memory and TCO advantages.

• Databricks, Fireworks, Essential, and Luma highlighted seamless integration and performance gains with MI300X and ROCm, enabling rapid AI model deployment.

• Dell, HPE, Supermicro, and Lenovo announced new server platforms and edge solutions optimized for AMD CPUs and GPUs, with record-setting benchmarks and energy efficiency.

• Microsoft and Lenovo introduced Copilot+ PCs powered by Ryzen AI Pro, delivering advanced AI experiences, security, and battery life for enterprise users.