AMD unveils AI platform strategy and advanced accelerator for generative AI

AMD has announced its comprehensive AI Platform strategy, which encompasses a range of hardware products designed to cater to AI needs from cloud to edge to endpoint.

As part of the announcement, AMD introduced the Instinct MI300X accelerator for generative AI workloads. Built on the next-gen CDNA 3 accelerator architecture, the MI300X boasts up to 192 GB of HBM3 memory to deliver optimal compute and memory efficiency. The accelerator is capable of accommodating large language models, such as the Falcon-40, a 40B parameter model, on a single MI300X accelerator. Additionally, the AMD Instinct Platform integrates eight MI300X accelerators into a standard design, providing a powerful solution for AI inference and training. The MI300X accelerator is expected to be available for sampling to key customers in Q3.

AMD also highlighted its commitment to an open and collaborative AI software ecosystem. The company showcased the ROCm software ecosystem for data center accelerators, which includes collaborations with industry leaders like PyTorch and Hugging Face. The integration of AMD’s ROCm software stack with PyTorch 2.0 enables immediate support for PyTorch on all AMD Instinct accelerators, facilitating the utilization of AI models on AMD’s accelerators.

Hugging Face, known for its open platform for AI builders, announced plans to optimize numerous Hugging Face models for deployment on various AMD platforms, including  Instinct accelerators, Ryzen and EPYC processors, Radeon GPUs, and Versal and Alveo adaptive processors.

[Image courtesy: AMD]

Just in

AlphaSense raises $650M

AlphaSense, a market intelligence and search platform, has raised $650 million in funding, co-led by Viking Global Investors and BDT & MSD Partners.

Elon Musk’s xAI raises $6B to take on OpenAI — VentureBeat

Confirming reports from April, the series B investment comes from the participation of multiple known venture capital firms and investors, including Valor Equity Partners, Vy Capital, Andreessen Horowitz (A16z), Sequoia Capital, Fidelity Management & Research Company, Prince Alwaleed Bin Talal and Kingdom Holding, writes Shubham Sharma. 

Capgemini partners with DARPA to explore quantum computing for carbon capture

Capgemini Government Solutions has launched a new initiative with the Defense Advanced Research Projects Agency (DARPA) to investigate quantum computing's potential in carbon capture.

Snowflake to acquire TruEra AI observability platform

Snowflake has entered into a definitive agreement to acquire TruEra, providers of an AI observability platform. Financial terms of the transaction were not disclosed.