AMD unveils AI platform strategy and advanced accelerator for generative AI

AMD has announced its comprehensive AI Platform strategy, which encompasses a range of hardware products designed to cater to AI needs from cloud to edge to endpoint.

As part of the announcement, AMD introduced the Instinct MI300X accelerator for generative AI workloads. Built on the next-gen CDNA 3 accelerator architecture, the MI300X boasts up to 192 GB of HBM3 memory to deliver optimal compute and memory efficiency. The accelerator is capable of accommodating large language models, such as the Falcon-40, a 40B parameter model, on a single MI300X accelerator. Additionally, the AMD Instinct Platform integrates eight MI300X accelerators into a standard design, providing a powerful solution for AI inference and training. The MI300X accelerator is expected to be available for sampling to key customers in Q3.

AMD also highlighted its commitment to an open and collaborative AI software ecosystem. The company showcased the ROCm software ecosystem for data center accelerators, which includes collaborations with industry leaders like PyTorch and Hugging Face. The integration of AMD’s ROCm software stack with PyTorch 2.0 enables immediate support for PyTorch on all AMD Instinct accelerators, facilitating the utilization of AI models on AMD’s accelerators.

Hugging Face, known for its open platform for AI builders, announced plans to optimize numerous Hugging Face models for deployment on various AMD platforms, including  Instinct accelerators, Ryzen and EPYC processors, Radeon GPUs, and Versal and Alveo adaptive processors.

[Image courtesy: AMD]

Just in

Reddit hasn’t turned a profit in nearly 20 years, but it just filed to go public anyway — CNN

Reddit — which is not yet profitable — says it seeks to grow its business through advertising, more e-commerce offerings and by licensing its data to other companies to train their artificial intelligence models, writes Clare Duffy and John Towfighi.

Leidos awarded $143M Defense Intelligence Agency technology platform contract

Leidos has obtained a task order contract from the Defense Intelligence Agency's (DIA) Science & Technology Directorate. This contract tasks Leidos with the creation and implementation of a comprehensive system for managing open-source intelligence

Staff say Dell’s return to office mandate is a stealth layoff, especially for women — The Register

The implications of choosing to work remotely, we're told, are: "1) no funding for team onsite meetings, even if a large portion of the team is flying in for the meeting from other Dell locations; 2) no career advancement; 3) no career movements; and 4) remote status will be considered when planning or organization changes – AKA workforce reductions," writes Thomas Claburn. 

Orkes raises $20M

Cupertino, CA-based Orkes, a company focused on the scaling of distributed systems, has raised $20 million.

Motorola Solutions appoints Nicole Anasenes to board

Motorola Solutions announced the appointment of Nicole Anasenes to its board of directors. Ms. Anasenes has over two decades of experience in leadership roles across software and services, market development, acquisitions, and business transformation.