# AMD MI325X Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/amd-mi325x
> Markdown URL: https://aitinkerers.org/technologies/amd-mi325x.md
> Technology record last updated: 2026-04-01T17:51:46Z
> Generated: 2026-09-22T18:42:03Z

The AMD Instinct MI325X is a CDNA 3-based accelerator delivering 2.61 PFLOPs (FP8 peak) and 256GB HBM3E memory for leadership AI training and large-scale inference.

The AMD Instinct MI325X is engineered for the most demanding generative AI and HPC workloads: it's a powerhouse accelerator built on the 3rd Gen CDNA 3 architecture. We've equipped this OAM module with an industry-leading 256GB of HBM3E memory and a massive 6 TB/s of peak bandwidth, enabling a single GPU to handle trillion-parameter models. For raw compute, expect up to 2.61 PFLOPs of FP8 peak performance (with structured sparsity, up to 5.22 PFLOPs), all optimized through the open-source ROCm™ software ecosystem. This is the next-gen solution for data centers scaling up large language model (LLM) training and high-throughput inference.

- Official technology site: https://www.amd.com/en/products/accelerators/instinct/mi300-series/mi325x.html
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Assembly of Experts: Linear-time construction of ultra-large language model variants](https://munich.aitinkerers.org/talks/rsvp_5nHjZ4TDvtA)

Requiring 10^13-10^15 FLOPs to calculate one 8 bit weight in an LLM is inefficient and not beautiful. Therefore, we developed the new "Assembly-of-Experts" construction method. It allows to create meaningful child variants of existing Mixture-of-Experts parent models in linear time. For this, parts of the parent models are recombined, guided by structural and semantic features. Using AoE, we constructed the DeepSeek R1T "Chimera", a 671B open-weights hybrid model combining DeepSeek's V3-0324 and R1 model variants. The child is achieving about R1-level intelligence, while using about 40% fewer output tokens, close to V3. Constructed without any fine-tuning or distillation, the Chimera exhibits surprisingly compact, orderly reasoning compared to its parent models. Moreover, it showed behaviour outside of the distribution, i.e. it is not just an interpolation of the parent models. Community response has been encouraging. The model has 8,200 downloads on Hugging Face and, at peak at the end of May, reached 1.35 billion processed tokens per day on OpenRouter and almost 5 billion tokens per day on chutes.ai. Since then, we have developed the second generation, DeepSeek-TNG R1T2 Chimera. It is a Tri-Mind that also leverages the new R1-0528, and uses a more refined construction method. It appears to be 20% faster than R1, while being almost always more intelligent. It is not quite as intelligent as R1-0528, but typically more than twices as fast, and also with a beautiful chain of thought like R1T. Since R1T2s release on OpenRouter on July 7th, it reached 1 billion tokens per day already on its first full day of operation. It broke 2 B/d on July 17th and grew to become the 5th most popular LLM on Chutes on July 19th. It currently runs on 30 Chutes instances of 8xH200 each, totalling 240 H200 GPUs.

- Event context: AI Tinkerers Munich - July 25 — 2025-07-25 — Munich
- Public talk page: https://munich.aitinkerers.org/talks/rsvp_5nHjZ4TDvtA

## Related Technologies

- [DeepSeek](https://aitinkerers.org/technologies/deepseek) ([Markdown](https://aitinkerers.org/technologies/deepseek.md)) — 12 public demos
- [vLLM](https://aitinkerers.org/technologies/vllm) ([Markdown](https://aitinkerers.org/technologies/vllm.md)) — 33 public demos