Primus technical blogs

September 9, 2026 ยท View on GitHub

Every published article about Primus, newest first. The last column points at the maintained documentation or code for the same topic: a blog is frozen at its publication date, so where the two disagree, the documentation wins. The top-level README lists only the most recent handful.

Published

DateTitleWhat it coversIn this repo
2026/09/03Enabling DeepSeek-V4-Flash Training on AMD Instinct MI355X GPUs with PrimusDeepSeek-V4-Flash architecture, performance projection, kernel optimizations, and how to reproduce the runsexamples/deepseek-v4
2026/08/12Using ODC to Accelerate AMD SFT TrainingOn-demand point-to-point communication replacing the FSDP all-gather / reduce-scatter, over rocSHMEM and MORIODC FSDP2 patches
2026/07/06Primus Tuning Agent: Closing the Configuration-Search LoopLLM-driven search over parallelism, pipeline layout, and recompute sets, scored by projection instead of cluster timeTuning agent
2026/06/10Dropless MoE Training in JAX with Primus-TurboGrouped GEMM brought into MaxText through JAX FFI and custom_vjp, with the fan-out / fan-in correctness detailsMaxText parameters
2026/04/24Primus Projection: Estimate Memory and Performance Before You TrainAnalytical memory estimation and benchmark-anchored throughput projection for multi-node runsProjection
2026/02/23Primus-Pipeline: A More Flexible and Scalable Pipeline Parallelism ImplementationZero-bubble schedules (zerobubble / zbv / v-half / v-min) alongside 1F1B and interleaved, in the Megatron-LM backendParallelism strategies
2026/01/15Deep Dive into Primus: High-Performance Training for Large Language ModelsHow the unified CLI and tuned backend presets reach peak dense-LLM throughput with minimal manual tuningMegatron-LM training
2025/12/16MoE Training Best Practices on AMD GPUsThe foundational MoE optimizations: DeepEP dispatch, sync-free MoE, 1F1B all-to-all overlap, selective recomputeMoE training deep-dive
2025/08/22Primus: A Lightweight, Unified Training Framework for Large Models on AMD GPUsThe framework itself: YAML-driven configuration, multi-backend design, preflight validation, structured loggingProject overview

Awaiting publication

DateTitleWhat it coversIn this repo
2026/08/21MoE Training Optimization with PrimusMegaMoE megakernel, FP8 / MXFP8 grouped GEMM, training-at-scale tuningMegaMoE fused MoE layer

Adding an article

Article sources are maintained in the ROCm Blogs repository, not here. Copies were vendored into this repository once before and drifted out of sync with the published versions, down to stale author lists, so this directory holds the index only. When an article goes live, add a row above and link to rocm.blogs.amd.com rather than adding a copy. Add it to the top-level README too if it belongs in the recent handful, dropping the oldest entry there to keep that list short.