List view

Torch symmetric - new latency optimized NVLS communication kernels for sequence parallelism

module: inference

Run tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 1997

#1997 In NVIDIA/Megatron-LM;

· sidsingh-nvidia opened on Oct 28, 2025

[4/4] Merge Megatron-RL into LM

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2002

#2002 In NVIDIA/Megatron-LM;

· tdene opened on Oct 28, 2025

Siddharth/torch symm fused

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2048

#2048 In NVIDIA/Megatron-LM;

· sidsingh-nvidia opened on Oct 30, 2025

ci: POC: Gridify test cases

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2049

#2049 In NVIDIA/Megatron-LM;

· ko3n1g opened on Oct 30, 2025

Fixes for gpt-oss

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2038

#2038 In NVIDIA/Megatron-LM;

· cuichenx opened on Oct 29, 2025

Hybrid Data x Context Parallelism Feature

dev branchDev branch related issues and developmentDev branch related issues and development

enhancementNew feature or requestNew feature or request

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2054

#2054 In NVIDIA/Megatron-LM;

· parthmannan opened on Oct 30, 2025

[Dev] Support packed seq in MTP

dev branchDev branch related issues and developmentDev branch related issues and development

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2043

#2043 In NVIDIA/Megatron-LM;

· BestJuly opened on Oct 30, 2025

Remove MoE throughput test

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2075

#2075 In NVIDIA/Megatron-LM;

· mathemakitten opened on Oct 31, 2025

Nemotron nano v2 vl changes for Megatron Bridge

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2078

#2078 In NVIDIA/Megatron-LM;

· cuichenx opened on Oct 31, 2025

Add minor log update

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2080

#2080 In NVIDIA/Megatron-LM;

· gautham-kollu opened on Nov 1, 2025

Fix NameError in pretrain_retro.py (add import_module), remove unused…

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2084

#2084 In NVIDIA/Megatron-LM;

· vignesh1507 opened on Nov 2, 2025

[Dev] Changes to support multimodule pipelining

dev branchDev branch related issues and developmentDev branch related issues and development

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2092

#2092 In NVIDIA/Megatron-LM;

· yashaswikarnati opened on Nov 3, 2025

chore: Merge main into dev

dev branchDev branch related issues and developmentDev branch related issues and development

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2093

#2093 In NVIDIA/Megatron-LM;

· chtruong814 opened on Nov 3, 2025

Remove redundant reduce in aux_loss logging

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2095

#2095 In NVIDIA/Megatron-LM;

· BestJuly opened on Nov 3, 2025

[Dev] Remove calculation of padding token in moe routing loss

dev branchDev branch related issues and developmentDev branch related issues and development

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2121

#2121 In NVIDIA/Megatron-LM;

· HaochenYuan opened on Nov 4, 2025

feat(moe): Support placing MTP layers into standalone stages

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2136

#2136 In NVIDIA/Megatron-LM;

· BestJuly opened on Nov 5, 2025

M4 + Dist Checkpoint: Replace global parallel state with explicit group parameters

Run tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2053

#2053 In NVIDIA/Megatron-LM;

· dimapihtar opened on Oct 30, 2025

nonuniform tensor parallelism

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2149

#2149 In NVIDIA/Megatron-LM;

· daiyaanarfeen opened on Nov 5, 2025

[Dev] Partial CUDA Graph support for EP Overlap

dev branchDev branch related issues and developmentDev branch related issues and development

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2168

#2168 In NVIDIA/Megatron-LM;

· Wohox opened on Nov 7, 2025

[Main] Support MTP packed-seq in main branch

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2173

#2173 In NVIDIA/Megatron-LM;

· BestJuly opened on Nov 7, 2025

[Dev] test(MoE): Add performance test for MoE layer

dev branchDev branch related issues and developmentDev branch related issues and development

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2177

#2177 In NVIDIA/Megatron-LM;

· Victarry opened on Nov 7, 2025

remove flattened_range code paths

Run tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2126

#2126 In NVIDIA/Megatron-LM;

· dimapihtar opened on Nov 4, 2025

Break apart dynamic inference step into 2 methods

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Run tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2192

#2192 In NVIDIA/Megatron-LM;

· tdene opened on Nov 10, 2025

Explicitly zero out padding token activations for dynamic inference

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2008

#2008 In NVIDIA/Megatron-LM;

· santhnm2 opened on Oct 28, 2025

Fix Mamba TP and remove confusing legacy initialization

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2202

#2202 In NVIDIA/Megatron-LM;

· jaredcasper opened on Nov 11, 2025