Search results

Checkpointer Feature Enhancements

better engineeringRepo code quality improvementsRepo code quality improvements

enhancementNew feature or requestNew feature or request

module: checkpoint

Status: Open.

Feature

#1262 In pytorch/torchtitan;

· fegin opened on Jun 4, 2025

[Deepseek] Router collapse on deepseek training loop

enhancementNew feature or requestNew feature or request

Status: Open.

#1246 In pytorch/torchtitan;

· xuanzhang816 opened on May 30, 2025

Save RNG states during checkpointing for deterministic debugging

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#1194 In pytorch/torchtitan;

· wwwjn opened on May 14, 2025

Can we support outputting checkpoints directly in .pt format?

enhancementNew feature or requestNew feature or request

module: checkpoint

Status: Open.

#1177 In pytorch/torchtitan;

· andrewor14 opened on May 9, 2025

[DeepSeek MoE] current workstream planning

enhancementNew feature or requestNew feature or request

Status: Open.

#1125 In pytorch/torchtitan;

· lessw2020 opened on Apr 21, 2025

[Feature] Add Multi-Token Prediction module

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#933 In pytorch/torchtitan;

· lessw2020 opened on Mar 5, 2025

Mitigation to HuggingFace Trainer

enhancementNew feature or requestNew feature or request

huggingface integration

Status: Open.

#824 In pytorch/torchtitan;

· huyiwen opened on Feb 6, 2025

HunyuanVideo Support

enhancementNew feature or requestNew feature or request

Status: Open.

#768 In pytorch/torchtitan;

· bendanzzc opened on Jan 2, 2025

DeepSeek V3 Support

enhancementNew feature or requestNew feature or request

Status: Open.

#760 In pytorch/torchtitan;

· casper-hansen opened on Dec 26, 2024

[question]can't disable CP for specific (unsupported) SDPA op

enhancementNew feature or requestNew feature or request

module: context parallel

Status: Open.

#757 In pytorch/torchtitan;

· FindDefinition opened on Dec 20, 2024

Any plans to support DPO training?

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#756 In pytorch/torchtitan;

· xs1997zju opened on Dec 20, 2024

[Parallelism] Implement vocabulary parallelism

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#680 In pytorch/torchtitan;

· casper-hansen opened on Nov 15, 2024