add: DFlash block diffusion speculative decoding#1128

Open

ChenhanYu wants to merge 24 commits intomainfrom

chenhany/dflash

Commits on Apr 1, 2026

add: DFlash block diffusion speculative decoding
ChenhanYu
committed
fix: rewrite DFlash to match SpecForge reference
ChenhanYu
committed
fix: correct mask_token_id and base model forward dispatch
ChenhanYu
committed
add: auto-detect mask_token_id for DFlash across model families
ChenhanYu
committed
fix: prevent DDP deadlock during AR validation
ChenhanYu
committed
fix: avoid DynamicModule dispatch loop in forward/training paths
ChenhanYu
committed
fix: revert training/eval to super().forward() matching EAGLE pattern
ChenhanYu
committed
fix: DDP deadlock when no valid loss positions on a rank
ChenhanYu
committed
add: logit distillation option for DFlash training
ChenhanYu
committed
fix: print training accuracy to console at each log step
ChenhanYu
committed
fix: use response-only loss mask for DFlash training
ChenhanYu
committed
fix: apply assistant_masks to labels in LanguageDataCollator
ChenhanYu
committed
fix: robust response-only loss mask via regex assistant span detection
ChenhanYu
committed
docs: add DFlash section to speculative decoding README

ChenhanYu
and
claude
committed
fix: resolve DFlash components from base model architecture

ChenhanYu
and
claude
committed
fix: enable response-only loss mask for DFlash training

ChenhanYu
and
claude
committed
add: DFlash launcher example for Qwen3-8B

ChenhanYu
and
claude
committed
fix: inline values in DFlash launcher YAML for --yaml compatibility

ChenhanYu
and
claude
committed
add: unit tests for DFlash speculative decoding

ChenhanYu
and
claude
committed
fix: add docstrings to DFlash classes for coverage check

ChenhanYu
and
claude
committed
add: AR validation step to DFlash launcher pipeline

ChenhanYu
and
claude
committed
fix: split DFlash tests into CPU (unit) and GPU tests

ChenhanYu
and
claude
committed
fix: correct DFlash attention mask test for reverse-causal pattern

ChenhanYu
and
claude
committed
fix: remove __init__.py from GPU test dirs to avoid conftest conflict

ChenhanYu
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add: DFlash block diffusion speculative decoding#1128

add: DFlash block diffusion speculative decoding#1128
ChenhanYu wants to merge 24 commits intomainfrom
chenhany/dflash

Commits on Apr 1, 2026

add: DFlash block diffusion speculative decoding

fix: rewrite DFlash to match SpecForge reference

fix: correct mask_token_id and base model forward dispatch

add: auto-detect mask_token_id for DFlash across model families

fix: prevent DDP deadlock during AR validation

fix: avoid DynamicModule dispatch loop in forward/training paths

fix: revert training/eval to super().forward() matching EAGLE pattern

fix: DDP deadlock when no valid loss positions on a rank

add: logit distillation option for DFlash training

fix: print training accuracy to console at each log step

fix: use response-only loss mask for DFlash training

fix: apply assistant_masks to labels in LanguageDataCollator

fix: robust response-only loss mask via regex assistant span detection

docs: add DFlash section to speculative decoding README

fix: resolve DFlash components from base model architecture

fix: enable response-only loss mask for DFlash training

add: DFlash launcher example for Qwen3-8B

fix: inline values in DFlash launcher YAML for --yaml compatibility

add: unit tests for DFlash speculative decoding

fix: add docstrings to DFlash classes for coverage check

add: AR validation step to DFlash launcher pipeline

fix: split DFlash tests into CPU (unit) and GPU tests

fix: correct DFlash attention mask test for reverse-causal pattern

fix: remove init.py from GPU test dirs to avoid conftest conflict