adds NVFP4 Fused Adam support#2797

Open

jomitchellnv wants to merge 12 commits intoNVIDIA:mainfrom

jomitchellnv:jm/nvfp4-block-fused-adam

Commits on Apr 9, 2026

adds NVFP4 Fused Adam support

Jonathan Mitchell
authored and
Jonathan Mitchell
committed
Adds testing file

Jonathan Mitchell
authored and
Jonathan Mitchell
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
Jonathan Mitchell
committed
responds to comments in review

Jonathan Mitchell
authored and
Jonathan Mitchell
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
Jonathan Mitchell
committed
addresses greptile comment

Jonathan Mitchell
authored and
Jonathan Mitchell
committed
Changes to commit (3 files):

Jonathan Mitchell
authored and
Jonathan Mitchell
committed
Address review comments in test_nvfp4_fsdp2_hooks.py
Jonathan Mitchell
committed
Only all-gather rowwise data in NVFP4 FSDP2 hooks
Jonathan Mitchell
committed
cudnn fe diff
Jonathan Mitchell
committed

Commits on Apr 10, 2026

Fix NVFP4 FSDP2 allgather test and re-add Float8BlockScaling xfail
Jonathan Mitchell
committed
X
Jonathan Mitchell
committed