Skip to content

Fetch from nvidia Megatron-LM #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
RaymondLi0 wants to merge 6,525 commits into
base: load-iter
Choose a base branch
from
Open

Fetch from nvidia Megatron-LM #5

RaymondLi0 wants to merge 6,525 commits into from

Conversation

@RaymondLi0
Copy link

@RaymondLi0 RaymondLi0 commented Aug 3, 2022

No description provided.

ko3n1g and others added 30 commits January 9, 2026 12:10
@ko3n1g
tests: Disable Mamba MOE model test after 43b4471 (#2886)
74db1ce 
Signed-off-by: oliver könig <[email protected]>
@jon-barker
Fix mamba moe unit test after commit reversion (#2888)
7fe7f48
@jon-barker
Improve error messages in mamba moe unit test (#2889)
ed461d6
@santhnm2 @shanmugamr1992
Use DynamicInferenceCoordinator for text generation server (#1910)
c0b2859 
Signed-off-by: Keshav Santhanam <[email protected]>
Co-authored-by: shanmugamr1992 <[email protected]>
Co-authored-by: Shanmugam Ramasamy <[email protected]>
@yobibyte
Fix inference server to make nemogym work. (#2887)
980a271
@maanug-nv
[training migration] add RNG config dataclass (#2347)
4e0eac4 
Signed-off-by: Maanu Grover <[email protected]>
@maanug-nv
[training migration] Add RerunStateMachineConfig dataclass (#2436)
7ff3a2d 
Signed-off-by: Maanu Grover <[email protected]>
@deepakn94
Add retry loop with exponential backoff in dataloader as a form of in…
1f6edf0 
…-application fault tolerance (#2836)

Signed-off-by: Deepak Narayanan <[email protected]>
@maanug-nv
[training migration] Add SchedulerConfig dataclass (#2400)
718d6c2 
Signed-off-by: Maanu Grover <[email protected]>
@mathemakitten
RL: Fix cu_seqlens construction for PackedSeqParams (#2883)
1a244a5
@ko3n1g
Revert "RL: Fix cu_seqlens construction for PackedSeqParams (#2883)"
f00fb9a 
This reverts commit 1a244a5.
@cuichenx @yaox12
[MoE] Apply grouped gemm bias before unpadding for FP8 (#2817)
8b4e00c 
Co-authored-by: Xin Yao <[email protected]>
@maanug-nv
[training migration] Add ProfilingConfig dataclass (#2393)
dabc39b 
Signed-off-by: Maanu Grover <[email protected]>
@Phlip79
Update Slack user group when oncall changes (#2859)
ba3fd4f
@santhnm2
Remove unused FlashAttention3 args (#2898)
4fc7935 
Signed-off-by: Keshav Santhanam <[email protected]>
@Phlip79
Use different token for assign logic (#2893)
438f2cf
@ko3n1g
chore: Add --no-container-mount-home to script (#2906)
7b7e687 
Signed-off-by: oliver könig <[email protected]>
@ko3n1g
build: Bump deps (#2911)
e068944 
Signed-off-by: oliver könig <[email protected]>
@yaoyu-33 @dimapihtar @Phlip79
feat: m4 leftover changes (#2506)
6704731 
Signed-off-by: dimapihtar <[email protected]>
Co-authored-by: Mcore Bot <[email protected]>
Co-authored-by: Dmytro Pykhtar <[email protected]>
Co-authored-by: dimapihtar <[email protected]>
Co-authored-by: Philip Petrakian <[email protected]>
@tdene
Fix RL sequence packing bin size (#2909)
ce2cc40
@chtruong814 @santhnm2
Revert "Remove unused FlashAttention3 args (#2898)" (#2916)
3f6ad46 
Signed-off-by: Charlie Truong <[email protected]>
Co-authored-by: Keshav Santhanam <[email protected]>
@ko3n1g
Revert "feat: m4 leftover changes (#2506)"
f967176 
This reverts commit 6704731.
@chtruong814
ci: Skip broken tests after dependency bump (#2934)
8d826c1 
Signed-off-by: Charlie Truong <[email protected]>
@ko3n1g
build: Downgrade flashinfer
b71059a 
Signed-off-by: oliver könig <[email protected]>
@ko3n1g
Reapply "feat: m4 leftover changes (#2506)"
8918762 
This reverts commit f967176.
@ko3n1g
Reapply "Remove unused FlashAttention3 args (#2898)" (#2916)
b7a9d36 
This reverts commit 3f6ad46.
@ko3n1g
Revert "ci: Skip broken tests after dependency bump (#2934)"
d6af382 
This reverts commit 8d826c1.
@ko3n1g
Ko3n1g/build/downgrade flashinfer (#2937)
2490e0c 
Signed-off-by: oliver könig <[email protected]>
@chtruong814
ci: Skip unit test cleanup (#2940)
5241224 
Signed-off-by: Charlie Truong <[email protected]>
@zhongbozhu @Phlip79
[MAIN][NVFP4][MOE] 128 Zero Padding for Grouped Quantization kernels …
fe87250 
…and Cuda Graph Support (#2655)

Signed-off-by: Zhongbo Zhu <[email protected]>
Co-authored-by: Philip Petrakian <[email protected]>
ahmadki and others added 30 commits February 2, 2026 06:34
@ahmadki
Handle step key correctly in checkpoint save with `--optimizer-cpu-…
f4502eb 
…offload` (#2874)
@BestJuly @maanug-nv
mRoPE for MTP (#3114)
70719cd 
Co-authored-by: Maanu Grover <[email protected]>
@deepakn94
Fix two minor bugs in MTP implementation for hybrid models (#3194)
e836e62 
Signed-off-by: Deepak Narayanan <[email protected]>
@mvirts @dimapihtar
Update README.md (#2111)
1362e4a 
Co-authored-by: Dmytro Pykhtar <[email protected]>
@ko3n1g
Revert "Fix two minor bugs in MTP implementation for hybrid models (#…
31d0c87 
…3194)"

This reverts commit e836e62.
@ko3n1g
Revert "Add MTP support for hybrid models (#2363)"
a0cc8ca 
This reverts commit 300d1b6.
@duncanriach @asolergi-nv
Fix bug in SFTDataset (#3185)
50546da 
Co-authored-by: Antoni-Joan Solergibert <[email protected]>
@HollowMan6 @dimapihtar @yaox12
Fix several syntax error (#3004)
dff4189 
Signed-off-by: Hollow Man <[email protected]>
Co-authored-by: Dmytro Pykhtar <[email protected]>
Co-authored-by: Xin Yao <[email protected]>
@wdykas @dimapihtar
Fix for RL Test (#3148)
c4bea0a 
Co-authored-by: Dmytro Pykhtar <[email protected]>
@buptzyb
Fix latent moe flops and backward_dw (#2977)
a4008d0 
Signed-off-by: Robin Zhang <[email protected]>
@shengf-nv
Use global user buffer when the bucket size does not fit FixedPoolAll…
afe443b 
…ocator (#2857)
@ko3n1g
ci: Checkpoint retention (#3205)
78475fe 
Signed-off-by: oliver könig <[email protected]>
@venmugil @yaox12
Add unit test for LatentMoE (#2892)
7080697 
Co-authored-by: Xin Yao <[email protected]>
@ko3n1g
ci: Enable unit tests on merge-queue (#3186)
0028273 
Signed-off-by: oliver könig <[email protected]>
@mathemakitten
Fix seq pack flag in get_logprobs (#3206)
94c9eae
@ko3n1g
ci(fix): Parse unit tests in merge-queue (#3224)
b477d12 
Signed-off-by: oliver könig <[email protected]>
@BestJuly @jaredcasper
Fix TE 2.12 AllGather CI failure (#3101)
1a61b77 
Co-authored-by: Jared Casper <[email protected]>
@ko3n1g
ci(hotfix): Pin uv (#3233)
79e7bfe 
Signed-off-by: oliver könig <[email protected]>
@mathemakitten
Add a unit test to check that RL get_logprobs will reuse training c…
18d69f1 
…udagraphed forward pass (#3209)
@mathemakitten
Do not offload grad buffers when training graphs are enabled (#3231)
27a5f83
@parthmannan
Fix missing PackedSeqParams import (#3214)
bc2eb9a
@santhnm2
Synchronize the request counts for EP inference with strict matching (#…
1fdb29f 
…3033)

Signed-off-by: Keshav Santhanam <[email protected]>
@tdene
Do not let requests fail silently inside inference engine (#3228)
e02344e
@github-actions
Update copy-pr-bot.yaml [skip ci]
4c48248
@tdene
Fix coordinator address collision check in flask (#3208)
9050d5b
@wdykas
torch saver inference model offload (#3170)
cd5ed74
@Autumn1998
enable cuda graph ut (#3197)
982ca5d
@wplf
Support EP with HSDP (#2840)
473e283 
Signed-off-by: jinliangl <[email protected]>
Co-authored-by: Jinliang Li <[email protected]>
Co-authored-by: Jinliang Li <[email protected]>
@BestJuly
[Main] Add the missing part to support 1F1B overlap for Qwen3-Next (#…
4a23972 
…2997)
@parthmannan
Missing import fix (#3241)
c036e77
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.