Skip to content

Pull requests: pytorch/torchtitan

New pull request New
40 Open 482 Closed
40 Open 482 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

test csv schedule on different runtime CLA Signed This label is managed by the Meta Open Source bot.
#707 opened Nov 27, 2024 by H-Huang • Draft
Support 3rd-party distributed backend CLA Signed This label is managed by the Meta Open Source bot.
#706 opened Nov 27, 2024 by qiongerfei Loading…
1
[do not review]Enable optimizer in backward in TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#705 opened Nov 27, 2024 by mori360 • Draft
3
[WIP] Allow benchmark between multiple configs CLA Signed This label is managed by the Meta Open Source bot.
#703 opened Nov 26, 2024 by H-Huang Loading…
2
W&B wandb support CLA Signed This label is managed by the Meta Open Source bot.
#699 opened Nov 25, 2024 by msaroufim Loading…
6
Configure RNGs appropriately for Pipeline + SPMD CLA Signed This label is managed by the Meta Open Source bot.
#689 opened Nov 22, 2024 by wconstab Loading…
14
necessary changes to unblock Sequence Parallel on odd length sequences CLA Signed This label is managed by the Meta Open Source bot.
#686 opened Nov 20, 2024 by tianyu-l Loading…
5
[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage CLA Signed This label is managed by the Meta Open Source bot.
#685 opened Nov 20, 2024 by XilunWu Loading…
2
[cp] add option to choose kv shards rotation method CLA Signed This label is managed by the Meta Open Source bot.
#684 opened Nov 20, 2024 by XilunWu Loading…
2
[WIP] Adding OBELICS DataLoader CLA Signed This label is managed by the Meta Open Source bot.
#663 opened Oct 30, 2024 by TJ-Solergibert Loading…
1
9
[not for land] torch.compile individual linears CLA Signed This label is managed by the Meta Open Source bot.
#661 opened Oct 29, 2024 by vkuzo Loading…
empty_cache before barrier CLA Signed This label is managed by the Meta Open Source bot.
#660 opened Oct 29, 2024 by carmocca Loading…
2
Use enable_gqa in place of repeat_kv CLA Signed This label is managed by the Meta Open Source bot.
#641 opened Oct 22, 2024 by awgu • Draft
2
Init weights only if not loading a checkpoint CLA Signed This label is managed by the Meta Open Source bot.
#628 opened Oct 18, 2024 by carmocca • Draft
3
[DO NOT REVIEW] gaps to enable FDSP2 cpu offloading CLA Signed This label is managed by the Meta Open Source bot.
#622 opened Oct 16, 2024 by weifengpy Loading…
1
1
[Not for land] Settings to make Llama3-8B on 8 GPUs faster CLA Signed This label is managed by the Meta Open Source bot.
#615 opened Oct 14, 2024 by awgu • Draft
[not for land] TE experiments, take 2 CLA Signed This label is managed by the Meta Open Source bot.
#614 opened Oct 14, 2024 by vkuzo Loading…
[DO NOT REVIEW] --experimental.fsdp_sharding_on_largest_dim CLA Signed This label is managed by the Meta Open Source bot.
#607 opened Oct 9, 2024 by weifengpy Loading…
fix mixed precision for replicate / pure DDP CLA Signed This label is managed by the Meta Open Source bot.
#591 opened Sep 29, 2024 by 152334H Loading…
1
21
[not for land yet] hack max and abs out of ops eligible for AC CLA Signed This label is managed by the Meta Open Source bot.
#580 opened Sep 17, 2024 by vkuzo Loading…
add pp validation for schedule CLA Signed This label is managed by the Meta Open Source bot.
#568 opened Sep 5, 2024 by H-Huang Loading…
3
3d with fp8 in test runner CLA Signed This label is managed by the Meta Open Source bot.
#564 opened Aug 29, 2024 by H-Huang • Draft
[WIP] zero bubble CLA Signed This label is managed by the Meta Open Source bot.
#546 opened Aug 20, 2024 by H-Huang • Draft
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode CLA Signed This label is managed by the Meta Open Source bot.
#536 opened Aug 20, 2024 by weifengpy Loading…
[Not for land] Added changes for GPT-2 perf CLA Signed This label is managed by the Meta Open Source bot.
#533 opened Aug 19, 2024 by awgu • Draft
5
ProTip! Follow long discussions with comments:>50.