Skip to content

Pull requests: pytorch/torchtune

New pull request New
89 Open 1,571 Closed
89 Open 1,571 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[wip] decouple rl test job CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2675 opened May 5, 2025 by ebsmothers • Draft
1
Qwen3 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2669 opened May 3, 2025 by prvnsmpth • Draft
7 of 16 tasks
30
[wip] context parallelism CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2668 opened May 2, 2025 by ebsmothers • Draft
9 tasks
6
Re-refactor Linear Loss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2667 opened May 2, 2025 by pbontrager Loading…
9 of 11 tasks
24
Set detail to be false when calling fsspec.ls CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2664 opened May 2, 2025 by ankitageorge Loading…
1 of 10 tasks
1
Update single device recipes to enable async checkpointing for intermediate checkpoints CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2662 opened May 2, 2025 by ankitageorge Loading…
1 of 8 tasks
1
Enable async checkpointing for distributed recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2660 opened May 2, 2025 by ankitageorge Loading…
8 tasks
1
llama4 distributed: compile optimizer CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2659 opened May 2, 2025 by IvanKobzarev Loading…
4
Fix QAT and quantize, add configs for Llama3.1 and 3.2 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2657 opened May 1, 2025 by andrewor14 Loading…
7
Reduce RAM usage when loading state dict for distributed workload CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2656 opened Apr 30, 2025 by Kanya-Mo Loading…
4 of 7 tasks
5
Add Ascend NPU as a backend for distributed recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2646 opened Apr 29, 2025 by Nicorgi Loading…
1 of 4 tasks
7
WIP-DEBUG-PROFILE torch.compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2644 opened Apr 28, 2025 by IvanKobzarev Loading…
2
[DO NOT REVIEW] Handle duplicates in activations offloading CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2628 opened Apr 22, 2025 by janeyx99 • Draft
13 tasks
1
scale_grads with foreach + compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2624 opened Apr 22, 2025 by IvanKobzarev Loading…
21
BIG DPO [Add FP8 support, 2D parallelism, async checkpointing] CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2621 opened Apr 21, 2025 by joecummings • Draft
13 tasks
1
Update yaml configs. Add validation dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2608 opened Apr 17, 2025 by krammnic Loading…
13 tasks
8
Solves #2598 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2599 opened Apr 15, 2025 by nouranali Loading…
3
🐛 [Multi-node Full Fine Tuning Example] Fix file path references and disable fused optimizer
#2575 opened Apr 10, 2025 by brianlechthaler Loading…
3
[WIP]: Eval chat template CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2574 opened Apr 9, 2025 by krammnic Loading…
2 of 13 tasks
1
[WIP - do not review] packing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2548 opened Apr 2, 2025 by felipemello1 • Draft
1
add resize_token_embedding functionality CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2542 opened Apr 1, 2025 by iamzainhuda Loading…
1 of 12 tasks
2
[WIP] Refactor profiler CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2540 opened Mar 31, 2025 by joecummings • Draft
13 tasks
1
[WIP] Minimize all reduces when accumulating gradients CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2539 opened Mar 31, 2025 by joecummings • Draft
1
Revert "nested instantiation" CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2535 opened Mar 28, 2025 by felipemello1 Loading…
2
Full train_on_input deprecation, removing other deprecated components CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2533 opened Mar 27, 2025 by RdoubleA Loading…
1 of 13 tasks
1
ProTip! Adding no:label will show everything without a label.