Skip to content

Issues: pytorch/torchtune

v0.5.0 tracker
#2008 opened Nov 14, 2024 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

222 Open 524 Closed
222 Open 524 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

how to adapt my new model?
#2077 opened Nov 27, 2024 by belle9217
2
OffloadActivations MemCpy Stream Sync behavior
#2076 opened Nov 27, 2024 by amogkam
2
[Clean up] Use FormattedFiles in configs community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2073 opened Nov 26, 2024 by joecummings
3
CUDA OOM error with supposedly good enough specs according to memory stats output
#2071 opened Nov 26, 2024 by sionhan
4
Checkpoint management in torchtune rfc Request for comments
#2070 opened Nov 25, 2024 by joecummings
LoRA vs. Full designation causes confusing in downstream applications like generation and eval
#2065 opened Nov 25, 2024 by joecummings
Add LR scheduler to PPO recipe community help wanted We would love the community's help completing this issue
#2064 opened Nov 25, 2024 by SalmanMohammadi
Deprecate SimPOLoss community help wanted We would love the community's help completing this issue
#2062 opened Nov 25, 2024 by SalmanMohammadi
1
PPO recipe improvements v.2.1
#2061 opened Nov 25, 2024 by SalmanMohammadi
@SalmanMohammadi
SmolLM2, Request for consideration
#2060 opened Nov 24, 2024 by insop
2
NCCL operations have failed or timed out.
#2059 opened Nov 24, 2024 by Ljyustc
1
OpenCoder, Request for adding a model
#2058 opened Nov 23, 2024 by insop
2
add dataset.packed support for llama 3.2 vision
#2057 opened Nov 23, 2024 by felipemello1
@pbontrager
improve error msg for packed being incompatible
#2056 opened Nov 23, 2024 by felipemello1
error fast when tokenizer=null and dataset.packed=True
#2055 opened Nov 23, 2024 by felipemello1
1
Clean up PyTorch profiler usage in recipes + configs
#2053 opened Nov 22, 2024 by joecummings
improve _optim_ckpt_wrapper so it is a drop in replacement of optimizer best practice Things we should be doing but aren't community help wanted We would love the community's help completing this issue
#2052 opened Nov 22, 2024 by felipemello1
2
Recipe documentation
#2050 opened Nov 22, 2024 by joecummings
1
FullModelHFCheckpointer saved checkpoint isn't compatible with Huggingface transformers model loading high-priority
#2048 opened Nov 21, 2024 by vancoykendall
@joecummings @felipemello1
10
Change llama 3 and 2 configs to use hf ckpt instead of meta ckpt community help wanted We would love the community's help completing this issue
#2045 opened Nov 21, 2024 by felipemello1
PPO slow start
#2044 opened Nov 21, 2024 by felipemello1
@SalmanMohammadi
[BUG] Linter is not capturing issues, like unused arguments bug Something isn't working
#2039 opened Nov 20, 2024 by felipemello1
[BUG] decoder_lora and fusion_lora is a no-op in llama 3.2 vision bug Something isn't working
#2038 opened Nov 20, 2024 by felipemello1
@pbontrager
1
Apply gradient accumulation fix to DPO/PPO recipes
#2037 opened Nov 20, 2024 by SalmanMohammadi
@SalmanMohammadi
update tests and readme cu121 --> cu124
#2036 opened Nov 20, 2024 by felipemello1
1
ProTip! Follow long discussions with comments:>50.