Skip to content

Issues: pytorch/torchtune

v0.7.0 tracker
#2538 opened Mar 30, 2025 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

281 Open 704 Closed
281 Open 704 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How to QAT the Llama-3b backbone model?
#2658 opened May 1, 2025 by webbigdata-jp
[Multi-Node] Test recipes/knowledge_distillation_distributed.py on a multi-node setup community help wanted We would love the community's help completing this issue good first issue Good for newcomers testing
#2649 opened Apr 29, 2025 by joecummings
1
Set log level for all recipes from the config community help wanted We would love the community's help completing this issue enhancement New feature or request good first issue Good for newcomers
#2648 opened Apr 29, 2025 by joecummings
1
Support Qwen3 enhancement New feature or request
#2645 opened Apr 29, 2025 by pocca2048
2
Potential tensor parallelism accuracy issues
#2641 opened Apr 28, 2025 by nathan-az
@joecummings
6
QAT LoRA related files for Qwen2.5 discussion Start a discussion
#2640 opened Apr 27, 2025 by altria-zewei-wang
@joecummings
1
Rename LoRATrainable enum community help wanted We would love the community's help completing this issue
#2636 opened Apr 25, 2025 by ebsmothers
Error when running generate_v2_distributed with Llama3 70b
#2635 opened Apr 25, 2025 by AugustoCapone
2
triton and edge device support
#2634 opened Apr 25, 2025 by moghadas76
1
torchtune + vLLM discussion Start a discussion
#2632 opened Apr 23, 2025 by haydn-jones
@joecummings
2
Is there a way to get PreferenceDataset to support packing?
#2631 opened Apr 23, 2025 by iqiancheng
@SalmanMohammadi
1
Is there a plan to support Qwen2_5 DPO (full or LoRA)?
#2630 opened Apr 23, 2025 by iqiancheng
@SalmanMohammadi
1
Support tensor parallelism with FP8 training
#2629 opened Apr 23, 2025 by nathan-az
1
1
Does torchtune require specific torch version?
#2625 opened Apr 22, 2025 by janeyx99
@joecummings
9
Add tool calling to ShareGPTToMessages Transform enhancement New feature or request
#2618 opened Apr 21, 2025 by joecummings
@joecummings
2
Add tool calling to OpenAIToMessages Transform enhancement New feature or request
#2617 opened Apr 21, 2025 by joecummings
@joecummings
2
Error when running a llama-2-70b-qkv-mlperf model discussion Start a discussion
#2614 opened Apr 19, 2025 by kailashg26
@joecummings
10
support for multigpu PPO enhancement New feature or request
#2606 opened Apr 17, 2025 by parthsarthi03
@joecummings @ebsmothers
3
How to try with FP8 for LLM finetuning? discussion Start a discussion
#2600 opened Apr 15, 2025 by kailashg26
@ebsmothers
9
Qwen Student and teacher logits mismatch during KD, needs padding
#2598 opened Apr 15, 2025 by nouranali
1
vllm support for qat model discussion Start a discussion
#2597 opened Apr 15, 2025 by mces89
@ebsmothers @drisspg
5
_generation token mask error
#2590 opened Apr 14, 2025 by xueyan-lii
1
Error when running torchtune llama-4 on MI300
#2586 opened Apr 11, 2025 by kailashg26
@ebsmothers
17
Triton/Inductor shared memory issues with newer pytorch versions bug Something isn't working
#2572 opened Apr 8, 2025 by nathan-az
3
deepspeed backend in torchtune?
#2569 opened Apr 7, 2025 by albert-inflection
1
ProTip! no:milestone will show everything without a milestone.