Skip to content

Pull requests: huggingface/trl

New pull request New
72 Open 1,441 Closed
72 Open 1,441 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

💠 Fix multi-gpu padding free
#3245 opened Apr 6, 2025 by qgallouedec Loading…
5 tasks
1
2
🗑️ Deprecate ConstantLengthDataset
#3242 opened Apr 6, 2025 by qgallouedec Loading…
5 tasks
1
Add Fine-tuning a Multimodal Model Using SFT (Single or Multi-Image Dataset) guide to docs
#3235 opened Apr 4, 2025 by sergiopaniego • Draft
1 of 7 tasks
14
[GRPO] Adds option to disable dropout
#3234 opened Apr 4, 2025 by edbeeching Loading…
6
[GRPO] Adds an option to scale the loss by a constant factor
#3231 opened Apr 4, 2025 by edbeeching Loading…
6
overlong filtering
#3229 opened Apr 4, 2025 by shirinyamani Loading…
5 tasks
13
remove unused optimizer config in prepare_deepspeed
#3228 opened Apr 3, 2025 by liguohao96 Loading…
1 of 5 tasks
3
Add a raw generate API to the vLLM server
#3227 opened Apr 3, 2025 by wilrop Loading…
5 tasks
3
Support iterable datasets in GRPO
#3226 opened Apr 3, 2025 by wilrop Loading…
5 tasks
1
3
Fix online DPO crash when model is a DataParallel object
#3225 opened Apr 3, 2025 by wilrop Loading…
5 tasks
1
3
feat(trainer): Support multi-role & consecutive turns in DataCollatorForCompletionOnlyLM (#3223)
#3224 opened Apr 3, 2025 by Kirili4ik Loading…
4 tasks done
1
update weight update process group
#3211 opened Apr 2, 2025 by ji-huazhong • Draft
5 tasks
Adding sampling parameters for vllm generation
#3210 opened Apr 2, 2025 by shaipranesh2 Loading…
6
Support for Models With Pre-Finetuned LoRA Adapters in GRPO: Add use_peft_as_reference Flag
#3196 opened Mar 31, 2025 by LoganVegnaSHOP Loading…
5 tasks done
1
7
GRPO: Scalable training with one LLM/node
#3186 opened Mar 31, 2025 by jglaser Loading…
2 of 5 tasks
🚀 Enhance GRPO VLLM server from sync to async and accelerate training
#3182 opened Mar 30, 2025 by binary-husky Loading…
3
Co-Locating vLLM w/ training to achieve higher throughput and GPU utilization
#3162 opened Mar 26, 2025 by toslali-ibm Loading…
2 of 5 tasks
1
14
🏃 Fix and make CI faster
#3160 opened Mar 25, 2025 by qgallouedec Loading…
8
📦 [SFT] Deprecate batched formatting_func
#3147 opened Mar 24, 2025 by YeFD Loading…
4 of 5 tasks
9
Fix length bias for Dr GRPO
#3138 opened Mar 23, 2025 by idoru Loading…
5 tasks
24
Extend BCO Trainer dataset format support
#3134 opened Mar 22, 2025 by reihig-ut Loading…
1 of 5 tasks
Add GRPO/ Online DPO support for quantitative models when use vllm as infer backbone.
#3133 opened Mar 22, 2025 by maoulee Loading…
5
improvement(utils.py): simplify repeating completion string
#3122 opened Mar 20, 2025 by tpoisonooo Loading…
6
feat: Add Interleaved Trainer implementation
#3107 opened Mar 18, 2025 by ucalyptus2 Loading…
3 tasks done
1
Update sft trainer to include better packing
#3100 opened Mar 17, 2025 by Ishan-Kumar2 Loading…
4 tasks done
1
3
ProTip! Add no:assignee to see everything that’s not assigned.