Skip to content

Pull requests: axolotl-ai-cloud/axolotl

New pull request New
57 Open 1,250 Closed
57 Open 1,250 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add finetome dataset to fixtures, check eval_loss in test
#2106 opened Nov 26, 2024 by winglian Loading…
Check torch version for ADOPT optimizer + integrating new ADOPT updates
#2104 opened Nov 25, 2024 by bursteratom Loading…
14
fix: update trainer.log signature waiting on upstream
#2103 opened Nov 25, 2024 by NanoCode012 • Draft
1 task
1
fix: ds3 and fsdp lmbench eval ready to merge
#2102 opened Nov 25, 2024 by NanoCode012 Loading…
12 tasks done
1
2
Add ds model card, rebased
#2101 opened Nov 24, 2024 by bursteratom Loading…
12
add e2e tests for Unsloth qlora and test the builds
#2093 opened Nov 20, 2024 by winglian Loading…
14
feat: add cut_cross_entropy
#2091 opened Nov 20, 2024 by NanoCode012 Loading…
4 of 5 tasks
10
Add Exact Deduplication Feature to Preprocessing Pipeline
#2072 opened Nov 18, 2024 by olivermolenschot Loading…
1 task done
1
23
fix(vlm): handle legacy conversation data format and check image in data
#2018 opened Nov 7, 2024 by NanoCode012 Loading…
7
refactor(optimizer): use optimizer_cls_and_kwargs for custom optim waiting on upstream
#2012 opened Nov 4, 2024 by NanoCode012 • Draft
2 of 6 tasks
add soap optimizer support
#1978 opened Oct 17, 2024 by winglian Loading…
1
shampoo optim support
#1919 opened Sep 18, 2024 by winglian Loading…
2
support seperate lr for embeddings, similar to loraplus
#1910 opened Sep 12, 2024 by winglian Loading…
Add Llama 3.1 Instruct Chat template, Ensure Correctness of 3, Small Refactor of Chat Template registration for shareGPT
#1903 opened Sep 7, 2024 by alpayariyak Loading…
3
multipack support for phi moe
#1870 opened Aug 26, 2024 by winglian Loading…
drop valueerror as this was from when 4bit required gptq
#1857 opened Aug 22, 2024 by winglian Loading…
1
semi-weekly 8bit lora zero3 check hold don't merge this yet
#1852 opened Aug 22, 2024 by winglian Loading…
2
fix so inference can be run against quantized models without adapters
#1834 opened Aug 19, 2024 by winglian Loading…
add q-galore optimizer
#1752 opened Jul 14, 2024 by winglian Loading…
3
Implements SPPO Alignment Algoritm
#1735 opened Jul 11, 2024 by kaykyr Loading…
1 of 3 tasks
10
Update multi-node.qmd
#1688 opened Jun 7, 2024 by shahdivax Loading…
15
jagged lr restart scheudler
#1680 opened Jun 3, 2024 by winglian Loading…
add support for SPPO
#1585 opened May 2, 2024 by winglian Loading…
WIP test out new dockerfile with more nvidia tools
#1557 opened Apr 21, 2024 by winglian Loading…
Add experimental install guide for ROCm
#1550 opened Apr 19, 2024 by xzuyn Loading…
6
ProTip! Filter pull requests by the default branch with base:main.