通过ORPO的方法微调llama3
创新点：结合SFT和对齐学习的新尝试
环境：最好使用colab L4（需要开PRO）
参考论文《ORPO: Monolithic Preference Optimization without Reference Model》
reference to blog:https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html
-
Notifications
You must be signed in to change notification settings - Fork 0
howardchiang2/fine_tune_llama3_with_ORPO
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
通过ORPO的方法微调llama3
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published