LoReFT

Hyper fast fine tuning for LLMs using PyReft.

See it live and in action 📺

Install pip install torch==2.2.0 transformers pyreft
Replace your HF token with access tokens from here https://huggingface.co/settings/tokens
Run the training pipeline python train.py
Score using the scoring pipeline python score.py

-PyReft:Pyreft library from the awesome Stanford NLP team.

-ReFt Paper:Research paper talking about Representation Fine Tuning.

👨🏾‍💻 Author: Nick Renotte
📅 Version: 1.x
📜 License: This project is licensed under the MIT License

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
README.md		README.md
emoji.csv		emoji.csv
financetemplate.csv		financetemplate.csv
knowledgeoverride.csv		knowledgeoverride.csv
manimdata.csv		manimdata.csv
score.py		score.py
train.py		train.py