Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to enable fp16 instead of bf16 when to train? #1

Open
nobody4t opened this issue Aug 8, 2023 · 0 comments
Open

how to enable fp16 instead of bf16 when to train? #1

nobody4t opened this issue Aug 8, 2023 · 0 comments

Comments

@nobody4t
Copy link

nobody4t commented Aug 8, 2023

Looks like the newer GPU architecure would support bf16. But mine is a little old.
I can change bf16 to fp16 when to train. But the model looks like a bf16 model. is that OK?

Actuall I failed to run the train process due to error below:

requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://huggingface.co/api/repos/create

The above exception was the direct cause of the following exception:

It tried to create a new repo in hf?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant