New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Blocked with missing Bert FT steps #41

Open

gbertulf opened this issue May 23, 2024 · 1 comment

gbertulf commented May 23, 2024

To whom this may concern,

Regarding the steps mentioned under 'Packing the Data"

Some queries

Where would input_dir for dataset_path_phase1 or _phase 2 come from?
Tried to run the pretraining script with -h option and got this error, could not find the optimize.py source for scipy module

Lastly,could not download the Data_packing_technique file from the link shared, is there an alternate link?

Alberto-Villarreal commented Nov 20, 2024

@gbertulf Please go to the last supported version of the Data Packing Technique Notebook: https://github.com/HabanaAI/Gaudi-tutorials/blob/f938a47f8787965f908cea03f0cef870f9d2c8ad/TensorFlow/DataPackingMLperfBERT/Data_Packing_Process_for_MLPERF_BERT.ipynb

Please give us some time to answer the two questions. We are looking for someone who can answer them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment