Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gem 预训练权重问题 #355

Open
reese-lee1 opened this issue Nov 1, 2024 · 5 comments
Open

gem 预训练权重问题 #355

reese-lee1 opened this issue Nov 1, 2024 · 5 comments

Comments

@reese-lee1
Copy link

请问给出再gem项目中,给出的与训练class和regr的pdparams文件,是如何筛选出的,我在使用zinc与训练后的得到的每个epoch的pdparams
thk

@Noisyntrain
Copy link
Collaborator

Hi reese-lee1, 感谢你的PaddleHelix的关注和支持,GEM中class和regr的pdparams是在各自的预训练任务配置下在10%的评估集上选取出的最好结果。因为距今的时间跨度较长,我们正在确认当时的任务配置中,如果有了结果会通知您

@reese-lee1
Copy link
Author

感谢你的回复,请问文档里里的class和regr是使用pretrain运行得到吗,但是我在运行pretrain后并没有得到类似的权重文件

@Noisyntrain
Copy link
Collaborator

是的,class和regr对应是所选取的某个epoch的pdparms。所有的epoch pdparms应当储存在./pretrain_models/zinc 文件夹或您自己定义的model_dir下

@reese-lee1
Copy link
Author

请问选取class和regr对应epoch的标准分别是什么,因为只能看到每个epoch所对应的loss值。看到演示的zinc数据集只有2k左右,请问你们在真实获取最佳class和regr是用zinc15里的2千万吗,如果能告知更多关于获取class和regr的细节将不胜感激。再次感谢你的回复与解释

@reese-lee1
Copy link
Author

image
这是返回格式烦请解释

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants