You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Up to now, this repo does not contain the evaluation scripts on GPT-J. Noticing that the MQUAKE dataset is built and filtered such that all single-hop facts are 100% answerable by GPT-J,I suppose that aligning with the generation configuration of GPT-J in your experiments is crutial in reproducing your results or conducting further investigations.
Hence, could you please shed some lights on the config you used over GPT-J? (I understand the limited bandwith, but maybe some references to the conventional settings you used might also be welcomed :)
Thanks.
The text was updated successfully, but these errors were encountered:
Hi, thanks for the amazing project!
Up to now, this repo does not contain the evaluation scripts on GPT-J. Noticing that the MQUAKE dataset is built and filtered such that all single-hop facts are 100% answerable by GPT-J,I suppose that aligning with the generation configuration of GPT-J in your experiments is crutial in reproducing your results or conducting further investigations.
Hence, could you please shed some lights on the config you used over GPT-J? (I understand the limited bandwith, but maybe some references to the conventional settings you used might also be welcomed :)
Thanks.
The text was updated successfully, but these errors were encountered: