Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

not reproducing results #16

Open
GonyRosenman opened this issue May 15, 2021 · 3 comments
Open

not reproducing results #16

GonyRosenman opened this issue May 15, 2021 · 3 comments

Comments

@GonyRosenman
Copy link

hello,
thanks for sharing your code.
i'm trying to reproduce results but not getting similar accuracy.

steps i took:

  1. download the folder 'hcp_tc_npy_22' from the google drive link that you supplied.
  2. run the preprocessing.py script after configuring the folders.
  3. run the 'run_training.py' script.

i made minor changes such as configuring 'adj_matrix.npy' isntead of 'adj_matrix_qingyu.npy'. (since this adj_matrix is generated automatically in the preprocessing.py script)

the accuracy doesn't go over 55%. what can possibly explain this?

@sgadgil6
Copy link
Owner

Can you try running the run_training.py with import net.st_gcn instead of import net.st_gcn_lstm

@GonyRosenman
Copy link
Author

hello again,
changing to net.st_gcn improved results up to 75-77% accuracy (:
is it possible that the adjacency matrix 'adj_matrix_qingyu.npy' is causing better performance as seen in your paper?
maybe you can give details about how to reproduce this matrix if so.
thanks!

@GMLB1997
Copy link

GMLB1997 commented Sep 27, 2021

I meet the same problem. The results in the paper cannot be reproduced. Only 75-77% accuracy can be achieved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants