Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results on OGBN-Papers100M #31

Open
RX28666 opened this issue Apr 6, 2024 · 6 comments
Open

Results on OGBN-Papers100M #31

RX28666 opened this issue Apr 6, 2024 · 6 comments

Comments

@RX28666
Copy link

RX28666 commented Apr 6, 2024

Hello,

I am wondering if there are any results of GAS on OGBN-Papers100M. (Or results on some datasets larger than ogbn-products)

BTW, since the dataset is so big, preprocessing steps such as partitioning with METIS are unrealistic to implement as usual. I am also wondering if there are any code scripts I can refer to that can help solve this issue.

Thanks.

@rusty1s
Copy link
Owner

rusty1s commented Apr 7, 2024

We didn't test on ogbn-papers100M at this point in time. Given enough RAM, this should definitely work though. I partially agree that METIS becomes infeasible on larger datasets (although all large-scale graph learning variants rely on it to scale), but you can also fallback to random partitioning.

@RX28666
Copy link
Author

RX28666 commented Apr 7, 2024

Thanks for your advice, I will try to run GAS on ogbn-papers100m.

@RX28666
Copy link
Author

RX28666 commented Apr 7, 2024

Hello Matthias,

I also faced a issue when I try to install the package, recently I updated my CUDA to 12.1:

CUDA Version: 12.1
PyTorch Version: 2.2.1+cu121

I tried to install the package in both ways provided, they all returned:

RuntimeError:
      The detected CUDA version (11.6) mismatches the version that was used to compile
      PyTorch (12.1). Please make sure to use the same CUDA versions.

Is this because the current package doesn't support cuda 12.1? Thanks.

@rusty1s
Copy link
Owner

rusty1s commented Apr 8, 2024

You need to re-install this package if you also update your CUDA version.

@RX28666
Copy link
Author

RX28666 commented Apr 8, 2024

Hello,

I deleted the original one by:

pip uninstall pyg_autoscale
WARNING: Skipping pyg_autoscale as it is not installed.

then re-install using
pip install git+https://github.com/rusty1s/pyg_autoscale.git
and also tried
python setup.py install

they both returned the same bug.

The detected CUDA version (11.6) mismatches the version that was used to compile
      PyTorch (12.1). Please make sure to use the same CUDA versions.

Is there anything I was missing? Any help would be appreciated.

@rusty1s
Copy link
Owner

rusty1s commented Apr 11, 2024

Ok, got it. This is IMO expected. You are using your local CUDA version (11.6) to compile this package, while you have PyTorch installed with CUDA version 12.1. What you can do

  • Downgrade PyTorch to use CUDA 11.*
  • Alternatively, update your local CUDA version to 12.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants