Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory_efficient_attention_forward #210

Open
RaykiDan opened this issue Nov 20, 2024 · 0 comments
Open

memory_efficient_attention_forward #210

RaykiDan opened this issue Nov 20, 2024 · 0 comments

Comments

@RaykiDan
Copy link

RaykiDan commented Nov 20, 2024

Try to run the command "python3 run.py --encoder vitl --img-path assets/examples --outdir depth_vis"

But it showed error because of certain operator not found:

NotImplementedError: No operator found for memory_efficient_attention_forward with inputs:
query : shape=(1, 2073, 16, 64) (torch.float32)
key : shape=(1, 2073, 16, 64) (torch.float32)
value : shape=(1, 2073, 16, 64) (torch.float32)
attn_bias : <class 'NoneType'>
p : 0.0
fa2F@v2.5.7-pt is not supported because:
device=cpu (supported: {'cuda'})
dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
cutlassF-pt is not supported because:

How to solve this? Thanks before

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant