Mean Attention Distance in ViT #399
Unanswered
nakashima-kodai
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi
I am wondering how to implement the mean attention distance results they show in Fig. 7 (right) of the paper. I am not quite familiar with transformers. Do you know how to implement the mean attention distance?
Thanks.
Beta Was this translation helpful? Give feedback.
All reactions