Mean Attention Distance in ViT

[nakashima-kodai]

Hi

I am wondering how to implement the mean attention distance results they show in Fig. 7 (right) of the paper. I am not quite familiar with transformers. Do you know how to implement the mean attention distance?

Thanks.