What is the intuition of negative attention?

[wanglu2014]

What does negative attention mean? It doesn't matter, or is it kind of a negative correlation?

[rusty1s]

I'm not sure to which GNN operator you are referring to. Attention scores usually to fit the interval [0, 1], e.g., via the softmax function.

[wanglu2014]

It is attention weight of GAT. Before softmax, the weights contain both negative and positive values.

[rusty1s]

Yes, high negative values will push the values after softmax close to zero.

[adhikarirsr]

Before Softmax e_{ij} can be negative as well as all positive because of LeakyReLU. However, as pointed out by @rusty1s using softmax it is normalized. It is explained pretty nicely here: https://www.youtube.com/watch?v=A-yKQamf2Fc&ab_channel=DeepFindr