attention is not explanation, but it is a really good place to start looking

tired of the take that attention weights mean nothing. they are not the whole story but they point you at the right tokens way more often than not.