Attention Mechanisms (Updating) Posted on 2022-12-31 In Natural Language Processing , Transformer Related Topics Symbols count in article: 116 Reading time ≈ 1 mins. I'll take down notes on different attention mechanisms while reading related topics. Transformer Self Attention Multi-Head Attention