#multi-head-self-attention - Tags

1 post · Transformer Series

Tag: #multi-head-self-attention

🗓 2026-04-03 • Transformer Series • ⏱ 41 min read

Multi-head self-attention in Transformers: motivation, principles, implementation details, and modern head-composition improvements.