Exploring the Transformer Series (9) --- Location Encoding Classification
APE vs RPE in Transformers: differences, representative methods, and relative-position design patterns.
APE vs RPE in Transformers: differences, representative methods, and relative-position design patterns.