https://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/the-position-problem-why-self-attention-is-blind-to-word-order2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/attention-is-permutation-equivariant2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/why-position-matters-for-language2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/what-we-need-from-positional-information2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/position-encoding-vs-position-embedding2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/absolute-vs-relative-position2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/a-formal-look-at-what-breaks-without-position2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/limitations-of-any-positional-encoding-approach2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/in-practice-what-modern-models-use2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/summary2025-06-05T00:00:00.000Zhttps://mbrenndoerfer.com/writing/position-problem-self-attention-word-order/quiz2025-06-05T00:00:00.000Z