Positional Encoding

> Adding positional encoding to every word in "dog bites man" and "man bites dog," then summing the whole sentence into one vector, produces the *exact same total* for both sentences. This counterexample shows that adding a position vector alone does not make every downstream computation order-aware.