Anatomy of Attention Sinks in Vision Transformers

A mechanistic dissection of attention sinks across five vision transformer families reveals fundamentally different mechanisms behind similar-looking behavior.

11 min read   ·   March 31, 2026

2026   ·   vision-transformers   attention   mechanistic-interpretability