What Caches Your Attention First