Reducing the memory footprint of stored attention keys and values by selecting or merging the most important entries.