By reusing computations across incrementally-changing screenshots, you can index screen history 3.7x faster in real-time without sacrificing visual understanding—making local visual assistants practical.
StreamEmbed enables real-time visual indexing of screenshots by exploiting pixel redundancy across frames. Instead of recomputing embeddings from scratch, it uses spatial token pruning to skip unchanged image blocks and temporal key-value reuse to cache computations across screenshots, achieving 3.7x faster encoding than standard visual encoders while maintaining accuracy.