Back Subscribe
← The Lexicon
Technologies

Sparse Attention (DeepSeek)

An architectural innovation that reduces long-context AI processing cost by selectively attending to relevant tokens rather than computing full attention across all positions; approximately 80% cheaper than dense attention at equivalent context lengths

— defined in 152th Edition, Mar 24, 2026
1appearances
Mar 2026first appeared
Mar 2026most recent
Technologiescategory

Across the corpus (1 defined)

Defined 152th EditionW12 · Mar 24, 2026