The Newsletter of Record
for the Future of Now
Token Wisdom
No. 153
SAT · JUN 13, 2026
Subscribe
← The Lexicon
Technologies

Sparse Attention (DeepSeek)

An architectural innovation that reduces long-context AI processing cost by selectively attending to relevant tokens rather than computing full attention across all positions; approximately 80% cheaper than dense attention at equivalent context lengths

— defined in 152th Edition, Mar 24, 2026
1editions defined
Mar 2026first defined
Mar 2026most recent
Technologiescategory

Defined in (1)

152th EditionW12 · Mar 24, 2026