← All concepts

sliding window attention

1 articles · 5 co-occurring · 0 contradictions · 0 briefs

Hybrid SWA extends traditional sliding window by layering in prefix reuse mechanism

Related concepts
prompt optimization 1 prefix reuse cross request context 1 kv cache management 1 context window optimization 1 context window management 1
Evidence chain (1 articles, showing 1)
@askalphaxiv: Hybrid SWA can make long-context inference ~7x cheaper in theory. extends

Hybrid SWA extends traditional sliding window by layering in prefix reuse mechanism

query this concept
$ db.articles("sliding-window-attention")
$ db.cooccurrence("sliding-window-attention")
$ db.contradictions("sliding-window-attention")