← All concepts

efficient inference

1 articles · 4 co-occurring · 0 contradictions · 0 briefs

Demonstrates efficiency gains from one-time context analysis vs repeated context switching

Related concepts
prompt context coupling 1 mixture of experts moe 1 memory persistence 1 context window optimization 1
Evidence chain (1 articles, showing 1)
@awnihannun: It's very cool that Apple shipped a 20B parameter on-device. supports

Demonstrates efficiency gains from one-time context analysis vs repeated context switching

query this concept
$ db.articles("efficient-inference")
$ db.cooccurrence("efficient-inference")
$ db.contradictions("efficient-inference")