Skip to content
#

training-free

Here are 109 public repositories matching this topic...

Training-free EXACT-ranking top-K sparse attention. Ranking keys by ⟨u_Q,K⟩ (u_Q=Q/‖Q‖) is order-identical to true attention score. Entropy H_N=α·log N+β (α≈0.31) gives sublinear support N^α and PPL gap decaying as N^-(1-α). Verified system: exact Triton kernel, INT8 KV ×0.508, +0.714% PPL delta..

  • Updated Jun 2, 2026
  • TeX

Add this topic to your repo

To associate your repository with the training-free topic, visit your repo's landing page and select "manage topics."

Learn more