Skip to content

[perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill#29710

Open
minosfuture wants to merge 2 commits intovllm-project:mainfrom
minosfuture:optimize_cat
Open

[perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill#29710
minosfuture wants to merge 2 commits intovllm-project:mainfrom
minosfuture:optimize_cat

Commits

Commits on Nov 29, 2025