Skip to content

Commit e145ebf

Browse files
chaunceyjiangwyettzeng
authored andcommitted
[Perf][DSV4] Optimize sparse top-k metadata kernels for higher prefill throughput (vllm-project#52084)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: Wyett <wyettzeng@gmail.com>
1 parent 94b1353 commit e145ebf

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

vllm/models/deepseek_v4/common/ops/cache_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -580,7 +580,7 @@ def combine_topk_swa_indices(
580580
return combined_indices, combined_lens
581581

582582

583-
_COMBINE_TOPK_SWA_NUM_WORKERS = 128
583+
_COMBINE_TOPK_SWA_NUM_WORKERS = 256
584584

585585

586586
# Representative pointer alignment variants for Triton pointer specialization.

0 commit comments

Comments
 (0)