Skip to content

[Model][Perf] Enable Inkling SplitKV on SM90 - #53317

Open
NVShreyas wants to merge 1 commit into
vllm-project:mainfrom
NVShreyas:perf/inkling-sm90-fa4-splitkv
Open

[Model][Perf] Enable Inkling SplitKV on SM90#53317
NVShreyas wants to merge 1 commit into
vllm-project:mainfrom
NVShreyas:perf/inkling-sm90-fa4-splitkv