Skip to content

[ModelRunner V2] Speculative Decoding NGram GPU Implementations - #40704

Open
PatchouliTIS wants to merge 79 commits into
vllm-project:mainfrom
PatchouliTIS:patchy/async_ngram_v2_pr
Open

[ModelRunner V2] Speculative Decoding NGram GPU Implementations#40704
PatchouliTIS wants to merge 79 commits into
vllm-project:mainfrom
PatchouliTIS:patchy/async_ngram_v2_pr

Merge branch 'main' into patchy/async_ngram_v2_pr

ffeadf6
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Aug 20, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync