[Feature] Mask Replay - #49577

Merged

ZJY0516 merged 132 commits into

vllm-project:mainfrom

vx120:mask_replay

Aug 13, 2026

Commits on Jul 27, 2026

Implement Mask Replay
vx120
committed
1a320a7
Optimize sampling mask storage
vx120
committed
a444039
Streamlined the code and removed unnecessary parts.
vx120
committed
9c6db21
Merge branch 'vllm-project:main' into mask_replay
vx120
authored
95d453f

Commits on Jul 29, 2026

Require final-only output for sampling replay
vx120
committed
da36481
add pre-commit code
vx120
committed
a37a134

Commits on Jul 30, 2026

Merge branch 'vllm-project:main' into mask_replay
vx120
committed
2129592
Clean up formatting in scheduler.py
vx120
committed
e3b8d31
Require bounded top-k for sampling replay
vx120
committed
bbffe02
Improve error message for top_k validation
vx120
authored
fee020e
Merge branch 'vllm-project:main' into mask_replay
vx120
authored
145da58
pre-commit change
vx120
committed
d84da9d
Merge branch 'vllm-project:main' into mask_replay
vx120
authored
8c4144f
Validate sampling replay output mode early

aoshen02
and
codex
committed
045c413
Gate sampling masks in scheduler

aoshen02
and
codex
committed
2951912
Merge pull request #3 from aoshen02/codex/fix-sampling-replay-validation
aoshen02
authored
754a737
Compact sampling support before async output

aoshen02
and
codex
committed
8cdca91
Merge pull request #9 from aoshen02/codex/compact-sampling-support-output
aoshen02
authored
4bce273
Merge pull request #6 from aoshen02/codex/sampling-mask-scheduler-flag
aoshen02
authored
26199bf
Remove FlashInfer sampling mask log

aoshen02
and
codex
committed
fdae7cc
Merge pull request #10 from aoshen02/codex/remove-flashinfer-sampling-mask-log
aoshen02
authored
0acee62
Disable FlashInfer sampling for sampling masks

aoshen02
and
codex
committed
41f18c6
Merge pull request #11 from aoshen02/codex/disable-flashinfer-sampling-mask
aoshen02
authored
a5591cc
Keep sampling mask tensors local to sampler

aoshen02
and
codex
committed
ba8aa3a
Merge pull request #12 from aoshen02/codex/keep-sampling-mask-local
aoshen02
authored
f038732
Move sampling mask to its own module

aoshen02
and
codex
committed
880788b
Merge pull request #14 from aoshen02/codex/extract-sampling-mask-output
aoshen02
authored
8622dbd

Commits on Jul 31, 2026

Restore sampler spacing

aoshen02
and
codex
committed
00c2ed2
Merge pull request #16 from aoshen02/codex/restore-processed-logprobs
aoshen02
authored
0ac290f
refactor: align sampling mask tensor conversion

aoshen02
and
codex
committed
209a885
Merge pull request #17 from aoshen02/codex/python-sampling-mask-conversion
aoshen02
authored
cef55ab
Refactor sampling mask compaction

aoshen02
and
codex
committed
b25bed1
Merge pull request #18 from aoshen02/codex/encapsulate-sampling-mask-compaction
aoshen02
authored
fac80d4
Merge branch 'main' into mask_replay
aoshen02
authored
78b54ac
Align sampling mask output with Rust protocol
vx120
committed
3c5e664
Merge branch 'vllm-project:main' into mask_replay
vx120
authored
cf2ad7e
[Feature] Expose sampling mask via HTTP endpoints as list[list[int]]

aoshen02
and
claude
committed
1c7b816
Remove sampling_mask from OpenAI-compat endpoints

aoshen02
and
claude
committed
a9ae6e5
Merge pull request #19 from aoshen02/worktree-sampling-mask-endpoint
aoshen02
authored
c3a2a38
Sync sampling mask protocol fixtures
vx120
committed
2d947dd
Enforce processed_logprobs mode for sampling mask

aoshen02
and
claude
committed
8905ebb
Merge pull request #20 from aoshen02/fix-logprobs-mode-validation
aoshen02
authored
1fccd75
Merge branch 'main' into mask_replay
vx120
authored
1e71000
Fix sampling mask scheduler test setup
vx120
committed
03fae73
Merge branch 'vllm-project:main' into mask_replay
vx120
authored
3963b7e
Move new_sampling_mask to end of EngineCoreOutput, revert Rust changes

aoshen02
and
claude
committed
d886296
Merge pull request #21 from aoshen02/fix-sampling-mask-field-order
aoshen02
authored
95f6a6e
Fix python_compat.py: move new_sampling_mask to end, remove wire Nil

aoshen02
and
claude
committed
ac6602f
Update output.rs
aoshen02
authored
97a96a0
Merge pull request #22 from aoshen02/fix-python-compat-field-order
aoshen02
authored
26b767b
Remove stale sampling_mask wire Nil from client.rs test fixture

aoshen02
and
claude
committed
e0d43ad
Merge pull request #23 from aoshen02/fix-client-rs-wire-nil
aoshen02
authored
19c3ff9
Remove FINAL_ONLY requirement for sampling mask

aoshen02
and
claude
committed
f8427ac
Merge pull request #24 from aoshen02/remove-final-only-requirement
aoshen02
authored
bbaa49c
Merge branch 'main' into mask_replay
vx120
authored
6d3836e
add validation of sampling replay params
vx120
committed
e4e0ae1
Merge branch 'main' into mask_replay
vx120
authored
fb14bec
Add sampling mask feature documentation

aoshen02
and
claude
committed
a74b537
Merge pull request #25 from aoshen02/add-sampling-mask-docs
aoshen02
authored
278a7b2
fix: markdownlint MD060 table-column-style in sampling_mask.md

aoshen02
and
claude
committed
6e7747a
Merge pull request #26 from vx120/fix/sampling-mask-md-lint-49577
aoshen02
authored
695ca45
Remove logprobs check in input_processor.py
vx120
authored
7cf69ba
Merge branch 'main' into mask_replay
vx120
authored
bf2865d
[Feature] Expose sampling mask via HTTP endpoints as list[list[int]]

authored and
vx120
committed
a49d465
Remove sampling_mask from OpenAI-compat endpoints

authored and
vx120
committed
7f90a9f
Merge pull request #19 from aoshen02/worktree-sampling-mask-endpoint

aoshen02
authored and
vx120
committed
4421bd4
Enforce processed_logprobs mode for sampling mask

authored and
vx120
committed
93dc02e
Sync sampling mask protocol fixtures
vx120
committed
ca15b4c
Merge pull request #20 from aoshen02/fix-logprobs-mode-validation

aoshen02
authored and
vx120
committed
982ceb9
Merge branch 'main' into mask_replay
vx120
committed
b799148
Move new_sampling_mask to end of EngineCoreOutput, revert Rust changes

authored and
vx120
committed
1733f82
Fix sampling mask scheduler test setup
vx120
committed
4dcc2cc
Merge branch 'vllm-project:main' into mask_replay
vx120
committed
b8fcc29
Merge pull request #21 from aoshen02/fix-sampling-mask-field-order

aoshen02
authored and
vx120
committed
e77d1d9
Fix python_compat.py: move new_sampling_mask to end, remove wire Nil

authored and
vx120
committed
cb8c60a
Update output.rs

aoshen02
authored and
vx120
committed
fcd283a
Remove stale sampling_mask wire Nil from client.rs test fixture

authored and
vx120
committed
f332d61
Merge pull request #22 from aoshen02/fix-python-compat-field-order

aoshen02
authored and
vx120
committed
87fd402
Remove FINAL_ONLY requirement for sampling mask

authored and
vx120
committed
a69ae8c
Merge pull request #23 from aoshen02/fix-client-rs-wire-nil

aoshen02
authored and
vx120
committed
ee4f6fb
Merge pull request #24 from aoshen02/remove-final-only-requirement

aoshen02
authored and
vx120
committed
73f7c71
Merge branch 'main' into mask_replay
vx120
committed
8987b3d
add validation of sampling replay params
vx120
committed
e2d4fa0
Add sampling mask feature documentation

authored and
vx120
committed
55d701b
Merge branch 'main' into mask_replay
vx120
committed
7c9722d
Merge pull request #25 from aoshen02/add-sampling-mask-docs

aoshen02
authored and
vx120
committed
818b022
fix: markdownlint MD060 table-column-style in sampling_mask.md

authored and
vx120
committed
402766a
Merge pull request #26 from vx120/fix/sampling-mask-md-lint-49577

aoshen02
authored and
vx120
committed
decfccb
fix(rust): add new_sampling_mask slot to EngineCoreOutput

authored and
vx120
committed
7f10866
Remove logprobs check in input_processor.py
vx120
committed
911496d
Merge branch 'main' into mask_replay
vx120
committed
8235f6b
Merge pull request #27 from vx120/fix/sampling-mask-md-lint-49577

aoshen02
authored and
vx120
committed
90d17ea
Merge branch 'main' into mask_replay
vx120
authored
6dae808
Merge branch 'main' into mask_replay
vx120
authored
bb08e6f
Merge branch 'main' into mask_replay
vx120
authored
16e1c80
Merge branch 'main' into mask_replay
vx120
authored
6d7edbd
Merge branch 'main' into mask_replay
vx120
authored
79c3986

Commits on Aug 1, 2026

Merge branch 'main' into mask_replay
vx120
authored
d8fcd2c

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Merge branch 'main' into mask_replay
vx120
authored
cd4eaf1
Merge branch 'main' into mask_replay
vx120
authored
e69e436
add pre-commit code
vx120
committed
ca46f77
Merge branch 'main' into mask_replay
vx120
authored
19c6c86
Merge branch 'main' into mask_replay
vx120
authored
997eb90

Commits on Aug 10, 2026

Merge upstream main into mask_replay

vx120
and
codex
committed
d49e7e4
Merge branch 'main' into mask_replay
vx120
authored
2ec706d
Fix pre-commit import ordering
vx120
committed
9c793ef
Merge remote-tracking branch 'origin/mask_replay' into mask_replay
vx120
committed
4d638b1
Merge branch 'main' into mask_replay
vx120
authored
e97181d

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Remove sampling mask CPU fallback

aoshen02
and
codex
committed
a23eeb6
Merge pull request #29 from aoshen02/codex/remove-sampling-mask-cpu-fallback
aoshen02
authored
ffeac59
Merge branch 'main' into mask_replay
aoshen02
authored
f90415f
Merge branch 'main' into mask_replay
vx120
authored
9e08019
Address sampling mask review feedback

aoshen02
and
codex
committed
59c64b9
Add sampling mask endpoint coverage

aoshen02
and
codex
committed
c992544
Merge pull request #30 from aoshen02/codex/address-mask-replay-review-comments
aoshen02
authored
63f97c6
Merge branch 'main' into mask_replay
aoshen02
authored
c937874

Commits on Aug 13, 2026

Fix sampling mask support assertions

aoshen02
and
codex
committed
bbe9552
Merge pull request #31 from aoshen02/codex/fix-sampling-mask-support-test
aoshen02
authored
2eae885
Fix sampling mask Rust wire compatibility

aoshen02
and
codex
committed
ab0c94b
Merge pull request #32 from aoshen02/codex/fix-sampling-mask-rust-wire
aoshen02
authored
0276e94
Merge branch 'main' into mask_replay
aoshen02
authored
b53b2a9
Fix Rust sampling mask test formatting

aoshen02
and
codex
committed
5b15d36
Merge pull request #33 from aoshen02/codex/fix-sampling-mask-rustfmt
aoshen02
authored
ab01a11