Skip to content

Commit f3876d7

Browse files
fix(input_batch): gate seq_lens_np default with vllm_version_is('0.27.1')
vLLM main (cdc4824a21) added max_query_len: int | None = None to the InputBatch dataclass (vllm#47808), making the child AscendInputBatch's non-default seq_lens_np field follow a default argument, which raises TypeError at class definition time. Use vllm_version_is('0.27.1') to conditionally give seq_lens_np a default value on main only, satisfying Python dataclass field ordering while keeping v0.27.1 behavior unchanged. Signed-off-by: hfadzxy <starmoon_zhang@163.com>
1 parent f502674 commit f3876d7

1 file changed

Lines changed: 7 additions & 1 deletion

File tree

vllm_ascend/worker/v2/input_batch.py

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,7 @@
2424

2525
from vllm_ascend.attention.attention_v1 import AscendAttentionState
2626
from vllm_ascend.ops.rotary_embedding import update_cos_sin
27+
from vllm_ascend.utils import vllm_version_is
2728

2829

2930
class AscendInputBuffers(InputBuffers):
@@ -68,7 +69,12 @@ class AscendInputBatch(InputBatch):
6869

6970
# Create seq_lens_np.
7071
# npu's attention backend still needs seq_lens on CPU side.
71-
seq_lens_np: np.ndarray
72+
if vllm_version_is("0.27.1"):
73+
seq_lens_np: np.ndarray
74+
else:
75+
# main (post-0.27.1): InputBatch gained max_query_len default field,
76+
# requiring the child's first field to also have a default.
77+
seq_lens_np: np.ndarray = None # type: ignore[assignment]
7278
# attn_state is used to build attention metadata.
7379
attn_state: AscendAttentionState | None = None
7480

0 commit comments

Comments
 (0)