Commit f7ef414
committed
Reject unsupported architectures in the front end
verify_model_arch only ran from _try_load_model_cls, which the API server
does not reach: front-end resolution goes through inspect_model_cls. On
SM120 the guard therefore fired inside the worker, off the usage-stats
path in init_device(), so both TP workers spawned and dumped a traceback
before EngineCore shut them down.
Call verify_model_arch from ModelConfig once the architecture is resolved,
so an unsupported device is rejected before any worker starts. The check
in _try_load_model_cls stays as a backstop for paths that build a model
without going through ModelConfig.
Reported-by: Rawsejet <#51560>
Signed-off-by: maxim955827848 <maxim955827848@gmail.com>1 parent ea8778f commit f7ef414
2 files changed
Lines changed: 25 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
611 | 611 | | |
612 | 612 | | |
613 | 613 | | |
| 614 | + | |
| 615 | + | |
| 616 | + | |
| 617 | + | |
| 618 | + | |
| 619 | + | |
| 620 | + | |
| 621 | + | |
| 622 | + | |
| 623 | + | |
| 624 | + | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
| 630 | + | |
| 631 | + | |
| 632 | + | |
| 633 | + | |
614 | 634 | | |
615 | 635 | | |
616 | 636 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
671 | 671 | | |
672 | 672 | | |
673 | 673 | | |
| 674 | + | |
| 675 | + | |
| 676 | + | |
| 677 | + | |
| 678 | + | |
674 | 679 | | |
675 | 680 | | |
676 | 681 | | |
| |||
0 commit comments