Skip to content

[WIP] Vllm recipes tool improve - #53325

Open
louie-tsai wants to merge 3 commits into
vllm-project:mainfrom
intel-ai-tce:vllm_recipes_tool_improve
Open

[WIP] Vllm recipes tool improve#53325
louie-tsai wants to merge 3 commits into
vllm-project:mainfrom
intel-ai-tce:vllm_recipes_tool_improve

Conversation

@louie-tsai

@louie-tsai louie-tsai commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Purpose

Add a simple flow to convert a validated vLLM Recipe into deployment-ready config.yml and env.sh.

The recipe remains the baseline. Hardware and workload information are optional and can be used to refine deployment-sensitive runtime settings so users can deploy models with configurations that better match their actual system and workload.

flowchart LR
    R["vLLM Recipe"] --> C["Recipe Converter"]
    H["Hardware Info (optional)"] --> C
    W["Workload Info (optional)"] --> C
    C --> F["config.yml + env.sh"]
    F --> D["vLLM Docker Image"]
    D --> E["OpenAI Endpoint"]
Loading

This helps bridge validated vLLM Recipes to an optimized deployment without requiring users to manually translate and tune recipe parameters.

Test Plan

Verify recipe-only conversion still works.

Verify hardware detection and optional workload inputs refine runtime settings.

Verify config.yml and env.sh are generated correctly.

Verify unsupported runtime-tuning hardware fails clearly.

Test Result

Tested recipe conversion and runtime tuning on Intel Xeon CPU, including hardware detection, workload inputs, and generated vLLM configuration.


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@louie-tsai
louie-tsai force-pushed the vllm_recipes_tool_improve branch from e633fa3 to 11133e0 Compare August 21, 2026 21:38
Signed-off-by: louie-tsai <louie.tsai@intel.com>
Signed-off-by: louie-tsai <louie.tsai@intel.com>
@louie-tsai
louie-tsai force-pushed the vllm_recipes_tool_improve branch from 11133e0 to 8b04cbf Compare August 21, 2026 21:38
Signed-off-by: louie-tsai <louie.tsai@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant