Skip to content

fea(readme): VLLM_PROMPT_SEQ_BUCKET_MAX value update #2121

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: v1.23.0_next
Choose a base branch
from
Open

fea(readme): VLLM_PROMPT_SEQ_BUCKET_MAX value update #2121

wants to merge 1 commit into from

Conversation

@imangohari1
Copy link

@imangohari1 imangohari1 commented Nov 6, 2025 •
edited by github-actions bot
Loading

The VLLM_PROMPT_SEQ_BUCKET_MAX is expected to be the size of input if avail, otherwise max_model_len.

Essential Elements of an Effective PR Description Checklist

  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results

Purpose

Test Plan

Test Result

@imangohari1
Copy link
Author

imangohari1 commented Nov 12, 2025

@mgawarkiewicz-intel thanks for the review. what else is needed here to merge this pr?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mgawarkiewicz-intel mgawarkiewicz-intel mgawarkiewicz-intel approved these changes

@kzawora-intel kzawora-intel Awaiting requested review from kzawora-intel kzawora-intel is a code owner

@madamczyk-intel madamczyk-intel Awaiting requested review from madamczyk-intel madamczyk-intel is a code owner

@michalkuligowski michalkuligowski Awaiting requested review from michalkuligowski michalkuligowski is a code owner

@vivekgoe vivekgoe Awaiting requested review from vivekgoe vivekgoe is a code owner

@afierka-intel afierka-intel Awaiting requested review from afierka-intel afierka-intel is a code owner

@xuechendi xuechendi Awaiting requested review from xuechendi xuechendi is a code owner

@jikunshang jikunshang Awaiting requested review from jikunshang jikunshang is a code owner

@mswiniarsk mswiniarsk Awaiting requested review from mswiniarsk mswiniarsk is a code owner

@PatrykWo PatrykWo Awaiting requested review from PatrykWo PatrykWo is a code owner

@wpyszka wpyszka Awaiting requested review from wpyszka wpyszka is a code owner

@deepvars deepvars Awaiting requested review from deepvars deepvars is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@imangohari1 @mgawarkiewicz-intel