Repository navigation
Conversation
Add an overview page and a getting-started page for the rhvp-vllm-ray-inference-server sandbox pattern, plus its architecture diagram.
Contributor
|
Hi @BwL1289. Thanks for your PR. I'm waiting for a validatedpatterns member to verify that this patch is reasonable to test. If it is, they should reply with Regular contributors should join the org to skip this step. Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This pull request adds the vLLM Ray Inference Server pattern to the site in the sandbox tier.
The pattern deploys an OpenAI-compatible LLM server on one OpenShift cluster. One pod runs Ray Serve LLM with the vLLM engine on one NVIDIA GPU. The cluster builds the server image with a BuildConfig from hash-pinned PyPI wheels on the NVIDIA CUDA UBI 9 image. OpenShift GitOps deploys the server, the NVIDIA GPU Operator and Node Feature Discovery, Vault with the External Secrets Operator for an optional Hugging Face token, and a JupyterLab notebook that times the server.
tier: sandbox,validated: false)We also emailed hybrid-cloud-patterns@googlegroups.com on 2026-11-08 to ask for the informal technical and
architecture reviews that the sandbox tier asks for. If that list is no longer read, or if it is easier, this pull
request can carry those reviews.
Files
content/patterns/rhvp-vllm-ray-inference-server/_index.adoccontent/patterns/rhvp-vllm-ray-inference-server/getting-started.adocstatic/images/rhvp-vllm-ray-inference-server/architecture.svgSandbox tier requirements
./pattern.sh make installfrommainat1a781d1, with default settings, on a new installer-provisioned AWS cluster (OpenShift 4.22.18, us-east-1, three m5.2xlarge nodes, no cluster changes). The command's own Argo CD health check passed, with all seven Argo CD applications Synced and Healthy. The pattern added the GPU node, the cluster built both images, the server answered the OpenAI API, and the notebook ran against it with no errors. An earlier install, on another new AWS cluster, found one bug (OpenShift's builder records an emptyCMDas/bin/sh -c null), which1a781d1fixes (README, What this pattern was verified against).pattern-metadata.yamlarchitecture.svgin this pull request_index.adocNotes for reviewers
questions are open with the Validated Patterns team: whether the
rhvp-prefix is acceptable under the Red Hattrademark guidelines, and whether the repository moves to
validatedpatterns-sandbox. A comment at the top of thefront matter says which values to change together.
partnersentry. The pattern uses NVIDIA, Ray, and vLLM software, but no partner organization takes part init. The front matter explains this in a comment. Leaving the field out also keeps the partner trademark notice off
the page.
page uses an image. The SVG uses plain SVG text, with no embedded HTML.
AGENTS.mdfile in the patternrepository.
Checks
hugo, run in the container image thatmake builduses, builds the site with these files and exits 0. The twopages report no warning other than the site-wide notice that the optional
rougegem is missing.