Skip to content

feat(inference-operator): Update inference helm chart to v2.1.1 with latest CRDs#416

Merged
mollyheamazon merged 1 commit intoaws:mainfrom
shantanutrip:inference-helm-may-5
May 6, 2026
Merged

feat(inference-operator): Update inference helm chart to v2.1.1 with latest CRDs#416
mollyheamazon merged 1 commit intoaws:mainfrom
shantanutrip:inference-helm-may-5

Conversation

@shantanutrip
Copy link
Copy Markdown
Contributor

What's changing and why?

Update the inference operator helm chart to v2.1.1 from the latest AWSCrescendoInferenceOperator dist.

Changes:

  • CRDs: Updated all 3 CRDs (inferenceendpointconfigs, jumpstartmodels, sagemakerendpointregistrations) with latest schema additions
  • Chart.yaml: Version bump 2.1.02.1.1
  • values.yaml: Added init container config (image.initContainer.repository/tag) and enableCustomServiceAccounts: false
  • config/manager/manager.yaml:
    • Init container image changed from hardcoded public.ecr.aws/bitnami/kubectl:1.30 to templated value
    • Added env vars: AWS_REGION, ENABLE_CUSTOM_SERVICE_ACCOUNTS, OPERATOR_SERVICE_ACCOUNT_NAME, OPERATOR_NAMESPACE
    • HYPERPOD_CLUSTER_ARN made optional with default ""

Before/After UX

Before:

  • Inference operator chart at v2.1.0 with older CRD schemas
  • Init container using hardcoded public bitnami kubectl image

After:

  • Inference operator chart at v2.1.1 with latest CRD schemas
  • Init container using configurable private image via values.yaml
  • Support for custom service accounts via enableCustomServiceAccounts flag

How was this change tested?

  • Validated all CRD YAML files are syntactically correct (parsed with Python yaml.safe_load)
  • Verified no remaining pdSpec/DPD references in published CRDs
  • Diff verified against source AWSCrescendoInferenceOperator dist

Are unit tests added?

N/A — Helm chart config/CRD update only, no application code changes.

Are integration tests added?

N/A — CRD schema and chart config changes. Integration tests along with HP CLI will handle this.

Reviewer Guidelines

‼️ Merge Requirements: PRs with failing integration tests cannot be merged without justification.

One of the following must be true:

  • Changes are documentation-only format?
  • [] All automated PR checks pass

…latest CRDs

Update inference operator chart from AWSCrescendoInferenceOperator dist.
Includes new CRD schemas, init container support, custom service
accounts flag, and templated manager configuration. Excludes pdSpec
(disaggregated prefill/decode) as it is not yet GA.
@shantanutrip shantanutrip requested a review from a team as a code owner May 5, 2026 20:35
@shantanutrip shantanutrip temporarily deployed to manual-approval May 5, 2026 20:35 — with GitHub Actions Inactive
Comment thread helm_chart/HyperPodHelmChart/charts/inference-operator/values.yaml
@mollyheamazon mollyheamazon merged commit 4b76719 into aws:main May 6, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants