aigatewayk8s

Internal, self-hosted, multi-provider AI Gateway on Kubernetes: teams register LLM provider credentials, publish AI Gateways with quota/rate-limit, and the platform team sees company-wide spend. Built as a Kubebuilder Operator + Control Plane (xDS) + Envoy fleet data plane + Console.

Description

api/v1alpha1/ holds the Provider/AIGateway CRDs, operator/controllers/ reconciles them, controlplane/{ir,xds,snapshot}/ compiles CRD state into Envoy xDS config, gateway/filters/ is the Envoy filter chain, management-api/ is the Go backend serving console/ (TypeScript/React). See _bmad-output/planning-artifacts/architecture/ for the full Architecture Spine.

Getting Started

Prerequisites

• go version v1.26.5 (pinned; see go.mod)
• controller-runtime v0.24.1 (pinned; see go.mod)
• docker version 17.03+.
• kubectl version v1.11.3+.
• Access to a Kubernetes v1.11.3+ cluster.
• cert-manager installed in the target cluster (make deploy/make install as of Story 2.3: the Provider CRD's ValidatingAdmissionWebhook delete-guard needs a TLS certificate, provisioned via config/certmanager/). Without it, the webhook's certificate Secret is never populated and, because the webhook is registered with failurePolicy: Fail, every Provider delete (including via the Management API) is rejected cluster-wide, not just ones actually blocked by an in-use reference.

To Deploy on the cluster

Build and push your image to the location specified by IMG:

make docker-build docker-push IMG=<some-registry>/aigatewayk8s:tag

NOTE: This image ought to be published in the personal registry you specified. And it is required to have access to pull the image from the working environment. Make sure you have the proper permission to the registry if the above commands don’t work.

Install the CRDs into the cluster:

make install

Deploy the Manager to the cluster with the image specified by IMG:

make deploy IMG=<some-registry>/aigatewayk8s:tag

NOTE: If you encounter RBAC errors, you may need to grant yourself cluster-admin privileges or be logged in as admin.

Create instances of your solution You can apply the samples (examples) from the config/sample:

kubectl apply -k config/samples/

NOTE: Ensure that the samples has default values to test it out.

To Uninstall

Delete the instances (CRs) from the cluster:

kubectl delete -k config/samples/

Delete the APIs(CRDs) from the cluster:

make uninstall

UnDeploy the controller from the cluster:

make undeploy

Project Distribution

Following the options to release and provide this solution to the users.

By providing a bundle with all YAML files

1. Build the installer for the image built and published in the registry:

make build-installer IMG=<some-registry>/aigatewayk8s:tag

NOTE: The makefile target mentioned above generates an 'install.yaml' file in the dist directory. This file contains all the resources built with Kustomize, which are necessary to install this project without its dependencies.

2. Using the installer

Users can just run 'kubectl apply -f ' to install the project, i.e.:

kubectl apply -f https://raw.githubusercontent.com/<org>/aigatewayk8s/<tag or branch>/dist/install.yaml

By providing a Helm Chart

1. Build the chart using the optional helm plugin

kubebuilder edit --plugins=helm/v2-alpha

2. See that a chart was generated under 'dist/chart', and users can obtain this solution from there.

NOTE: If you change the project, you need to update the Helm Chart using the same command above to sync the latest changes. Furthermore, if you create webhooks, you need to use the above command with the '--force' flag and manually ensure that any custom configuration previously added to 'dist/chart/values.yaml' or 'dist/chart/manager/manager.yaml' is manually re-applied afterwards.

Contributing

// TODO(user): Add detailed information on how you would like others to contribute to this project

NOTE: Run make help for more information on all potential make targets

More information can be found via the Kubebuilder Documentation

License

Copyright 2026.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.