Skip to content

Kubernetes Deployment ​

Deploy GhostAI via Helm charts on any Kubernetes cluster. Supports multi-tenant, high-availability, and air-gapped (UDS) configurations.

Architecture ​

Prerequisites ​

  • Kubernetes 1.26+
  • Helm 3.12+
  • kubectl configured for your cluster
  • Container registry access (for GhostAI images)

Quick Start ​

bash
# Deploy via Helm
./infrastructure/scripts/targets/kubernetes.sh up

The Kubernetes deploy script handles:

  1. Creating the namespace
  2. Setting up K8s secrets from .env
  3. Running helm install or helm upgrade
  4. Waiting for rollout completion
  5. Running health checks

Configuration ​

Helm values are configured through the deploy script or a values.yaml override:

yaml
# values.yaml
backend:
  replicas: 3
  image: your-registry/ghostai-backend:latest
  env:
    LLM_PROVIDER: openai
    PII_REFEREE_RUNTIME: llama-cpp
    PII_REFEREE_MODEL_GPU_LAYERS: "0"

frontend:
  replicas: 2
  image: your-registry/ghostai-frontend:latest

postgresql:
  enabled: true
  auth:
    database: ghostai

redis:
  enabled: true
  sentinel:
    enabled: true

vllm:
  enabled: false  # Set true if GPU nodes available
  nodeSelector:
    gpu: "true"

Air-Gapped / UDS Deployment ​

For government and defense environments, the UDS (Unicorn Delivery Service) target creates air-gap bundles:

bash
# Build Zarf package (air-gap bundle)
./infrastructure/scripts/targets/uds.sh up

# Includes: container images, Helm charts, NIST SP 800-53 validation

Operations ​

bash
./infrastructure/scripts/targets/kubernetes.sh status    # Pod status
./infrastructure/scripts/targets/kubernetes.sh logs      # Aggregate logs
./infrastructure/scripts/targets/kubernetes.sh update     # Helm upgrade
./infrastructure/scripts/targets/kubernetes.sh rollback   # Previous release
./infrastructure/scripts/targets/kubernetes.sh validate   # Health checks

Scaling ​

bash
# Manual scale
kubectl scale deployment ghostai-backend --replicas=5

# HPA (auto-scaling)
kubectl autoscale deployment ghostai-backend \
  --min=2 --max=10 --cpu-percent=70

SOC 2 Type II Certified | BAA Available | HIPAA-Ready