Deployment
SaaS, self-hosted, air-gapped
One code base and one image for every deployment; DEPLOYMENT_MODE chooses. Regulated organisations usually start self-hosted or air-gapped.
saasself_hostedLICENSE_PLAN).airgappedEGRESS_ALLOWLIST: a model call to any other is refused and sealed. An unknown mode reads as air-gapped.Install with Helm
The chart (helm/azoth-os) ships the app, its scheduled jobs, network policies, a nightly backup of the bundled database, and an optional bundled Supabase (Postgres, GoTrue, PostgREST) and Redis. Secrets come from one Secret you generate offline:
kubectl create namespace azoth
node scripts/self-hosted/gen-secrets.mjs --name azoth-secrets --namespace azoth | kubectl apply -f -
helm install azoth helm/azoth-os -n azoth \
--set appUrl=https://azoth.bank.internal \
--set image.repository=<registry>/azoth-os --set image.digest=sha256:… \
--set ingress.tls[0].secretName=azoth-tlsMigrations, by hand
The chart never applies migrations. The image carries the runner: run node migrator/scripts/migrate.mjs --status, then --apply, as a Job. It keeps a checksum ledger and refuses an edited file; the app reports ready only once the database is at the migration it expects.
Identity and e-mail
Sign in through your organisation’s OIDC provider, or through SAML with Entra ID or ADFS, single logout included. E-mail goes through your SMTP relay: STARTTLS without downgrade, never credentials in plaintext.
Air-gapped
- The deployment’s own infrastructure — its database, Redis, time-stamping authority and telemetry collector — stays reachable; anything else must be on the allowlist.
- Models hosted inside the deployment — vLLM, TGI, LiteLLM, Ollama’s OpenAI API — are the
internalprovider: the same gateway, rules and journal, at the price you declare. - Without the Internet, give the deployment its own time-stamping authority: the local level.
egress:
allowlist:
- llm.bank.internal # any port
- siem.bank.internal:8443 # this port only
- "*.models.bank.internal" # any sub-domain
internalModels:
- name: vllm
baseUrl: http://vllm.models.svc:8000/v1
models: [llama-3.1-70b-instruct]
price: { input: 0.4, output: 0.8 } # USD per 1M tokens, declared by youThe signed image and the offline bundle
Each release pushes a signed image and its signed SBOM, and attaches an offline bundle — the chart, every image, a signed SHA256SUMS — that verifies with openssl alone, without the Internet.
The model catalog
A self-hosted deployment imports the latest signed model catalog every day; an air-gapped one imports a signed file from Platform admin. A catalog is refused unless it is signed and hashes to its sha256.
The full guide is docs/self-hosting.md in the repository.