Grid

Grid is the Kubernetes control plane for multi-site AI routing with Praxis as the request data plane.

What Grid does

• Reconciles GridNetwork, GridSite, and provider CRDs.
• Forms site membership with SWIM and propagates provider state with CRDTs.
• Manages Grid trust material for mTLS between sites.
• Scrapes configured provider metrics and scores routing candidates.
• Renders Praxis routing overlay ConfigMaps consumed by gateway deployments.
• Projects provider credential references into overlays without writing token values into Grid routing data.

What Grid does not do

Grid does not proxy model traffic, translate provider APIs, or run Praxis HTTP filters. The Praxis gateway stack handles TLS, proxying, and backend I/O; Praxis AI supplies the AI-specific routing and credential filters.

Getting started

Some Kind validations require Praxis AI and Praxis Core features that are still pending merge or project-owned image publication. Until those images are available, use the documented xtask image override environment variables for local development runs.

# Validate operator routing overlay generation in kind
cargo xtask env validate-operator-routing -c tests/env/operator-routing.toml

# Validate the dedicated llm-d-compatible provider-gateway path
# Uses Praxis AI ext_proc with mock EPP test image
cargo xtask env verify-llmd-compatible-routing -c tests/env/operator-routing-multisite.toml

# Validate /v1/responses request parsing and Grid overlay routing
cargo xtask env verify-responses-routing -c tests/env/operator-routing-multisite.toml

# Validate full-grid routing across local, remote, cloud mock, and API mock
cargo xtask env verify-full-grid-routing -c tests/env/operator-routing-two-provider.toml

# Validate API-provider fallback with static header injection
cargo xtask env verify-api-fallback -c tests/env/operator-routing.toml

# Validate native grid_route → grid_credential_inject credential injection.
# Tokens are read from a mounted Secret file and stay out of Praxis ConfigMaps.
cargo xtask env verify-api-fallback-native -c tests/env/operator-routing.toml

# Validate SWIM membership from env-var startup seeds
cargo xtask env verify-swim-membership -c tests/env/operator-routing.toml

# Validate SWIM membership from GridNetwork.spec.seeds
cargo xtask env verify-swim-crd-seeds -c tests/env/operator-routing.toml

# Validate CRDT provider-state propagation over SWIM
cargo xtask env verify-swim-state -c tests/env/operator-routing.toml

# Validate encrypted SWIM transport behavior and failure cases
cargo xtask env verify-swim-encryption -c tests/env/operator-routing-multisite.toml

# Validate transitive three-node SWIM mesh propagation and routing eligibility
cargo xtask env verify-swim-mesh-three-node -c tests/env/operator-routing-multisite.toml

# Validate GridSite trust fingerprint promotion and fail-closed rotation
cargo xtask env verify-gridsite-trust-fingerprint -c tests/env/operator-routing-multisite.toml

Documentation

• Documentation index
• Architecture overview
• Custom resources
• Routing
• Scoring
• Auth and policy
• Operations
• Consumer config
• CI Kind E2E strategy

Development

• Development guide
• Conventions