Documentation

curl -X POST https://api.g8kepr.com/api/v1/gateway/completions \
  -H "Authorization: Bearer gk_org_ab12cd34_YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "provider": "openai",
    "model": "gpt-4o-mini",
    "messages": [
      { "role": "user", "content": "Hello, G8KEPR!" }
    ]
  }'

{
  "request_id": "req_9f2c8ab1",
  "provider": "openai",
  "model": "gpt-4o-mini",
  "content": "Hello! How can I help you today?",
  "finish_reason": "stop",
  "usage": { "prompt_tokens": 12, "completion_tokens": 9, "total_tokens": 21 },
  "cost_usd": 0.0000042,
  "latency_ms": 512,
  "verification": null,
  "response_filter": null
}

Plans & billing

Every account starts on a 30-day Starter trial (extend to 90 days free). Upgrade, downgrade, or add payment details anytime under Dashboard → Billing.

Customer-VPC Topology

Wire Format Flow

Sensor ↔ Collector Contract

Sensors are stateless; the collector is the only stateful component and the only thing that touches Postgres or Redis. Every interaction between the two is on this diagram — anything not listed does not happen (per ADR-002).

Deployment Shapes

Coverage Map

What lands across the four pillars. Categorical inventory only — specific patterns, scoring weights, and evasion countermeasures are not publicly enumerated. Licensed customers see the full pattern catalog in the dashboard pattern library.

Pattern Updates

The base pattern set ships with the sensor images. Updates arrive as signed bundles — verified against G8KEPR's Ed25519 release key before load. Online deploys pull weekly from releases.g8kepr.com; air-gap deploys receive packs out-of-band via signed file. Sensor pins min/max pack version in sensor.yaml so production stays stable across releases.

Compound Chains

Multi-vector attacks where each individual primitive looks benign — only the co-occurrence is lethal. The collector correlates atomic findings across a 5-minute sliding window per request and emits a compound finding when a named pattern matches.

Compliance Mapping

Detection findings feed compliance evidence tooling. HIPAA is the only framework with live-evidence scoring today; the others (SOC 2, ISO 27001, PCI DSS, GDPR, EU AI Act, and more) are self-attestation and gap-analysis mapping — never marked certified until independently attested.

Example Request Monitor

HTTP Integration

OWASP Top 10 Coverage

Rate Limiting Tiers

Geo-Blocking Config

{
  "rule_name": "block-high-risk-countries",
  "action": "block",
  "countries": ["CN", "RU", "KP", "IR"],
  "response_code": 403,
  "log": true
}

Session Tracking

Include X-Session-ID in every request to enable multi-turn threat correlation. G8KEPR tracks escalation patterns across requests within a session.

# All requests in a session share the same X-Session-ID
curl -X POST https://api.g8kepr.com/api/v1/gateway/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "X-Session-ID: sess_abc123xyz" \
  -H "Content-Type: application/json" \
  -d '{ "model": "gpt-4o", "messages": [...] }'

Tool Authorization — RBAC

Explainability Response

{
  "allowed": false,
  "threat_score": 0.87,
  "decision": "block",
  "explanation": "Prompt injection pattern detected: role confusion + instruction override",
  "patterns_matched": [
    { "id": "PI-001", "name": "Role Confusion", "confidence": 0.92 },
    { "id": "PI-007", "name": "Instruction Override", "confidence": 0.81 }
  ],
  "session_escalation_factor": 2.0,
  "session_request_count": 4
}

Agent Hijacking Detection

G8KEPR detects multi-agent attack patterns that target agentic pipelines — attacks designed to manipulate one agent through another, poison tool results, or impersonate orchestrators. Coverage includes context poisoning, cross-session leakage, and multi-step prompt chaining.

Audit Log Query

curl https://api.g8kepr.com/api/v1/mcp/audit?session_id=sess_abc123xyz \
  -H "Authorization: Bearer YOUR_API_KEY"

Routing Strategies

Distributes requests evenly across all healthy providers. Good for load balancing when all providers have similar SLAs.

{
  "strategy": "round_robin",
  "providers": ["openai", "anthropic", "cohere"],
  "health_check_interval_s": 30
}

Model Marketplace

Streaming

import httpx

with httpx.stream("POST", "https://api.g8kepr.com/api/v1/gateway/completions",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={"model": "gpt-4o", "messages": [...], "stream": True},
) as resp:
    for line in resp.iter_lines():
        if line.startswith("data: "):
            print(line[6:])  # SSE payload

Webhook Events

Webhook Payload Schemas

All webhook payloads share a common envelope. Verify the signature using X-G8KEPR-Signature (HMAC-SHA256 of the raw body with your webhook secret).

{
  "event": "threat.blocked",
  "version": "2.1",
  "timestamp": "2026-03-31T14:22:01.432Z",
  "org_id": "org_abc123",
  "gateway_id": "gw_prod_01",
  "data": {
    "request_id": "req_xyz789",
    "threat_score": 0.91,
    "decision": "block",
    "pattern_ids": ["PI-001", "PI-007"],
    "session_id": "sess_def456",
    "session_request_count": 4,
    "session_escalation_factor": 2.0,
    "source_ip": "1.2.3.4",
    "method": "POST",
    "path": "/v1/completions",
    "user_agent": "python-httpx/0.27.0"
  }
}

{
  "event": "gateway.down",
  "version": "2.1",
  "timestamp": "2026-03-31T14:30:00.001Z",
  "org_id": "org_abc123",
  "gateway_id": "gw_prod_01",
  "data": {
    "gateway_name": "Production",
    "backend_url": "https://api.example.com",
    "check_type": "http",
    "http_status": 503,
    "consecutive_failures": 3,
    "first_failure_at": "2026-03-31T14:29:00.000Z"
  }
}

{
  "event": "rate_limit.exceeded",
  "version": "2.1",
  "timestamp": "2026-03-31T15:00:05.210Z",
  "org_id": "org_abc123",
  "gateway_id": "gw_prod_01",
  "data": {
    "scope": "per_ip",
    "identifier": "1.2.3.4",
    "limit": 100,
    "window_seconds": 60,
    "retry_after": 47
  }
}

Delivery Reliability

G8KEPR retries failed webhook deliveries with exponential backoff (±10% jitter). HTTP 4xx responses (except 429 Too Many Requests) are treated as permanent failures and do not retry — fix the endpoint configuration rather than burning retries. Endpoints that fail repeatedly are automatically paused to protect your receiving infrastructure; you can re-enable them from Dashboard → Webhooks or via the API.

Inspect failures for a specific webhook:

curl https://api.g8kepr.com/api/v1/webhooks/wh_abc123/failures/summary \
  -H "Authorization: Bearer YOUR_API_KEY"

Session Escalation Tiers

Example Threat Log

Response Policies

Authentication

Create keys in the dashboard under Dashboard → API Keys. Keys are formatted gk_org_<org8>_<token> and are shown only once at creation. Send a key as an Authorization: Bearer <key> header, or as X-API-Key: <key>. Each key carries a scope: read, write, or admin.

# Bearer token (the X-API-Key: <key> header also works)
curl https://api.g8kepr.com/api/v1/gateways \
  -H "Authorization: Bearer gk_org_ab12cd34_YOUR_TOKEN"

Endpoints

Rate Limit Response Headers

Compliance Frameworks

Environment Variables

Docker Compose — env injection

services:
  backend:
    image: g8kepr/api:2.1.0
    environment:
      DATABASE_URL: $DATABASE_URL
      REDIS_URL: $REDIS_URL
      SECRET_KEY: $SECRET_KEY
      API_ENCRYPTION_KEY: $API_ENCRYPTION_KEY
      ENVIRONMENT: production
      LOG_LEVEL: info
      WORKERS: 4
    env_file:
      - .env.production  # blocked from git by pre-commit hook

Feature Flags

Common Errors

Debug Mode

# Enable verbose logging
LOG_LEVEL=debug g8kepr serve

# Or set in environment
export LOG_LEVEL=debug
docker compose up backend

Health Check Endpoints

G8KEPR ships with a full observability stack: Prometheus metrics, pre-built Grafana dashboards, and structured JSON logs compatible with any aggregator (Loki, Datadog, ELK).

Prometheus Metrics

Metrics are exposed at GET /metrics in Prometheus text format. Scrape interval recommended: 15s.

Prometheus Scrape Config

scrape_configs:
  - job_name: 'g8kepr'
    scrape_interval: 15s
    static_configs:
      - targets: 'g8kepr-backend:8000'
    metrics_path: /metrics
    bearer_token: YOUR_METRICS_TOKEN

Grafana Dashboard Setup

Import the pre-built dashboards from the monitoring/grafana/dashboards/ directory in the repo. Three dashboards are included:

# Import via Grafana CLI
grafana-cli dashboards import monitoring/grafana/dashboards/overview.json
grafana-cli dashboards import monitoring/grafana/dashboards/threats.json
grafana-cli dashboards import monitoring/grafana/dashboards/ai-gateway.json

# Or via API
curl -X POST http://grafana:3000/api/dashboards/import \
  -H "Authorization: Basic admin:admin" \
  -H "Content-Type: application/json" \
  -d @monitoring/grafana/dashboards/overview.json

Alert Rules

Log Format

All logs are structured JSON, written to stdout. Each log line includes request_id for end-to-end tracing.

{
  "level": "info",
  "time": "2026-03-31T14:22:01.432Z",
  "request_id": "req_xyz789",
  "org_id": "org_abc123",
  "gateway_id": "gw_prod_01",
  "method": "POST",
  "path": "/v1/completions",
  "status": 403,
  "duration_ms": 4,
  "threat_score": 0.91,
  "decision": "block",
  "pattern": "PI-001"
}

Recent, customer-facing improvements to the G8KEPR platform. Feature-level only — contact support for detailed release notes.