Products

58 modules. 6 apps.

Every module toggleable at runtime. Install packs to configure groups. All included in every plan.

Start free Browse packs
App 01Proxy
The gateway. 50 middleware modules in a chain, every one toggleable at runtime via API.
All Routing Caching Cost Safety Transform Validate Observe Shims Other
fallbackrouterProvider failover
modelswitchModel aliasing
regionrouteGeo-based routing
localsyncLocal model sync
abrouterA/B traffic splits
cachelayerResponse caching
embedcacheEmbedding cache
semanticcacheSemantic similarity
costcapSpending limits
tierdropAuto-downgrade
idlekillKill idle requests
outputcapMax output tokens
usagepulseUsage reporting
rateshieldRate limiting
promptslimPrompt compression
tokentrimToken trimming
contextpackContext packing
chatmemConversation memory
langbridgeLanguage detection
voicebridgeAudio transcription
structuredshieldJSON validation
evalgateQuality gating
codefenceCode validation
promptguardInjection detection
toxicfilterContent moderation
guardrailTopic fencing
agegateAge-appropriate
hallucicheckHallucination detect
secretscanSecret detection
agentguardAgent safety
anthrofitClaude via OpenAI SDK
geminishimGemini via OpenAI SDK
streamsnapStream capture
imageproxyVision/image proxy
tenantwallMulti-tenant isolation
ipfenceIP allowlist
keypoolAPI key rotation
llmtapRequest logging
tracelinkDistributed tracing
alertpulseReal-time alerts
driftwatchModel drift detection
compliancelogAudit logging
feedbackloopUser feedback
promptpadPrompt management
promptlintPrompt validation
approvalgateHuman approval
batchqueueBatch processing
multicallParallel fan-out
mockllmDeterministic mock
devproxyDev/staging proxy
App 02Observe
Automatic tracing, cost dashboards, alerts, and anomaly detection for every LLM request.
tracesFull request logging
costsDaily cost rollups
alertsThreshold alerting
anomaliesAnomaly detection
App 03Trust
Append-only audit ledger with hash-chain integrity, evidence packs, and policy enforcement.
ledgerHash-chained audit trail
evidenceEvidence packs
policiesBlock/warn/log rules
feedbackUser feedback capture
replaysRequest replay
App 04Studio
Versioned prompt templates, A/B experiments, benchmarks, and snapshot comparison.
templatesVersioned prompts
experimentsA/B testing
benchmarksModel comparisons
snapshotsPoint-in-time saves
App 05Forge
DAG workflow engine. Chain LLM calls, transforms, and tool calls with dependency ordering.
workflowsDAG definitions
runsExecution tracking
toolsTool registry
sessionsStateful chat
App 06Exchange
Config pack marketplace. Install providers, modules, routes, workflows, and alerts in one click.
packsPack marketplace
installerOne-click apply
environmentsEnv sync
syncPush/pull configs
API endpoints

69 REST endpoints across all 6 apps. Full programmatic control over everything.

GET/api/apps
GET/api/proxy/modules
PUT/api/proxy/modules/{name}
GET/api/proxy/providers
GET/api/proxy/routes
POST/v1/chat/completions
GET/api/observe/traces
GET/api/observe/costs
POST/api/observe/alerts
GET/api/trust/ledger
GET/api/trust/policies
GET/api/studio/templates
POST/api/forge/workflows
POST/api/forge/workflows/{slug}/run
GET/api/forge/runs/{id}
GET/api/exchange/packs
POST/api/exchange/packs/{slug}/install
DELETE/api/exchange/installed/{id}

Full API reference →