App 02 — Observe

See everything. Miss nothing.

Every LLM request traced automatically. Costs rolled up daily. Anomalies caught in real time. No extra tools, no extra config.

Start free See the API

Recent traces Live

Trace	Model	Tokens	Cost	Latency	Status
tr_8a4f2c	gpt-4o	1,247	$0.0187	842ms	200
tr_3b7e1a	claude-sonnet-4-20250514	3,891	$0.0467	2.1s	200
tr_c91d5f	gpt-4o-mini	412	$0.0006	310ms	200
tr_f2a8b4	gpt-4o	0	$0.00	28.3s	429
tr_71e3c9	gpt-4o-mini	876	$0.0013	445ms	200

Today's cost

Total spend $4.23

gpt-4o: $2.91 • claude-sonnet-4-20250514: $0.89 • gpt-4o-mini: $0.43

Alerts 2 active

● daily-cost-limit: $4.23 > $4.00

● rate-limit-spike: 23 blocks in 5m

○ provider-down: all healthy

What Observe does

Request Tracing

Every LLM request logged automatically with model, tokens, cost, latency, and status. Full request/response bodies optional.

Cost Rollups

Daily cost aggregation by model. See exactly where your money goes. Historical trends and per-model breakdowns.

Alert Rules

Set thresholds on cost, latency, error rate, or token usage. Get notified when something crosses the line.

Anomaly Detection

Automatic detection of latency spikes, cost anomalies, and error rate changes. Catches problems before users notice.

Latency Tracking

P50, P95, P99 latency per model and provider. Identify slow endpoints and optimize routing decisions.

Zero Config

Observe hooks into every proxy request automatically. No code changes, no SDK, no agent to install.

The API

Everything in Observe is queryable via REST. Pull traces into your own dashboards, pipe alerts to Slack, export costs to your billing system.

# Get recent traces
curl https://your-instance.stockyard.dev/api/observe/traces?limit=50

# Cost breakdown for today
curl https://your-instance.stockyard.dev/api/observe/costs

# Create an alert rule
curl -X POST /api/observe/alerts \
  -d '{"name":"cost-spike", "metric":"cost", "condition":"gt",
       "threshold":10.0, "window":"1h", "channel":"slack"}'

# Get detected anomalies
curl https://your-instance.stockyard.dev/api/observe/anomalies
  

Stop flying blind.

Observe ships with every Stockyard instance. Self-hosted or Cloud.

Start free Back to platform