Skip to main content

8 docs tagged with "observability"

View all tags

LLM Latency on Kubernetes

Debug LLM latency on Kubernetes by separating gateway time, queue wait, prefill, decode, GPU pressure, model readiness, and rollout behavior.

LLM Latency War Room

Field note for debugging LLM latency on Kubernetes when pods are healthy but users still wait for time to first token.

LLM Observability Challenge

Challenge-style observability lab for Kubernetes LLM workloads covering latency, queueing, GPU saturation, traces, logs, and alerts.

Observability Stack

Practical Kubernetes observability stack design with metrics, logs, traces, and events.

Production Readiness Challenge

Challenge-style Kubernetes LLM production readiness lab covering security, rollback, quota, cost, observability, and launch review.