Tag
#opentelemetry
3 posts tagged opentelemetry.
- monitoring
How to Monitor LLM in Production: Metrics, Drift, and Alerting
A practitioner's guide to production LLM monitoring — covering TTFT, token throughput, output quality drift, hallucination signals, and alerting with
- ops
LLM Cost & Latency Observability with OpenTelemetry
Token spend and tail latency are the two metrics that decide whether an LLM feature ships or gets killed. How to instrument both with OpenTelemetry so you
- ops
End-to-End Tracing for LLM Applications: What Belongs in a Span
Production LLM apps span multiple model calls, tool invocations, retrieval steps, and re-tries. A complete trace makes them debuggable; a sparse one