prometheus

LLM Costs and Observability with agentgateway on Kubernetes (Part 2)

Part 2: scrape agentgateway with Prometheus, build a Grafana dashboard of token cost and per-tool usage, see blocked tool calls, and alert on spend.

Shubham Katara · 12 min

Read →