Tech News
← Home  ·  All topics

Prometheus Metrics

1 GoKawiil brief on this topic · RSS for prometheus metrics

New open-source tool llmtee logs cost and latency of LLM API calls

Developer Garritfra released llmtee, a self-hosted proxy that sits between clients and OpenAI, Anthropic, or OpenAI-compatible APIs like OpenRouter, Ollama, vLLM and Groq, logging tokens, cost, latency and time to first token for every request while passing responses through unchanged. It runs as a single Go binary backed by SQLite or PostgreSQL, supports per-key daily and monthly budget caps that trigger HTTP 429 once exceeded, and exposes data via a web dashboard, CSV export, Prometheus metrics and an MCP server.