OpenLLM Monitor is a plug-and-play, real-time observability dashboard for monitoring and debugging LLM API calls across OpenAI, Ollama, OpenRouter, and more. Tracks tokens, latency, cost, retries, and lets you replay prompts — fully open-source and self-hostable.
nlp machine-learning sdk ai monitoring openai model-evaluation plug-and-play model-monitoring model-performance llm ollama openllm
-
Updated
Jun 21, 2025 - JavaScript