brainstate

traceloop/openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Python★ 7.5kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. open-telemetry/opentelemetry-collector

    OpenTelemetry Collector

    Go★ 7.7kApache-2.0GitHub ↗

    Why this match

    topics metrics, monitoring, observability; language differs: Python → Go

  2. SigNoz/signoz

    SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

    TypeScript★ 32.5kGitHub ↗

    Why this match

    topics good-first-issue, metrics, monitoring; language differs: Python → TypeScript

  3. Netflix/metaflow

    Build, Manage and Deploy AI/ML Systems

    Python★ 10.3kApache-2.0GitHub ↗

    Why this match

    topics datascience, generative-ai, llm

  4. highlight/highlight

    highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

    TypeScript★ 9.4kGitHub ↗

    Why this match

    topics metrics, monitoring, observability; language differs: Python → TypeScript

  5. open-telemetry/opentelemetry-go

    OpenTelemetry Go API and SDK

    Go★ 6.6kApache-2.0GitHub ↗

    Why this match

    topics metrics, opentelemetry; language differs: Python → Go

  6. evidentlyai/evidently

    Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

    Jupyter Notebook★ 8.0kApache-2.0GitHub ↗

    Why this match

    topics generative-ai, llm, llmops; language differs: Python → Jupyter Notebook

  7. GoogleCloudPlatform/agent-starter-pack

    Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

    Python★ 6.6kApache-2.0archivedGitHub ↗

    Why this match

    topics generative-ai, llmops, observability

  8. vibrantlabsai/ragas

    Supercharge Your LLM Application Evaluations 🚀

    Python★ 16.2kApache-2.0GitHub ↗

    Why this match

    topics llm, llmops