discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
History and source changes · Reports and owner responses · Compare
Similar
- comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Why this match
topics evaluation, llm, llmops
- intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Why this match
topics llm, llmops; language differs: Python → Rust
- open-compass/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
Why this match
topics evaluation, llm
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llmops; language differs: Python → HTML
- langfuse/langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
Why this match
topics evaluation, llm, llmops; language differs: Python → TypeScript
- promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Why this match
topics evaluation, llm, llmops; language differs: Python → TypeScript; license differs: Apache-2.0 → MIT
- Helicone/helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Why this match
topics evaluation, llm, llmops; language differs: Python → TypeScript
- mrgloom/awesome-semantic-segmentation
:metal: awesome-semantic-segmentation
Why this match
topics evaluation