brainstate

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

Python★ 7.6kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. mrgloom/awesome-semantic-segmentation

    :metal: awesome-semantic-segmentation

    ★ 10.8kGitHub ↗

    Why this match

    topics benchmark, evaluation

  2. google/benchmark

    A microbenchmark support library

    C++★ 10.5kApache-2.0GitHub ↗

    Why this match

    topics benchmark; language differs: Python → C++

  3. vibrantlabsai/ragas

    Supercharge Your LLM Application Evaluations 🚀

    Python★ 16.2kApache-2.0GitHub ↗

    Why this match

    topics evaluation, llm

  4. jingyaogong/minimind

    🧠 Train a 64M-parameter LLM from scratch in just 2h!

    Python★ 64.9kApache-2.0GitHub ↗

    Why this match

    topics large-language-model

  5. promptfoo/promptfoo

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

    TypeScript★ 26.8kMITGitHub ↗

    Why this match

    topics evaluation, llm, llm-eval; language differs: Python → TypeScript; license differs: Apache-2.0 → MIT

  6. 0xPlaygrounds/rig

    ⚙️🦀 Build modular and scalable LLM Applications in Rust

    Rust★ 9.1kMITGitHub ↗

    Why this match

    topics large-language-model, llm; language differs: Python → Rust; license differs: Apache-2.0 → MIT

  7. InternLM/InternLM

    Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

    Python★ 7.3kApache-2.0GitHub ↗

    Why this match

    topics large-language-model, llm

  8. sharkdp/hyperfine

    A command-line benchmarking tool

    Rust★ 29.2kApache-2.0GitHub ↗

    Why this match

    topics benchmark; language differs: Python → Rust