brainstate

NVIDIA/garak

the LLM vulnerability scanner

Python★ 9.9kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. jeinlee1991/chinese-llm-benchmark

    非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。

    ★ 6.5kGitHub ↗

    Why this match

    topics llm-evaluation

  2. ifixai-ai/iFixAi

    Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

    Python★ 43.4kApache-2.0GitHub ↗

    Why this match

    topics ai, llm-evaluation, llm-security

  3. Tencent/AI-Infra-Guard

    A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

    Python★ 7.4kApache-2.0GitHub ↗

    Why this match

    topics llm-evaluation, llm-security

  4. confident-ai/deepeval

    The LLM Evaluation Framework

    Python★ 19.3kApache-2.0GitHub ↗

    Why this match

    topics llm-evaluation

  5. NVIDIA-NeMo/Guardrails

    NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

    Python★ 7.4kGitHub ↗

    Why this match

    topics llm-security

  6. mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    Python★ 28.7kApache-2.0GitHub ↗

    Why this match

    topics ai, llm-evaluation

  7. The-Art-of-Hacking/h4cker

    This repository is maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), AI security, vulnerability research, exploit development, reverse engineering, and more. 🔥 Also check: https://hackertraining.org

    Jupyter Notebook★ 30.0kMITGitHub ↗

    Why this match

    topics ai, vulnerability-assessment; language differs: Python → Jupyter Notebook; license differs: Apache-2.0 → MIT

  8. SoupTeam/soup-wall

    Soup Wall: open-source security for AI agents and model traffic. Local Agent, Gateway, self-hosted Console. Apache-2.0.

    Python★ 29Apache-2.0GitHub ↗

    Why this match

    topics llm-security