ai-red-team · GitHub Topics

#大语言模型#🐢 Open-Source Evaluation & Testing library for LLM Agents

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.86 k

3 天前

Azure / PyRIT

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

ai-red-team generative-ai red-team-tools responsible-ai

Python 2.88 k

4 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python 1.67 k

2 天前

microsoft / AI-Red-Teaming-Playground-Labs

AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.

ai-red-team prompt-injection

TypeScript 1.57 k

1 个月前

mbrg / power-pwn

An offensive security toolset for Microsoft 365 focused on Microsoft Copilot, Copilot Studio and Power Platform

defcon30 pentesting redteam Hacking powerautomate roboticprocessautomation rpa lowcode 无代码 m365 microsoft365 powerapps hacking-tool redteaming ai-red-team copilotstudio

Python 1.05 k

24 天前

cyberark / FuzzyAI

#大语言模型#A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

jailbreak jailbreaking 大语言模型人工智能安全 Fuzzing/Fuzz testing llm-evaluation llm-security ai-red-team

Jupyter Notebook 744

2 个月前