ai-security · GitHub Topics

#Awesome#This repository is primarily maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), artif...

Hacking penetration-testing hacking-series Cybersecurity ethical-hacking hacker Exploit exploit-development vulnerability vulnerability-assessment vulnerability-management Awesome Lists training hackers 人工智能 ai-security

Jupyter Notebook 21.47 k

8 天前

Giskard-AI / giskard

#大语言模型#🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.62 k

4 天前

jiep / offensive-ai-compilation

A curated list of useful resources that cover Offensive AI.

offensive-ai adversarial-machine-learning ai-security 人工智能 compilation

HTML 1.24 k

1 个月前

THUYimingLi / backdoor-learning-resources

#计算机科学#A list of backdoor learning resources

backdoor-attacks ai-security 深度学习机器学习

1.11 k

1 年前

utkusen / promptmap

#大语言模型#a prompt injection scanner for custom LLM applications

ChatGPT prompt-engineering prompt-injection 大语言模型 ai-security claude ollama

Python 807

3 个月前

stacklok / toolhive

ToolHive makes deploying MCP servers easy, secure and fun

人工智能 mcp ai-security mcp-servers mcp-tools 安全 Go Kubernetes

Go 592

3 天前

splx-ai / agentic-radar

#大语言模型#A security scanner for your LLM agentic workflows

agentic-ai agentic-framework agentic-workflow 人工智能 ai-security 命令行界面 devsecops 大语言模型 llm-security red-teaming 安全 generative-ai mcp mcp-server

Python 588

6 天前

normster / llm_rules

RuLES: a benchmark for evaluating rule-following in language models

ai-security gpt-4 ai-safety

Python 225

4 个月前

phantasmlabs / phantasm

#大语言模型#Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte 176

7 个月前

cyproxio / mcp-for-security

MCP for Security: A collection of Model Context Protocol servers for popular security tools like SQLMap, FFUF, NMAP, Masscan and more. Integrate security testing and penetration testing into AI workfl...

ai-security Cybersecurity hacking-tools mcp model-context-protocol pentesting security-automation security-testing 安全 web-security

TypeScript 170

25 天前

ZhengyuZhao / AI-Security-and-Privacy-Events

A curated list of academic events on AI Security & Privacy

adversarial-examples adversarial-machine-learning ai-security

152

10 个月前

fiddlecube / compliant-llm

Build Secure and Compliant AI agents and MCP Servers. YC W23

ai-agents ai-security mcp mcp-server

Python 141

10 天前

LetterLiGo / SafeGen_CCS2024

[CCS'24] SafeGen: Mitigating Unsafe Content Generation in Text-to-Image Models

ai-safety ai-security generative-ai text-to-image

Python 131

2 个月前

Repello-AI / whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and...

ai-security llm-security prompt-engineering

Python 120

1 年前

LLAMATOR-Core / llamator

#自然语言处理#Framework for testing vulnerabilities of large language models (LLM).

attack 大语言模型自然语言处理 Python 安全 ai-security red-team hallucinations llm-security rag-evaluation 人工智能 rag jailbreak owasp red-team-tools agent vulnerability

Python 119

5 天前

EzgiKorkmaz / adversarial-reinforcement-learning

Reading list for adversarial perspective and robustness in deep reinforcement learning.

robust-machine-learning deep-reinforcement-learning ai-safety ai-alignment responsible-ai ai-security llm-security

117

2 个月前

reds-lab / Narcissus

The official implementation of the CCS'23 paper, Narcissus clean-label backdoor attack -- only takes THREE images to poison a face recognition dataset in a clean-label way and achieves a 99.89% attack...

adversarial-attacks adversarial-machine-learning ai-security backdoor-attacks

Python 115

2 年前

CyberAlbSecOP / Awesome_CyberSec_Bible

Cyber-Security Bible! Theory and Tools, Kali Linux, Penetration Testing, Bug Bounty, CTFs, Malware Analysis, Cryptography, Secure Programming, Web App Security, Cloud Security, Devsecops, Ethical Hack...