llm-security · GitHub Topics

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 28 k

1 天前

NVIDIA / garak

the LLM vulnerability scanner

人工智能 llm-evaluation llm-security security-scanners vulnerability-assessment

Python 4.87 k

6 天前

Giskard-AI / giskard

#大语言模型#🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.74 k

23 天前

verazuo / jailbreak_llms

#大语言模型#[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT jailbreak 大语言模型 prompt llm-security jailbreaking

Jupyter Notebook 3.23 k

7 个月前

protectai / llm-guard

#大语言模型#The Security Toolkit for LLM Interactions

large-language-models 大语言模型 ChatGPT 安全 adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

Python 1.9 k

2 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python 1.57 k

3 天前

mariocandela / beelzebub

#大语言模型#A secure low code honeypot framework, leveraging AI for System Virtualization.

Cybersecurity 安全 honeypot 框架 Go research-project Kubernetes cloudnative cloudsecurity 大语言模型 llm-security deception llama mcp

Go 1.33 k

3 天前

OWASP / www-project-top-10-for-large-language-model-applications

#大语言模型#OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

人工智能 appsec 大语言模型 llm-security

TeX 816

4 天前

EasyJailbreak / EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

大语言模型 llm-security jailbreak

Python 690

4 个月前

cyberark / FuzzyAI

#大语言模型#A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

jailbreak jailbreaking 大语言模型人工智能安全 Fuzzing/Fuzz testing llm-evaluation llm-security ai-red-team

Jupyter Notebook 664

18 天前

splx-ai / agentic-radar

#大语言模型#A security scanner for your LLM agentic workflows

agentic-ai agentic-framework agentic-workflow 人工智能 ai-security 命令行界面 devsecops 大语言模型 llm-security red-teaming 安全 generative-ai mcp mcp-server

Python 647

14 天前

chawins / llm-sp

#Awesome#Papers and resources related to the security and privacy of LLMs 🤖

adversarial-machine-learning Awesome Lists 大语言模型 llm-security 隐私安全

Python 520

2 个月前

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

llm-security prompt-injection adversarial-attacks adversarial-machine-learning large-language-models llmops yara-scanner 安全

Python 400

1 年前

liu00222 / Open-Prompt-Injection

#大语言模型#This repository provides a benchmark for prompt Injection attacks and defenses

llm-security 大语言模型 prompt-injection

Python 250

15 天前

R3DRUN3 / sploitcraft

🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷

Cybersecurity Hacking offensive-security proof-of-concept redteam 教程人工智能 Amazon Web Services cloud container-security Docker Linux llm-security network-security Python Windows

Jupyter Notebook 201

1 个月前

phantasmlabs / phantasm

#大语言模型#Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte 179

8 个月前

sshh12 / llm_backdoor

Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running a...

backdoor-attacks llm-security qwen2-5

Python 178

4 个月前