llm-security · GitHub Topics

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 25.37 k

1 个月前

Giskard-AI / giskard

#大语言模型#🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.62 k

4 天前

NVIDIA / garak

the LLM vulnerability scanner

人工智能 llm-evaluation llm-security security-scanners vulnerability-assessment

Python 4.58 k

3 天前

verazuo / jailbreak_llms

#大语言模型#[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT jailbreak 大语言模型 prompt llm-security jailbreaking

Jupyter Notebook 3.17 k

6 个月前

protectai / llm-guard

#大语言模型#The Security Toolkit for LLM Interactions

large-language-models 大语言模型 ChatGPT 安全 adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

Python 1.75 k

6 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python 1.47 k

5 天前

mariocandela / beelzebub

#大语言模型#A secure low code honeypot framework, leveraging LLM for System Virtualization.

Cybersecurity research 安全 honeypot 框架低代码 Go research-project Kubernetes cloudnative cloudsecurity openai 大语言模型 llm-security llama3 ollama deception

Go 1.16 k

25 天前

EasyJailbreak / EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

大语言模型 llm-security jailbreak

Python 653

3 个月前

cyberark / FuzzyAI

#大语言模型#A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

jailbreak jailbreaking 大语言模型人工智能安全 Fuzzing/Fuzz testing llm-evaluation llm-security ai-red-team

Jupyter Notebook 599

11 天前

splx-ai / agentic-radar

#大语言模型#A security scanner for your LLM agentic workflows

agentic-ai agentic-framework agentic-workflow 人工智能 ai-security 命令行界面 devsecops 大语言模型 llm-security red-teaming 安全 generative-ai mcp mcp-server

Python 588

6 天前

chawins / llm-sp

#Awesome#Papers and resources related to the security and privacy of LLMs 🤖

adversarial-machine-learning Awesome Lists 大语言模型 llm-security 隐私安全

Python 507

7 天前

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

llm-security prompt-injection adversarial-attacks adversarial-machine-learning large-language-models llmops yara-scanner 安全

Python 393

1 年前

liu00222 / Open-Prompt-Injection

#大语言模型#This repository provides a benchmark for prompt Injection attacks and defenses

llm-security 大语言模型 prompt-injection

Python 224

15 天前

R3DRUN3 / sploitcraft

🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷

Cybersecurity Hacking offensive-security proof-of-concept redteam 教程人工智能 Amazon Web Services cloud container-security Docker Linux llm-security network-security Python Windows

Jupyter Notebook 198

10 天前

phantasmlabs / phantasm

#大语言模型#Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte 176

7 个月前

sshh12 / llm_backdoor

Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running a...

backdoor-attacks llm-security qwen2-5

Python 171

2 个月前

ZenGuard-AI / fast-llm-security-guardrails

The fastest Trust Layer for AI Agents

llm-security 安全 agentic-ai ai-agent ai-agents ai-runtime

Python 136

18 天前

yevh / TaaC-AI

AI-driven Threat modeling-as-a-Code (TaaC-AI)

application-security devsecops gpt gpt-3 gpt-4 threat threat-modeling 人工智能 llm-security claude-3 mistral-7b

HTML 136

1 年前

Repello-AI / whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and...

ai-security llm-security prompt-engineering

Python 120

1 年前

LLAMATOR-Core / llamator

#自然语言处理#Framework for testing vulnerabilities of large language models (LLM).

attack 大语言模型自然语言处理 Python 安全 ai-security red-team hallucinations llm-security rag-evaluation 人工智能 rag jailbreak owasp red-team-tools agent vulnerability

Python 119

5 天前