大型语言模型(LLMs)安全保护的综合参考资料。涵盖OWASP生成式AI十大风险、即时注入、对抗性攻击、现实世界事件及实用防御。包含红队工具、防护措施和缓解策略目录,帮助开发者、研究人员和安全团队负责任地部署人工智能。
prompt-injection-defense 开源项目推荐(205 个)
prompt-injection-defense 话题在 GitHub 上没有填写简介,这里按 Star 数汇总最相关的热门仓库。
热门项目 前 20
按 Star 数排序展示前 20 个 · GitHub 共 205 个仓库Open source prompt injection protection for Agents calling tools (via MCP, CLI or direct function calling). Detect and defend against prompt injection attacks. 22MB, CPU-only, < 10ms latency.
PromptMe is an educational project that showcases security vulnerabilities in large language models (LLMs) and their web integrations. It includes 10 hands-on challenges inspired by the OWASP LLM Top 10, demonstrating how these vulnerabilities can be discovered and exploited in real-world scenarios.
AgentWard – Built for all, hardened for OpenClaw.
Self-hosted AI security proxy. Redact PII, block prompt injection, route to any LLM provider. OpenAI-compatible.
Tamper-evident integrity monitor for the MCP config & server files your local AI agents load.
ZEOS: a transformer operating system — priority-preemptive scheduling, protected mode, and deterministic replay for LLM jobs
Open test set of .eml emails for checking how email security controls and AI mailbox assistants handle indirect prompt injection. It crosses three intents (system-prompt disclosure, data exfiltration, tool discovery) with three delivery methods (plaintext, hidden HTML, Base64), plus a benign control. All content is fictional and non-routable.
[EMNLP 2026] PISanitizer: Preventing Prompt Injection to Long-Context LLMs via Prompt Sanitization
An adversarially benchmarked reference implementation for pre-action AI agent authorization. Provenance-based gating for LLM agent tool calls: deny-by-default permissions, parameter lineage, signed receipts, audit logging.
⚡ DROS™ VajraClaw (Hacker Edition): Free Multi-Agent Runtime Security & Docker Governance Gateway with W3C DID & <1μs Enforcement
Protect your LLMs from prompt injection and jailbreak attacks. Easy-to-use Python package with multiple detection methods, CLI tool, and FastAPI integration.
Personal finance agent that decides whether an expense is safe — pay in full, split, use installments, or wait — from a 90-day balance forecast over real transaction history, with a deterministic decision core and a narrow multimodal evidence layer for receipts and messages.
Browser automation with evidence. An Agent Skill that lets an AI agent drive a real browser while every action passes a policy gate, every run leaves an auditable artifact, and the run compiles into a plain Playwright script that replays for free.
Belay is an open-source, local-first security layer for AI coding agents (Claude Code, Codex, Cursor, OpenClaw, Hermes Agent and MCP) that blocks dangerous commands, secret leaks, and prompt injection at the tool-call boundary in under 100ms — no LLM in the decision path by default, no cloud, no phone-home.
IntentFrame security plugin for Hermes Agent (Nous Research) — an external policy checkpoint that gates terminal, code, file, and cron tool calls before they run on your machine.
Runtime security enforcement for autonomous AI agents.
Detect and sanitize prompt injection attacks in Rails apps. Protects against direct injection (users hacking your LLMs via form inputs) and indirect injection (malicious prompts stored for other LLMs to scrape). ~70 detection patterns across 7 attack categories with configurable sensitivity levels. Now includes resource extraction detection pattern
A prompt-injection firewall for AI agents, with no AI inside: your agent reads anything and takes orders only from you. For Claude Code, Gemini CLI, MCP hosts and LangChain. | Файрвол от промпт-инъекций для ИИ-агентов без ИИ внутри: агент читает что угодно и слушается только вас.
ZhiHu CLI PRO — Cross-question deep research for Zhihu & AI Agents. Search, capture, verify, analyze large corpora, preserve evidence lineage, and synthesize across questions.
关于这个话题
- 清单取自 GitHub 话题页并按 Star 数排序,每次展示前 20 个项目;原始页面见 https://github.com/topics/prompt-injection-defense。
- 该话题在 GitHub 上共有 205 个仓库, 本站收录的是其中最热门的 20 个,不是全量列表。
- Star / Fork 每日自动刷新一次,实时数据以 GitHub 为准。
- 当前 20 个项目累计 770 Star,覆盖 5 种主要语言,数据更新于 2026-11-11。
- 中文介绍来自 GitHub 官方话题说明(github/explore)的机器翻译,可点「查看原文」对照;译文缺失时会先展示原文。