TatarinBlack GitHub avatar

ai-runtime-security-sandbox

TatarinBlack

一个教育性 RAG 聊天机器人沙盒,可现场演示提示注入和工具滥用等攻击,并设有安全模式展示防御,完全本地离线运行。

Stars

34

7 天增长

暂无数据

Fork 数

22

开放 Issue

0

开源协议

MIT

最近更新

2026-07-27

AI 仓库情报摘要
FR-AI / ANALYSIS

为什么值得关注

它提供独特的现场演示体验:一键发起攻击场景、单一切换开关切换脆弱/安全模式、内置架构与攻击流程面板,专为会议演讲设计,并映射到 OWASP LLM 和 Agentic Top 10。

适合谁使用

  • 安全会议演讲者和听众
  • AI/ML 安全工程师和研究人员
  • 构建 RAG 聊天机器人或 AI 代理的开发者
  • 教授 AI 安全概念的教育工作者

典型使用场景

  • 在会议演讲中现场演示提示注入和工具滥用
  • 通过实践培训理解 RAG 聊天机器人的漏洞
  • 测试并比较不同 LLM 提供者在攻击下的行为
  • 无网络依赖的离线安全演示排练

项目优势

  • 完全离线且确定性的模拟提供者确保 100% 可靠性
  • 七个预配置攻击场景,一键执行
  • 内置攻击流程面板无需幻灯片即可向观众讲解攻击机制
  • 通过简单 .env 配置支持多种 LLM 提供者(OpenAI、Claude、Gemini、本地模型)

使用前须知

  • 故意存在漏洞,明确不适用于生产环境
  • TF-IDF 检索针对特定场景提示词调整,限制自由探索
  • 默认端口 8000 可能与其他服务冲突

README 快速开始

AI Runtime Security Sandbox

A fully local, self-contained RAG chatbot built to make Prompt Injection, Tool Abuse, Excessive Agency, Data Leakage, and Insecure Output Handling visible — live, in front of an audience.

⚠️ This is an intentionally vulnerable educational sandbox. It is built to demonstrate real attack techniques against a RAG chatbot, live, in a conference talk. Do not deploy it to a public or production environment. Full disclaimer in SECURITY.md.

Seven live attack scenarios, one click each, with a Secure Mode switch that shows the exact same attack get blocked in real time — plus an in-app Architecture view and an Attack Flow panel so an audience can follow along without a single slide. Mapped to both the OWASP Top 10 for LLM Applications and the brand-new OWASP Top 10 for Agentic Applications (2026).

Built as the companion sandbox for the talk "AI Runtime Security: Breaking (and Defending) RAG Chatbots — Live" (Azure OpenAI · RAG Agents · Process & Culture track). Slides are in /slides.

Table of contents

Why this exists

Traditional security controls protect networks, endpoints, identities, and applications. RAG chatbots and AI agents open a new attack surface: prompts become input, models become decision engines, agents execute actions, and tools get direct access to business systems. This sandbox makes five OWASP LLM Top 10 risk categories, plus one from the newly published OWASP Top 10 for Agentic Applications (2026) — ASI04: Agentic Supply Chain Vulnerabilities, via an MCP tool poisoning demo — reproducible and demonstrable in minutes, against your choice of Azure OpenAI, OpenAI, Anthropic Claude, Google Gemini, or any local OpenAI-compatible model, with zero setup cost thanks to a built-in offline mock model.

Quickstart

`

项目描述

Live RAG chatbot security demo — prompt injection, tool abuse, excessive agency

相关仓库与替代方案

根据分类、Topic 和编程语言匹配的相似项目。

lopopolo
精选
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI 与机器学习AI 智能体
2,390
slvDev
精选
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI 与机器学习大语言模型
1,960
littledivy
精选
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI 与机器学习
1,482