TatarinBlack GitHub avatar

ai-runtime-security-sandbox

TatarinBlack

An educational RAG chatbot sandbox that demonstrates live attacks like Prompt Injection and Tool Abuse, with a secure mode to show defenses, all running locally and offline.

Stars

34

7-day growth

No data

Forks

22

Open issues

0

License

MIT

Last updated

2026-07-27

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It provides a unique live-demo experience with one-click attack scenarios, a single toggle to switch between vulnerable and secure modes, and an in-app architecture/attack flow panel designed for conference talks, all mapped to OWASP LLM and Agentic Top 10.

Who it is for

  • Security conference speakers and attendees
  • AI/ML security engineers and researchers
  • Developers building RAG chatbots or AI agents
  • Educators teaching AI security concepts

Use cases

  • Live demonstration of prompt injection and tool abuse in a conference talk
  • Hands-on training for understanding RAG chatbot vulnerabilities
  • Testing and comparing different LLM providers' behavior under attack
  • Offline rehearsal of security demos without internet dependency

Strengths

  • Fully offline and deterministic mock provider ensures 100% reliability
  • Seven pre-configured attack scenarios with one-click execution
  • In-app Attack Flow panel narrates attack mechanics for audience without slides
  • Supports multiple LLM providers (OpenAI, Claude, Gemini, local) via simple .env config

Considerations

  • Intentionally vulnerable and explicitly not suitable for production deployment
  • TF-IDF retrieval is tuned to exact scenario prompt wording, limiting free-form exploration
  • Default port 8000 may conflict with other services if not changed

README quick start

AI Runtime Security Sandbox

A fully local, self-contained RAG chatbot built to make Prompt Injection, Tool Abuse, Excessive Agency, Data Leakage, and Insecure Output Handling visible — live, in front of an audience.

⚠️ This is an intentionally vulnerable educational sandbox. It is built to demonstrate real attack techniques against a RAG chatbot, live, in a conference talk. Do not deploy it to a public or production environment. Full disclaimer in SECURITY.md.

Seven live attack scenarios, one click each, with a Secure Mode switch that shows the exact same attack get blocked in real time — plus an in-app Architecture view and an Attack Flow panel so an audience can follow along without a single slide. Mapped to both the OWASP Top 10 for LLM Applications and the brand-new OWASP Top 10 for Agentic Applications (2026).

Built as the companion sandbox for the talk "AI Runtime Security: Breaking (and Defending) RAG Chatbots — Live" (Azure OpenAI · RAG Agents · Process & Culture track). Slides are in /slides.

Table of contents

Why this exists

Traditional security controls protect networks, endpoints, identities, and applications. RAG chatbots and AI agents open a new attack surface: prompts become input, models become decision engines, agents execute actions, and tools get direct access to business systems. This sandbox makes five OWASP LLM Top 10 risk categories, plus one from the newly published OWASP Top 10 for Agentic Applications (2026) — ASI04: Agentic Supply Chain Vulnerabilities, via an MCP tool poisoning demo — reproducible and demonstrable in minutes, against your choice of Azure OpenAI, OpenAI, Anthropic Claude, Google Gemini, or any local OpenAI-compatible model, with zero setup cost thanks to a built-in offline mock model.

Quickstart

`

Description

Live RAG chatbot security demo — prompt injection, tool abuse, excessive agency

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482