An interactive GridWorld reinforcement learning visualizer that lets users watch Q-Learning, Policy Iteration, and basic Monte Carlo agents learn in real time through a 2x2 canvas of heatmaps, policies, reward curves, and step-by-step explanations.

Stars

4

7-day growth

No data

Forks

0

Open issues

0

License

No data

Last updated

2026-07-31

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It makes otherwise abstract RL concepts such as Q-tables, TD errors, and policy iteration visible and interactive, and it is designed specifically as a learning and experimentation sandbox with ready-to-run agents plus TODO templates.

Who it is for

  • Students beginning reinforcement learning
  • Instructors or trainers looking for interactive RL teaching demos
  • Developers experimenting with Q-Learning or custom agents
  • Hobbyists interested in GridWorld algorithms

Use cases

  • Observing how a Q-table changes with each step in real time
  • Comparing Q-Learning, Policy Iteration, and Monte Carlo behavior on the same map
  • Implementing and testing a custom agent such as SARSA by editing a designated agent file
  • Teaching or self-studying RL concepts like value iteration, exploration, and TD updates

Strengths

  • Provides a rich visual interface: state-value heatmap, greedy-policy arrows, cumulative reward curve, step explanation, and selected-cell Q-values.
  • Supports multiple runnable agents (Q-Learning, Policy Iteration, basic Monte Carlo) and code templates for extension.
  • Allows real-time interaction: pause, single-step, reset episodes, regenerate maps, click cells, and adjust hyperparameters with keyboard controls.
  • Offers configurable maps and an agent abstraction that defines clear interfaces for custom algorithms.

Considerations

  • The included non-Q-Learning agents are basic; Policy Iteration and Monte Carlo templates require completing TODOs for deeper learning.
  • The Monte Carlo agent updates only at episode end, so single-step Q-after values can appear unchanged, which may confuse users.
  • The repository is a desktop Matplotlib visualization project, not a full RL library or production training framework.

README quick start

安装与运行

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482