Antidoom is a specialized tool that generates preference data and trains LoRA adapters to reduce repetitive loops (doom loops) in language model completions using Final Token Preference Optimization.

Stars

334

7-day growth

No data

Forks

31

Open issues

0

License

Apache-2.0

Last updated

2026-07-07

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It directly addresses a specific and common failure mode in LLM reasoning—repetition loops—with a targeted, efficient approach that adapts a proven preference optimization method (Antislop) to this narrow problem, providing detailed hyperparameter guidance and multi-GPU support including AMD ROCm.

Who it is for

  • Researchers and engineers working on LLM repetition and reasoning issues
  • Developers of reasoning-focused language models (e.g., LFM series)
  • ML practitioners fine-tuning models with LoRA who need to fix output loops
  • Users with AMD GPUs who need a validated ROCm workflow

Use cases

  • Reducing doom loops in long chain-of-thought or reasoning generations
  • Industrial fine-tuning of small reasoning models (e.g., 1.2B) for production
  • Automated dataset creation for preference-based repetition suppression
  • Debugging and analyzing repetition patterns in model completions

Strengths

  • Narrow focus enables precise attack on the loop-starting token rather than full answers
  • Built on published research (Antislop) with reproducible implementation
  • Comprehensive configuration for generation, regularization, and training hyperparameters
  • Verified ROCm support with specific AMD troubleshooting and config files

Considerations

  • Only targets one failure mode (repetition loops), not general output quality or safety
  • Requires high-end GPU hardware (NVIDIA/CUDA or AMD MI-series) with sufficient VRAM
  • Training can easily overtrain if hyperparameters (learning rate, max examples) are not carefully tuned

README quick start

Quick Start

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482