esp32-ai
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
It is notable as a practical, minimalist example of a research talk built with Quarto, and it explicitly states that the slides themselves were drafted by coding agents, making it a concrete demonstration of the workflow it discusses.
Slides for a 15-minute talk on integrating coding agents into research workflows.
Sam Abbott, London School of Hygiene & Tropical Medicine, 30 July 2026.
Rendered: samabbott.co.uk/how-I-llm
Requires Quarto and, optionally, Task.
task # render to _site/
task preview # live-reloading preview
task check # validate the Quarto project
index.qmd — title slide, talk plan, and section includes_partials/ — one file per sectionfigures/ — figures, including the model diagram from
BVDOutbreakSizestyle.css — presentation stylingThese slides were themselves drafted by coding agents; the final section describes how.
Similar projects matched by category, topics, and programming language.
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
Deltafin is a research project that runs the 2.8-trillion-parameter Mixture-of-Experts model Kimi K3 on a single Apple Silicon Mac (e.g., M1 Max with 64 GB) at about 16 seconds per token, using exact, reproducible inference with local or streaming expert loading.

A comprehensive guide for building and configuring a high-end local machine to run state-of-the-art LLMs, with detailed hardware choices, BIOS tuning, and Docker-based model serving.