esp32-ai
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
An empirical study on cross-regime volatility forecasting for the KOSPI200, demonstrating that a two-parameter mean-reversion anchor generalizes across volatility regimes while XGBoost, Random Forests, and Transformers all fail with negative out-of-distribution R².
3
No data
0
0
MIT
2026-07-29
It challenges the prevailing assumption that more complex models generalize better, providing strong evidence that embedding financial theory (a simple anchor) dramatically outperforms flexible learners in out-of-distribution settings, and reveals that in-regime accuracy is uninformative about cross-regime robustness.
Why a two-parameter mean-reversion anchor generalizes where XGBoost, Random Forests, and Transformers fail.
An empirical study of out-of-distribution robustness in volatility forecasting on the KOSPI200. Six models are compared on identical data under controlled regime transitions, testing whether learned models retain forecasting skill when the volatility level shifts — and whether embedding financial theory into a neural network repairs the failure.
Status: Undergraduate research project. Preprint + code archived for the record. If you use this work, please cite via the DOI in
CITATION.cff(see below).
Cross-regime volatility generalization is a problem of structure, not capacity. Flexible learners do not fail to find a signal; they discard transferable structure that a two-parameter formula retains, in exchange for regime-specific fit.
Cross-regime R² (train on one volatility regime, test on another):
| Experiment | XGBoost | Random Forest | Transformer | soft-PINN | additive-PINN | anchor |
|---|---|---|---|---|---|---|
| E1 (low→high) | −1.15 | −1.14 | −1.11 | −1.12 | 0.68 | 0.71 |
| E2 (high→low) | −22.9 | −27.2 | −22.2 | −10.1 | 0.70 | 0.76 |
| E3 (mid→high) | −0.80 | −0.78 | −0.67 | −0.76 | 0.59 | 0.57 |
| E4 (mid→low) | −3.75 | −5.77 | −2.55 | −4.41 | −0.40 | −0.96 |
| E5 (bridge→mid) | −4.72 | −10.5 | −5.02 | −3.47 | 0.32 | 0.69 |
All four data-driven models score negative cross-regime R² everywhere (Crisis Robustness Score = 0.00). A two-parameter closed-form mean-reversion anchor, with no training, achieves positive R² on four of five experiments.
Cross-Regime Robustness of Volatility Forecasting: Why a Two-Parameter Mean-Reversion Anchor Generalizes Where XGBoost, Random Forests, and Transformers Fail
Similar projects matched by category, topics, and programming language.
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
Deltafin is a research project that runs the 2.8-trillion-parameter Mixture-of-Experts model Kimi K3 on a single Apple Silicon Mac (e.g., M1 Max with 64 GB) at about 16 seconds per token, using exact, reproducible inference with local or streaming expert loading.

A comprehensive guide for building and configuring a high-end local machine to run state-of-the-art LLMs, with detailed hardware choices, BIOS tuning, and Docker-based model serving.