ForceBand: Learning Forceful Manipulation with sEMG
Official EMG2Force model code for "ForceBand: Learning Forceful Manipulation
with sEMG" (arXiv:2606.26093 ·
project page).
ForceBand is a low‑cost wrist‑worn sEMG + IMU band; its EMG2Force model
predicts per‑finger fingertip forces (thumb, index, middle, ring, pinky) from the
8‑channel sEMG + IMU stream — a DINOv2 ViT‑S spectrogram encoder + Transformer
(~28.5 M params) that conditions on the previous window's force for continuity.
EMG2Force on a held‑out validation session — predicted (color) vs. ground‑truth (grey) per‑finger force.
-->
What ships
| Artifact | Status | Where |
|---|
| ✅ Pretrained checkpoint (DINOv2, Apache‑2.0) | released | checkpoints/ |
| ✅ Validation set — held‑out pretraining chunks, ~5‑min quick checkpoint test | released | data/val/ · data/splits/val.txt |
| ✅ Deploy‑demo set — calibration + held‑out validation | released | data/demos/ · data/splits/{calib,demo_val}.txt |
| ⏳ Full pretraining dataset | under preparation | — |
| ➕ RGB overlay videos (optional, ~1.3 GB) | Google Drive | scripts/download_videos.py |
Roadmap
Before paper acceptance
Install
conda env create -f environment.yml && conda activate emg2force
pip install -e . # or: pip install -r requirements.txt
GPU recommended. **No bac