ForceBand 是一种低成本腕戴式 sEMG+IMU 手环,通过 EMG2Force 模型(DINOv2 ViT‑S 频谱编码器 + Transformer)预测每根手指指尖的力。

Stars

52

7 天增长

暂无数据

Fork 数

3

开放 Issue

1

开源协议

Apache-2.0

最近更新

2026-07-24

AI 仓库情报摘要
FR-AI / ANALYSIS

为什么值得关注

它提供了开源、预训练的模型,能够从表面肌电图实现强大的指尖力预测,并通过简单的校准流程将机器人演示中的误差降低约 5 倍。

适合谁使用

  • 从事灵巧操作的机器人研究者
  • 开发可穿戴输入设备的人机交互工程师
  • 寻求非侵入力估计的假肢开发者
  • 研究肌电力量推断的学术人员

典型使用场景

  • 通过校准将人类手部力量技能迁移至机器人手
  • 估计假肢或外骨骼控制中的抓握力
  • 分析精细运动技能或康复进展
  • 使用低成本硬件实现力感知交互系统

项目优势

  • 在 Apache‑2.0 许可下发布了开源预训练检查点和验证数据
  • 在少量演示集上校准使力预测误差降低约 5 倍(MAE 从 46.0 降至 9.5)
  • 在保留的会话中拇指/食指/中指力跟踪良好(R² 0.68/0.65/0.50)
  • 低成本硬件设计,公开了物料清单和肌电硬件调查

使用前须知

  • 完整预训练数据集和 DIY 硬件教程尚未发布
  • 环指和小指的力噪声较大且携带的力较小
  • 迁移到新设置(不同传感器放置或环境)时需要校准

README 快速开始

ForceBand: Learning Forceful Manipulation with sEMG

     

Official EMG2Force model code for "ForceBand: Learning Forceful Manipulation with sEMG" (arXiv:2606.26093 · project page).

ForceBand is a low‑cost wrist‑worn sEMG + IMU band; its EMG2Force model predicts per‑finger fingertip forces (thumb, index, middle, ring, pinky) from the 8‑channel sEMG + IMU stream — a DINOv2 ViT‑S spectrogram encoder + Transformer (~28.5 M params) that conditions on the previous window's force for continuity.

EMG2Force on a held‑out validation session — predicted (color) vs. ground‑truth (grey) per‑finger force. -->

What ships

ArtifactStatusWhere
✅ Pretrained checkpoint (DINOv2, Apache‑2.0)releasedcheckpoints/
✅ Validation set — held‑out pretraining chunks, ~5‑min quick checkpoint testreleaseddata/val/ · data/splits/val.txt
✅ Deploy‑demo set — calibration + held‑out validationreleaseddata/demos/ · data/splits/{calib,demo_val}.txt
⏳ Full pretraining datasetunder preparation
➕ RGB overlay videos (optional, ~1.3 GB)Google Drivescripts/download_videos.py

Roadmap

Before paper acceptance

  • Hardware Bill of Materials (BOM)
  • Hardware DIY tutorial (build your own ForceBand)
  • EMG hardware survey — sEMG front‑ends / electrodes / acquisition boards compared
  • Full pretraining dataset
  • Robot policy training pipeline
  • DINOv3 backbone variant — its license needs further validation on our side before we redistribute, so for now we ship DINOv2; planned as an opt‑in download‑DINOv3‑yourself recipe (the two perform on par — see Backbones)

Install

conda env create -f environment.yml && conda activate emg2force
pip install -e .                          # or: pip install -r requirements.txt

GPU recommended. **No bac

相关仓库与替代方案

根据分类、Topic 和编程语言匹配的相似项目。

lopopolo
精选
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI 与机器学习AI 智能体
2,390
slvDev
精选
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI 与机器学习大语言模型
1,960
littledivy
精选
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI 与机器学习
1,482