Holo 是一款实验性的 macOS 应用,通过内置麦克风将 MacBook 周围桌面划分为四个可指定轻触区域,在本地实时分类并执行对应动作。

Stars

516

7 天增长

+103

Fork 数

71

开放 Issue

4

开源协议

暂无数据

最近更新

2026-07-21

AI 仓库情报摘要
FR-AI / ANALYSIS

为什么值得关注

它是一个研究原型,完全在本地处理,不上传任何数据;提供详细的校准指引、质量检查和否定样本训练,并配有全面的诊断与评估系统,致力于可重复的声学交互。

适合谁使用

  • 希望免接触快速触发应用的 macOS 高级用户
  • 研究声学人机交互的学者
  • 探索设备端机器学习用于空间输入的开发者
  • 寻求桌面上下文相关操作以提高效率的生产力用户

典型使用场景

  • 打字或写作时免接触启动应用、运行命令或快捷指令
  • 辅助技术:为难以使用键盘或鼠标的用户提供替代交互方式
  • 桌面工作流程:比如启动计时器、复制文本或用语音合成朗读
  • 评估声学感知技术的实验性应用

项目优势

  • 隐私优先:所有处理在本地完成,默认丢弃原始音频
  • 校准过程严谨:包含用户指导、质量检查、一致性验证和否定样本收集
  • 支持多种感应模式(被动、主动声学探测、混合),并提供诊断对比功能
  • 具备完善的评估工具,可生成含延迟、混淆矩阵的 JSON/CSV 报告

使用前须知

  • 配置档案仅针对特定 MacBook、桌面、房间和 Mac 位置;拒绝外部麦克风输入
  • 依赖于稳定、刚性的桌面和一致敲击方式;柔软或不稳固的桌面可能无法获得可区分区域
  • 实验性主动探测可能被硬件过滤或被用户听到;80% 准确率和 200ms 延迟指标尚未在所有设置上验证

README 快速开始

Holo

Holo is an experimental native macOS utility that turns the desk immediately around a MacBook into four assignable tap zones. It listens through the selected Mac microphone, extracts acoustic features from short impulse windows, classifies the zone locally, and runs the action assigned to that zone.

The topology is intentionally four broad zones:

                  Display side
Left Rear      ┌─────────────┐      Right Rear
               │   MacBook   │
Left Front     └─────────────┘      Right Front
                  Trackpad side

Holo is a research prototype. Automated DSP tests pass, but useful accuracy still has to be measured on each real MacBook, desk, room, and laptop position. No physical accuracy claim is made without a saved 60-tap evaluation from that setup.

The requirement-by-requirement evidence ledger is in ACCEPTANCE.md.

What is implemented

  • Four fixed zones: rear and front zones on each side of the MacBook.
  • Explicitly armed calibration: ten accepted examples spread across each zone, 40 total, with clear retry guidance for weak, noisy, or clipped taps.
  • A calibration-consistency check that identifies and can redo the weakest zone before saving.
  • Adaptive streaming onset detection, sustained-sound rejection, and fixed 90 ms analysis windows.
  • Passive tap acoustics, an optional active acoustic probe, and a hybrid mode.
  • Robust feature normalization, a regularized linear zone model backed by nearest-example novelty checks, ambiguity rejection, out-of-distribution rejection, and optional negative examples.
  • Per-profile actions: visual only, play a sound, copy or speak text, open a website, run a Shortcut, open an application or item, execute a shell command, or capture a screenshot. New zones default to visual-only until the user assigns a side effect.
  • Guided 60-tap held-out evaluation with per-zone accuracy, latency, rejected-tap counts, and a confusion matrix.
  • Saved evaluation history is restored after relaunch and scoped to the desk profile that produced it.
  • Signal diagnostics, labeled feature capture, approach comparison, JSON/CSV reports, and opt-in raw debug WAV capture.
  • Sandboxed, local persistence. Raw audio is discarded by default.
  • Core Audio route validation requires the built-in microphone for every mode and the built-in speakers for Active or Hybrid sensing.

Requiremen

相关仓库与替代方案

根据分类、Topic 和编程语言匹配的相似项目。

Blaizzy
精选
Blaizzy GitHub avatar

nativ

Nativ is a native macOS app that lets you run AI models locally on Apple silicon, offering chat, model management, performance analytics, and an OpenAI/Anthropic-compatible API server.

AI 与机器学习AI 视觉与语音
985
uzairansaruzi
精选
uzairansaruzi GitHub avatar

hermex

Hermex is a native SwiftUI iPhone app that lets you control a self-hosted Hermes AI agent directly from your phone, with no subscriptions, tracking, or third-party relay.

AI 与机器学习大语言模型
941
simonw
精选
simonw GitHub avatar

speech-analyzer-cli

A macOS command-line tool that uses Apple's on-device speech APIs to transcribe prerecorded audio into plain text, JSON, JSONL, SRT, or WebVTT.

开发者工具CLI 与终端
20