为什么值得关注

它提供完全本地、开源的 AI 代理，具有两种明确模式（教学模式和代理模式）、语音控制和紧急终止开关，且无需任何云连接（除了用户自己的 OpenAI API）。

适合谁使用

寻求本地自动化的 Mac 高级用户
探索 AI 代理框架的开发者
演示 macOS 工作流程的教育者与培训者
希望完全控制 API 使用情况的注重隐私的用户

典型使用场景

自动化重复性 macOS 任务，如文件整理或应用启动
通过教学模式的逐步讲解学习 Mac 操作
使用自定义语音命令创建并触发已保存的工作流
在受控本地环境中测试和调试 AI 代理行为

项目优势

两种明确模式（教学模式和代理模式）并带有代码级强制执行限制
具备自适应噪声门控和免提监听的语音输入
支持保存和重用任务序列的工作流系统
通过辅助功能 API 实现光标保持控制，仅在必要时回退到 CGEvent

使用前须知

需要有效的 OpenAI API 密钥并产生使用费用
仅支持 macOS 13+，且需手动授予屏幕录制、辅助功能和麦克风权限
无内置云服务集成（Notion、Gmail 等），且缺少执行前确认机制

README 快速开始

UltraClicky

An open-source, local AI agent that lives in your menu bar, sees your screen, and drives your Mac. Summon it next to your cursor, type a request, and it either answers + points at the screen (tutor mode) or does the task (agent mode) by controlling the Mac itself.

There are no cloud connectors (no Notion, Gmail, Calendar, etc.). The agent's only powers are: see the screen, and drive this Mac. The loop runs against your own OpenAI key through a speech-to-speech Realtime session when voice is active.

macOS 13+ · Swift · AppKit + SwiftUI · built with XcodeGen.

Setup — the only three things you do

Paste your OpenAI key into a local .env file in the project root:
```
api-key=''
```
(Copy .env.example to .env if you don't have one. Never commit your real key.)

Generate the project, then build and run:

brew install xcodegen        # if you don't have it
xcodegen generate            # creates Clicky.xcodeproj from project.yml
open Clicky.xcodeproj         # then build & run (⌘R) in Xcode

…or from the command line:

xcodebuild -project Clicky.xcodeproj -scheme Clicky -configuration Debug build

On first launch, grant the three macOS permissions when prompted. The setup window lists each one with a button that deep-links to the right System Settings pane:
- Screen Recording — so the agent can see what you see.
- Accessibility — so it can read the UI and act in place (without moving your cursor).
- Microphone — only for voice input from the mic button.
These prompts require manual approval in System Settings and cannot be skipped or pre-granted by code. The setup window re-checks status when you return to it.

If api-key is missing or empty at launch, the setup window shows a clear message pointing you to .env. The key is only ever read from local runtime configuration — it is never hardcoded.

.env is ignored by Git and is not copied into the app bundle. If you launch the app from somewhere that cannot find the project-root .env, point at a specific file with the CLICKY_ENV_PATH environment variable.

How to use it

Summon: press ⌃⌥ (Control + Option). A floating, semi-transparent input panel appears near your cursor. P

项目描述

A repository for ultraclicky

ultraclicky