uzairansaruzi
Featured
hermex
Hermex is a native SwiftUI iPhone app that lets you control a self-hosted Hermes AI agent directly from your phone, with no subscriptions, tracking, or third-party relay.
Why it is worth attention
It bundles an mlx-vlm server with a polished UI, offering local inference, comprehensive metrics, and integrations with coding tools—all optimized for Apple’s unified memory architecture.
Who it is for
- Mac users seeking private, offline AI chat
- Developers who need a local OpenAI/Anthropic-compatible API for coding agents
- MLX model enthusiasts wanting a managed workspace on Apple silicon
- Privacy-conscious professionals requiring on-device inference
Use cases
- Running private, streamed conversations with local models and image attachments
- Serving as a local API endpoint for tools like Claude Code or OpenCode
- Monitoring model performance, token usage, and request volume in real time
- Managing and browsing a library of MLX models downloaded from Hugging Face
Strengths
- Native SwiftUI app built specifically for macOS 26+ and Apple silicon
- Leverages MLX and unified memory for efficient local inference
- Provides a unified interface for chat, server, analytics, and model management
- Supports both OpenAI and Anthropic API compatibility out of the box
Considerations
- Requires Apple silicon and macOS 26, excluding older Macs
- First-time setup and model downloads need network access
- Dedicated audio-only and image-generation models are not yet supported
README quick start
Nativ
Local AI, native to your Mac.
Chat, serve, monitor, and connect MLX models from one macOS app.
Nativ is a native macOS workspace for running AI models locally on Apple silicon. It bundles an mlx-vlm server, finds compatible models in your Hugging Face cache, and wraps the whole experience in a polished SwiftUI app.
Use Nativ as a private chat app, a model manager, a performance dashboard, or an OpenAI- and Anthropic-compatible local inference server for the tools you already use.
What Nativ can do
| Feature | What you get |
|---|---|
| Local chat and vision | Streaming conversations, image attachments, reasoning output, response metrics, and persistent chat history. |
| Model library | Discover installed MLX models, browse compatible models on Hugging Face, download them, inspect capabilities, switch models, or remove old ones. |
| Performance analytics | Track request volume, token usage, time to first token, decode speed, model performance, and recent activity. |
| Local APIs | OpenAI-compatible chat, Responses, image, audio, and model endpoints, plus Anthropic Messages endpoints. |
| Coding-tool integrations | Configure and launch Codex, Claude Code, Pi, Hermes, and OpenCode against models served by Nativ. |
| Developer workspace | Inspect runtime details, copy endpoint URLs, search and filter live server logs, and monitor server health. |
| Menu bar controls | Start or stop the server, change the loaded model, check serving statistics, and open the main app without breaking focus. |
| Advanced inference controls | Tune sampling, thinking budgets, structured output, KV-cache quantization, prefix caching, and speculative decoding. |
Inference runs on your Mac after a model has been downloaded. Model downloads and first-time build dependencies still require network access.
Coming soon
Support for dedicated audio-only and image-generation-only models is coming soon.
How it works
flowchart LR
A["Nativ · SwiftUI app"] --> B["NativServerKit"]
B --> C["Bundled mlx-vlm server"]
C --> D["MLX runtime"]
D --> E["Local models · Apple unified memory"]
F["Apps and coding agents"] -->|"localhost API"| C
NativServerKit owns the embedded Python distribution and server lifecycle. The app adds model discovery, chat, a
Description
Local AI, native to your Mac. Chat, serve, monitor, and connect MLX models from one macOS app.
Related repositories
Similar projects matched by category, topics, and programming language.
simonw
Featured
speech-analyzer-cli
A macOS CLI tool that transcribes prerecorded audio using Apple's on-device speech APIs and outputs plain text, JSON, JSONL, SRT, or WebVTT.
JustinGamer191
Holo
Holo is an experimental macOS utility that turns the desk around a MacBook into four assignable tap zones using acoustic classification and runs local actions.