esp32-ai
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
它独特地结合了聊天模式的 TUI 和共享的提示生成核心,支持超过十个后端及自定义端点,内置拒绝处理和按目标学习功能,能随时间改进生成的提示。
Chat-mode forge for persona-layer system prompts.
State a goal. A permissive generator model drafts a complete, ready-to-paste system prompt. You paste it into any target LLM's system / custom-instructions field (a chat.claude.ai project, a custom GPT, a Gemini Gem, a Grok personality, an OpenRouter system message, Cursor rules…) and the target loads into a compliant, in-character state for your domain.
The draft streams live, lands in a highlighted panel, auto-copies to your clipboard, and auto-saves to disk. Paste the target's refusal back and Forge re-angles it.
⚠ Authorized use only. Forge is a research and red-teaming tool, intended for evaluating and testing systems you own or are explicitly authorized to assess. Use it only within the bounds of a permitted engagement, and in line with the terms of service of any model or provider involved. You are responsible for how you use it.
Forge is a terminal app (with a one-shot CLI twin) that turns a plain-English goal into a finished, paste-ready system prompt for a target model. The generation logic — architecture styles, the sanitizer, refusal detection — lives in one shared core, so the chat TUI and the CLI can never drift apart. Every model provider is reached through the same OpenAI-compatible interface, so one code path drives all of them.
Chat-mode forge for persona-layer system prompts — live model picker, per-target learning, any OpenAI-compatible backend. Cross-platform.
根据分类、Topic 和编程语言匹配的相似项目。
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
Deltafin is a research project that runs the 2.8-trillion-parameter Mixture-of-Experts model Kimi K3 on a single Apple Silicon Mac (e.g., M1 Max with 64 GB) at about 16 seconds per token, using exact, reproducible inference with local or streaming expert loading.

A comprehensive guide for building and configuring a high-end local machine to run state-of-the-art LLMs, with detailed hardware choices, BIOS tuning, and Docker-based model serving.