7-e1even
精选
learn-agent
A collection of notes on building coding agents, derived from the production development of the desktop agent Reina, with each mechanism simplified into a zero-dependency, single-file Node.js demo.
AI 仓库情报摘要
FR-AI / ANALYSIS为什么值得关注
它提供了罕见的端到端实验体验，使用真实硬件（RNGD 作业服务器）、引导式优化和调度查看器，将底层架构理解与实用的模型优化连接起来。
适合谁使用
- AI 编译器工程师
- 性能工程师
- 对硬件-软件协同设计感兴趣的 ML 研究人员
- 从事 AI 加速器开发的 Rust 开发者
典型使用场景
- 学习 RNGD 的 vISA 内核编程
- 优化 Transformer 内核性能（GEMM、GEMV、注意力）
- 使用真实模型对 AI 加速器进行基准测试
- 练习内核融合和内存优化技术
项目优势
- 通过 RNGD 作业服务器提供真实硬件访问，测量结果准确
- 覆盖简单内核和完整的 Qwen3 0.6B 模型
- 包含调度查看器用于瓶颈分析
- 提供引导式优化和自由优化环节，附具体优化菜单
使用前须知
- 需要 x86-64 Linux 环境（不支持原生 macOS/Windows/ARM）
- 需要 Rust 工具链、cargo-furiosa-opt 和作业服务器账户
- 完整模型的仿真速度慢；真实运行需要排队提交
- 仅专注于 Furiosa RNGD，不适用于其他加速器
README 快速开始
Furiosa Optimization Tutorial
Overview
- This tutorial covers the hardware architecture and programming principles of Furiosa RNGD, a next-generation AI accelerator
- Participants use the dedicated development environment to implement and optimize Tensor Contraction and Transformer kernels
- Goal: understand the architecture, write vISA kernels, and optimize a real Qwen3 0.6B model
Prerequisites
- x86-64 Linux: published artifacts are
x86_64-unknown-linux-gnuonly, sobinstallfinds nothing on macOS, Windows, or ARM- macOS: work in an x86-64 Linux container (setup)
- Windows: work in an x86-64 Linux container (e.g. WSL2)
- Rust toolchain and
cargo-furiosa-opt: installed during the lecture (Section 1) - Qwen3 0.6B baseline code: provided separately
- RNGD job server account: sign up with your GitHub username before the lab
Submit your GitHub username via the Google Form. Accounts on the job server are provisioned from those usernames, so the form must close before the lab starts.
Company Intro (10:00 to 10:15, 15 min)
- FuriosaAI is committed to provide a programmable AI accelerator.
1. Installation and Quick Start (10:15 to 10:50, 35 min)
1.1 Installation (book: Introduction)
# 1. Rust toolchain: install rustup from https://rustup.rs/, then pin nightly
rustup toolchain install nightly-2026-05-01
# 2. cargo-furiosa-opt
cargo install cargo-binstall
cargo binstall cargo-furiosa-opt
# 3. Project scaffold
cargo install cargo-generate
cargo generate furiosa-ai/furiosa-opt base-template # prompt: enter base-template
cd base-template
-
cargo-furiosa-optis prebuilt: the installing toolchain is irrelevant, the scaffold'srust-toolchain.tomlpins the build one -
The
Favorite ... not found in configline fromcargo generateis expected -
RNGD SDK and driver: required only for
--backend npu -
Today's lab: emulation and RNGD job server (SDK on the job server)
-
Job server (https://arena.furiosa.ai): get in before Section 1.3, in two steps:
- A. Sign in to the web UI: open https://arena.furiosa.ai, log in with GitHub SSO. Your account exists only if the GitHub username you submitted in the form (see Prerequisites) was registered, if the log
相关仓库与替代方案
根据分类、Topic 和编程语言匹配的相似项目。
slvDev
精选
esp32-ai
A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.
jamesob
精选
local-llm
A comprehensive guide for building and configuring a high-end local machine to run state-of-the-art LLMs, with detailed hardware choices, BIOS tuning, and Docker-based model serving.