An educational full-stack NPU accelerator demo featuring a 16×16 systolic array RTL design, AXI4 SoC integration, C/Python runtime, UART driver, and TVM BYOC compiler backend, verified on FPGA with LeNet-5 inference.

Stars

17

7-day growth

No data

Forks

1

Open issues

0

License

AGPL-3.0

Last updated

2026-07-29

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It provides a complete, end-to-end open-source NPU design from RTL to neural network inference, including hardware verification on real silicon and integration with the TVM compiler stack, making it a rare educational resource.

Who it is for

  • Hardware engineers learning systolic array and SoC design
  • ML compiler developers exploring TVM BYOC backends
  • Students and researchers in computer architecture and accelerators
  • FPGA enthusiasts building custom neural network accelerators

Use cases

  • Teaching NPU architecture and full-stack accelerator design
  • Prototyping and researching systolic array and dataflow strategies
  • Developing and testing custom TVM codegen targets for NPUs
  • Running small neural networks like LeNet-5 on low-power embedded hardware

Strengths

  • Complete pipeline from RTL to inference with TVM BYOC integration
  • Hardware-verified on a Xilinx FPGA at 175 MHz achieving 44.8 GMAC/s
  • 17 self-checking testbenches and golden model ensure correctness
  • Comprehensive documentation including module specs and architectural principles in both English and Chinese

Considerations

  • Supports only INT8 precision, not floating-point or mixed-precision
  • Designed specifically for the Xilinx XCZU4EV board; porting to other FPGAs requires adaption
  • UART transport is extremely slow (~1 s per image), limiting practical deployment without PCIe/Ethernet
  • Licensed under AGPLv3, which may restrict commercial or closed-source use

README quick start

Quick Start

Description

End-to-End NPU: RTL systolic array → AXI4 SoC → TVM compiler → FPGA inference

Related repositories

Similar projects matched by category, topics, and programming language.

vercel-labs
Featured
vercel-labs GitHub avatar

scriptc

scriptc compiles ordinary TypeScript into small, fast native executables without needing Node.js, V8, or any JavaScript runtime in the binary.

Developer ToolsCode Quality & Build
1,985
jamesob
Featured
jamesob GitHub avatar

local-llm

A comprehensive guide for building and configuring a high-end local machine to run state-of-the-art LLMs, with detailed hardware choices, BIOS tuning, and Docker-based model serving.

AI & Machine LearningLarge Language Models
1,660
mereyabdenbekuly-ctrl
Featured
mereyabdenbekuly-ctrl GitHub avatar

clodex-ide

Clodex is an open-source, local-first agentic IDE that combines persistent AI tasks, code, terminal, browser, Git, models, memory, and governed execution in one Electron workspace, currently in technical preview.

AI & Machine LearningAI Agents
859