Elemental-EL GitHub avatar

InfernoNet-Quantization

Elemental-EL

InfernoNet implements static INT8 post-training quantization on a custom CNN for fire detection, exporting quantized weights and dyadic requantization parameters for edge deployment on AVX-VNNI CPUs and FPGAs.

Stars

3

7-day growth

No data

Forks

0

Open issues

0

License

No data

Last updated

2026-07-29

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It bridges PyTorch FX graph quantization with bare-metal hardware verification by converting floating-point requantization into hardware-ready dyadic fractions, achieving 3.72x compression while preserving spatial features.

Who it is for

  • Researchers in efficient deep learning and model compression
  • Hardware engineers working on FPGA or NPU inference accelerators
  • Developers building fire detection systems for edge devices
  • Students learning about graph-mode quantization and hardware-aware deployment

Use cases

  • Deploying low-latency fire detection on embedded systems with integer-only ALUs
  • Verifying custom FPGA datapath outputs against a PyTorch reference model
  • Teaching FX graph quantization and post-training quantization workflows
  • Comparing memory footprint savings of INT8 vs FP32 models in resource-constrained environments

Strengths

  • Achieves 3.72x compression (0.96 MB to 0.26 MB) via FX graph quantization
  • Uses Global Average Pooling to drastically reduce memory before fully-connected layers
  • Employs per-channel affine weight quantization and per-tensor activation quantization with 7-bit input range to avoid overflow
  • Exports dyadic (integer multiplier + bit-shift) requantization parameters for integer-only hardware

Considerations

  • No accuracy metrics reported comparing FP32 and INT8 models, making it hard to assess degradation
  • Designed specifically for AVX-VNNI architectures and bare-metal FPGA testbenches, limiting general CPU deployment
  • The custom fire dataset is not publicly available, requiring users to collect and preprocess their own data

README quick start

Usage

  1. Train the FP32 model:

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482