OnnxStream
About
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
⚡ Quick Start
git clone https://github.com/onnxstream.git🏷️ Topics
💻 Supported Platforms
📋 Technical Details
- Repository
- vitoplantamura/OnnxStream
- Language
- C++
- License
- NOASSERTION
- Stars
- 2,081
- Category
- text generation
- Difficulty
- intermediate
- Last Updated
- 2026-06-18
- Platforms
- web, mac
Frequently Asked Questions About OnnxStream
What is OnnxStream?
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
How do I install OnnxStream?
Run: git clone https://github.com/onnxstream.git
What are the system requirements for OnnxStream?
OnnxStream supports web, mac. It is written in C++ and is best suited for intermediate-level users. The repository has 2,081+ stars on GitHub and is licensed under NOASSERTION.