vllm-omni
⭐ 5.5k stars💬 text generation🔧 Pythonintermediate📄 Apache-2.0🔄 2026-07-08
About
A framework for efficient model inference with omni-modality models
⚡ Quick Start
pip install vllm-omni🏷️ Topics
💻 Supported Platforms
maclinuxwindows
📋 Technical Details
- Repository
- vllm-project/vllm-omni
- Language
- Python
- License
- Apache-2.0
- Stars
- 5,473
- Category
- text generation
- Difficulty
- intermediate
- Last Updated
- 2026-07-08
- Platforms
- mac, linux, windows
Frequently Asked Questions About vllm-omni
What is vllm-omni?
A framework for efficient model inference with omni-modality models
How do I install vllm-omni?
Run: pip install vllm-omni
What are the system requirements for vllm-omni?
vllm-omni supports mac, linux, windows. It is written in Python and is best suited for intermediate-level users. The repository has 5,473+ stars on GitHub and is licensed under Apache-2.0.