ONNX Runtime
Open Source
Library
Cross-platform ML inference engine
About
ONNX Runtime is Microsoft's cross-platform engine for high-performance inference and training of ONNX models, with hardware acceleration across CPU, GPU, and NPUs and a dedicated generative-AI path for LLMs.
Compatibility
Supported Languages
python
c++
Details
- Category
- Library
- License
- MIT