Triton Inference Server
Open Source
Library
Production inference serving
About
NVIDIA Triton Inference Server is an open-source serving system for deploying models from any framework at scale, with dynamic batching, concurrent model execution, and multi-GPU support behind a standard API.
Compatibility
Supported Languages
python
c++
Details
- Category
- Library
- License
- BSD-3-Clause