NVIDIA GPU¶
CVEDIA-RT can run on any NVIDIA GPU with Compute Capability greater or equal to 7.5 in both Windows and Linux.
Supported Cuda Compute Capability¶
| CC | Notes |
|---|---|
| 5.2 | Deprecated |
| 5.3 | Jetson Nano - Limited support |
| 6.0 | Deprecated on TensorRT 10 |
| 6.1 | Deprecated on TensorRT 10 |
| 7.0 | Deprecated on TensorRT 10 |
| 7.2 | Jetson AGX / NX |
| 7.5 | End of life |
| 8.0 | Limited support |
| 8.6 | |
| 8.7 | Orin AGX / NX / Nano |
| 8.9 | CVEDIA-RT 2024.1.0 and newer |
| 9.0 | Limited support; CVEDIA-RT 2024.1.2 and newer |
| 10.0 | 2025.1.0 and newer |
| 12.0 | 2025.1.0 and newer |
Deprecations
- Starting on CUDA 13, Desktop GPUs with cuda compute lower than 7.5 (not included) are no longer supported, you should install CUDA 12.x to be compatible.
- When running CVEDIA-RT with TensorRT 10 the minimum supported cuda compute is 7.5
Supported TensorRT versions¶
| Version | Notes |
|---|---|
| 8.0.1 | Limited support |
| 8.0.3 | Limited support |
| 8.2.1 | Limited support |
| 8.2.2 | Limited support |
| 8.2.3 | Limited support |
| 8.2.4 | Limited support |
| 8.2.5 | Limited support |
| 8.4.1 | Limited support |
| 8.4.1.5 | Limited support |
| 8.5.0 | Limited support |
| 8.5.2 | Limited support |
| 8.5.3 | Limited support |
| 8.6.1 | Jetson / Orin |
| 8.6.1.2 | Deprecated in favor of 8.6.1.6 |
| 8.6.1.6 | CVEDIA-RT 2024.1.0 and newer - Native compatible |
| 8.6.3.1 | CVEDIA-RT 2024.1.2 and newer |
| 10.8.0.43 | CVEDIA-RT 2025.1.0 and newer - Experimental |
| 10.13.2.6 | CVEDIA-RT 2025.1.0 and newer - Same version on all platforms, expected to be LTS |
Deprecated cuda compute / versions may support some models but not the most recent ones, when this happens CVEDIA-RT will fall back to the next best backend.
Running Natively
When running CVEDIA-RT Natively on linux the versions of libnvinfer8 must align with our release version, otherwise models won't load.