NVIDIA GPU¶
CVEDIA-RT can run on any NVIDIA GPU with Compute Capability greater or equal to 7.5 in both Windows and Linux.
Supported Cuda Compute Capability¶
| CC | Notes |
|---|---|
| 5.2 | Deprecated |
| 5.3 | Jetson Nano - Limited support |
| 6.0 | Deprecated on TensorRT 10 |
| 6.1 | Deprecated on TensorRT 10 |
| 7.0 | Deprecated on TensorRT 10 |
| 7.2 | Jetson AGX / NX |
| 7.5 | End of life |
| 8.0 | Limited support |
| 8.6 | |
| 8.7 | Orin AGX / NX / Nano |
| 8.9 | CVEDIA-RT 2024.1.0 and newer |
| 9.0 | Limited support; CVEDIA-RT 2024.1.2 and newer |
| 10.0 | 2025.1.0 and newer |
| 12.0 | 2025.1.0 and newer |
Deprecations
- Starting on CUDA 13, Desktop GPUs with cuda compute lower than 7.5 (not included) are no longer supported, you should install CUDA 12.x to be compatible.
- When running CVEDIA-RT with TensorRT 10 the minimum supported cuda compute is 7.5
Supported TensorRT versions¶
| Version | Notes |
|---|---|
| 8.0.1 | Limited support |
| 8.0.3 | Limited support |
| 8.2.1 | Limited support |
| 8.2.2 | Limited support |
| 8.2.3 | Limited support |
| 8.2.4 | Limited support |
| 8.2.5 | Limited support |
| 8.4.1 | Limited support |
| 8.4.1.5 | Limited support |
| 8.5.0 | Limited support |
| 8.5.2 | Limited support |
| 8.5.3 | Limited support |
| 8.6.1 | Jetson / Orin |
| 8.6.1.2 | Deprecated in favor of 8.6.1.6 |
| 8.6.1.6 | CVEDIA-RT 2024.1.0 and newer |
| 8.6.3.1 | CVEDIA-RT 2024.1.2 and newer |
| 10.13.2.6 | CVEDIA-RT 2025.2.0 and newer |
Deprecated cuda compute / versions may support some models but not the most recent ones, when this happens CVEDIA-RT will fall back to the next best backend.
As of 2025.2.0 RT will require CUDA 12.9 to work on TensorRT 10. TensorRT 8.x support will start it's EOL in the following releases.
Running Natively
When running CVEDIA-RT Natively on linux the versions of libnvinfer8 must align with our release version, otherwise models won't load.