NVIDIA GPU¶
CVEDIA-RT can run on any NVIDIA GPU with Compute Capability greater or equal to 6.1 in both Windows and Linux.
Supported Cuda Compute Capability¶
| CC | Notes |
|---|---|
| 5.2 | deprecated |
| 5.3 | jetson nano |
| 6.0 | limited support |
| 6.1 | |
| 7.0 | limited support |
| 7.2 | jetson agx / nx |
| 7.5 | |
| 8.0 | limited support |
| 8.6 | |
| 8.7 | orin agx / nx / nano |
| 8.9 | CVEDIA-RT 2024.1.0 and newer |
| 9.0 | limited support; CVEDIA-RT 2024.1.2 and newer |
Supported TensorRT versions¶
| Version | Notes |
|---|---|
| 8.0.1 | |
| 8.0.3 | |
| 8.2.1 | |
| 8.2.2 | Native compatible |
| 8.2.3 | |
| 8.2.4 | |
| 8.2.5 | |
| 8.4.1 | |
| 8.4.1.5 | |
| 8.5.0 | |
| 8.5.2 | |
| 8.5.3 | |
| 8.6.1 | jetson / orin |
| 8.6.1.2 | deprecated in favor of 8.6.1.6 |
| 8.6.1.6 | CVEDIA-RT 2024.1.0 and newer - Native compatible |
| 8.6.3.1 | CVEDIA-RT 2024.1.2 and newer |
Deprecated cuda compute / versions may support some models but not the most recent ones, when this happens CVEDIA-RT will fall back to the next best backend.
Running Natively
When running CVEDIA-RT Natively on linux the versions of libnvinfer8 must align with our release version, otherwise models won't load.