CUDA Toolkit Installer https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local Tensor RT Download deb installer from: https://developer.nvidia.com/tensorrt/download/10x Instructions: https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html#installing-debian cuDNN 9.4.0 https://developer.nvidia.com/cudnn-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local To install for CUDA 11, perform the above configuration but install the CUDA 11 specific package: To install for CUDA 12, perform the above configuration but install the CUDA 12 specific package: