Linux

Check your current power save state: Unless it has been previously changed, it should read: In this context, 3 indicates that the Network Manager will use power saving. Let’s change it to 2, indicating that the system will not use power saving. From the terminal:

Update

Repository Clone repository Edit ~/.bashrc file: Add: Reload the bash:

Display public key

CUDA Toolkit Installer https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local Tensor RT Download deb installer from: https://developer.nvidia.com/tensorrt/download/10x Instructions: https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html#installing-debian cuDNN 9.4.0 https://developer.nvidia.com/cudnn-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local To install for CUDA 11, perform the above configuration but install the CUDA 11 specific package: To install for CUDA 12, perform the above configuration but install the CUDA 12 specific package:

Edit /etc/sysctl.conf Add these at the end of the file

Increase kernel.watchdog threshold value to avoid continue server crashes