Which CUDA/CuDNN libraries are actually required for ONNX Runtime CUDA?

[Maxi741cv]

Hi, I am trying to understand which CUDA libraries I actually need to ship with ONNX Runtime CUDA(version 1.22).

Right now, the full set of CUDA-related libraries I have is about 3 GB, and CuDNN itself adds another 1 GB. That is quite a lot, so I am wondering whether I really need to include the entire CUDA / cuDNN package, or only a smaller subset.

When I inspect ONNX Runtime CUDA with Dependency Walker, it does not show all CUDA-related dependencies. It only shows a few libraries. Because of that, I am not sure how complete or reliable that dependency list is for deployment purposes.

So my question is: how safe is it to ship only the libraries that appear as direct dependencies of ONNX Runtime CUDA? Or do I still need to include the full CUDA and cuDNN runtime package?

In other words, instead of shipping more than 4 GB of dependencies, I would like to include only the minimum required set for running ONNX Runtime CUDA, if that is supported and safe. Ideally, that would reduce the package size to something closer to 1–1.5 GB instead of 4+ GB.

List of all CUDA/CuDNN DLLs

cublas64_12.dll
cublasLt64_12.dll
cudart64_12.dll
cufft64_11.dll
cufftw64_11.dll
cuinj64_129.dll
curand64_10.dll
cusolver64_11.dll
cusolverMg64_11.dll
cusparse64_12.dll
nppc64_12.dll
nppial64_12.dll
nppicc64_12.dll
nppidei64_12.dll
nppif64_12.dll
nppig64_12.dll
nppim64_12.dll
nppist64_12.dll
nppisu64_12.dll
nppitc64_12.dll
npps64_12.dll
nvblas64_12.dll
nvfatbin_120_0.dll
nvJitLink_120_0.dll
nvjpeg64_12.dll
nvrtc64_120_0.alt.dll
nvrtc64_120_0.dll
nvrtc-builtins64_129.dll
zlibwapi.dll
cudnn64_9.dll
cudnn_adv64_9.dll
cudnn_cnn64_9.dll
cudnn_engines_precompiled64_9.dll
cudnn_engines_runtime_compiled64_9.dll
cudnn_graph64_9.dll
cudnn_heuristic64_9.dll
cudnn_ops64_9.dll

[Maxi741cv]

I'm not sure I fully trust Dependencies when it shows the list of DLLs that ONNX Runtime CUDA depends on. I'm wondering if it's possible that some libraries I removed are actually required, but just not visible in the dependency list. For example, some CUDA or cuDNN libraries might be loaded dynamically at runtime, which is why they don't appear in the static dependency analysis.

[Maxi741cv]

I managed to check which libraries are loaded dynamically. Here’s the full list but I’m not sure how to verify it for certain. Is there anywhere on their website or in the documentation that lists the libraries requiring OnnxRuntime CUDA?

cublas64_12.dll
cublasLt64_12.dll
cudart64_12.dll
cufft64_11.dll
nvrtc64_120_0.dll
cudnn64_9.dll
cudnn_engines_precompiled64_9.dll
cudnn_engines_runtime_compiled64_9.dll
cudnn_graph64_9.dll
cudnn_heuristic64_9.dll
cudnn_ops64_9.dll