This Must Be Set On Each Container You Launch, After The Container Toolkit Has Been.
Using an nvidia gpu inside a docker container requires you to add the nvidia container toolkit to the host. This integrates the nvidia drivers with your container runtime. The nvidia container toolkit provides different options for enumerating gpus and the capabilities that are supported for cuda containers.