Downgrading CUDA without changing NVIDIA driver version

I'm struggling to downgrade my current CUDA version. I am using Ubuntu 20.04 LTS with NVIDIA GeForce RTX 3070 GPU, 460 drivers and CUDA 11.2. I am using tensorflow 1.13.1 as part of a machine-learning software package and for some reason the software doesn't work properly. I suspect this is because of CUDA, as I use the same software with NVIDIA TITAN V GPU, 450 drivers and CUDA 11.0 and the software works fine.

I've first tried downgrading the NVIDIA drivers to 450 as that automatically installs CUDA 11.0. However, it seems the RTX 3070 GPU only supports the 460 drivers, so downgrading the drivers is not an option.

Next, I tried downgrading only CUDA, without touching the drivers. First, I tried removing the current CUDA installation:

sudo apt-get --purge remove "*cublas*" "cuda*"

followed by installing CUDA 11.0 from the NVIDIA archive with the .deb (local) file (following the installation instructions on the website):

wget
sudo mv cuda-ubuntu2004.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget
sudo dpkg -i cuda-repo-ubuntu2004-11-0-local_11.0.3-450.51.06-1_amd64.deb
sudo apt-key add /var/cuda-repo-ubuntu2004-11-0-local/7fa2af80.pub
sudo apt-get update
sudo apt-get -y install cuda

However, this always seems to automatically revert the drivers to 450, which leads to dependency conflicts. Based on this website, CUDA 11 should support >=450 drivers, so is it possible to downgrade CUDA 11.2 to 11.0 without changing the drivers?

Many thanks!

Know someone who can answer? Share a link to this question via email, Twitter, or Facebook.