I had the same problem with Ubuntu 20.04. What I did was to update the linux kernel. If you type
uname -a
to find out which version you have, then see if you are on 5.6 or 5.8
I was on 5.6-1020 and then updated to 5.8 by using the following command:
sudo apt install linux-image-5.8.0-23-generic linux-headers-5.8.0-23-generic linux-buildinfo-5.8.0-23-generic linux-modules-5.8.0-23-generic linux-modules-extra-5.8.0-23-generic
I noticed that in PulseAudio Volume Control, I can now actually disable the non working microphone under the configuration tab. Whereas before I couldn't.