I actually figured out the issue.
The procedure I was following was correct, I was just missing one tiny step:
pvchange -x y /dev/mapper/encryptedvolume
I recommend to follow the instructions in the question #320957 on Unix & Linux Stack Exchange, where I found the above step in the second comment of the accepted answer.