I got this solved myself.
Googling revealed me that there has been a change from Ubuntu 20.04 to Ubuntu 22.04 in what software is used by default for configuring network. That led me to try Ubuntu 20.04 keeping everything else the same, and that fixed this issue.