How does Ubuntu lock my Live USB? I notice that, after booting from my Live USB (with Ubuntu inside) and shutdown, I won't be able to boot it again, unless I unplug the USB and plug it in again. Is this a side-effect of something, or is it intentional? I wonder what mechanism is used to do this?

This is probably caused by some peculiarity of your BIOS. Definitely not intentional.