The dual of the dual of an LP is the same LP again, so LP2 is the dual of LP1 iff LP1 is the dual of LP2. Which one you choose to call the primal is a matter of where you're choosing to place your attention: it's not an intrinsic fact about the LPs themselves.
Analogously, given, say, a complex number $z$, you can consider its complex conjugate $\overline{z}$. The complex conjugate of the complex conjugate of $z$ is equal to $z$ again, so it's equally valid to start with $\bar{z}$ and consider its complex conjugate $z$.