The answer is yes:
Let $U \trianglelefteq G$ be connected unipotent. Then the image of $U$ in $G/N$ is also connected unipotent normal, so it is trivial because $G/N$ is reductive. In other words $U \trianglelefteq N$. But $N$ is also reductive so $U$ is trivial.