You have shown that $\varphi$ is a bijection, which is a good start. Just as a homomorphism is a function which preserves structure, an isomorphism is a bijection which preserves and reflects structure. (This is an oversimplification in general, but is accurate for these sorts of algebraic structures).
So what structure is there? The two binary operations! So, we have a binary operation $\cdot$ on $G\times H$ defined by: $$\langle g_1,h_1\rangle \cdot \langle g_2,h_2\rangle=\langle g_1\ast g_2,h_1\\# h_2\rangle$$ and a corresponding operation $\square$ on $H\times G$.
To show that $\varphi$ is an isomorphism, you have to show that $$\varphi(\langle g_1,h_1\rangle\cdot \langle g_2,h_2\rangle)=\varphi(\langle h_1,g_1\rangle)\square \varphi(\langle h_2,g_2\rangle)$$