The displaced neighborhood won't be of that form because it won't be a neighborhood of $\infty$. If $g\in G\setminus G_\infty$, then $g(\infty)\
eq\infty$, and the image of your neighborhood under $g$ will be a neighborhood of the point $g(\infty)$, not of $\infty$.
Remember, a neighborhood of a point $z_0$ is just a set that contains a disk around $z_0$ unless $z_0=\infty$, in which case it is a set that contains the complement of a disk (together with $\infty$). So when you change from being a neighborhood of $\infty$ to a neighborhood of some other point, that doesn't mean you change the center of the disk you are taking the complement of; it means you change altogether from having the complement of a disk to a disk itself.