Take $ S = \Bbb{Z}$ and take $R = \Bbb{Z}[\sqrt{-3}]$. Then $R$ is f.g. over $S$ (in fact free of rank $2$) but now $R$ is not integrally closed: The quotient field of $R$ is $\Bbb{Q}(\sqrt{-3})$ and $ \frac{1 + \sqrt{-3}}{2}$ is in here, and this is integral over $R$ being a solution of $x^2 - x + 1$. But this element is not in $R$.