Your last paragraph is basically already the answer to your question. Suppose $A$ is hollow. Then for any (nonempty) open set $O$, $O$ must contain some $x\in \mathbb{R}\setminus A$ (why? otherwise $O$ would be a subset of the interior of $A$, which would make $A$ not hollow).
But this is _exactly_ the statement that the complement of $A$ is dense!
So indeed, the complement of a hollow set is always dense.
* * *
Note that there's nothing special about $\mathbb{R}$, here - this is a general fact about topological spaces.