Every connected Lie group $G$ has a maximal compact subgroup $K$ to which it is homotopy equivalent; in particular $G$ and $K$ have the same cohomology (with any coefficients). The maximal compact subgroup of the Galilean group is the subgroup $SO(3)$ of rotations. Topologically this is real projective space $\mathbb{RP}^3$, whose real (and even rational) cohomology is the same as that of the $3$-sphere $S^3$: we have $H^0 \cong H^3 \cong \mathbb{R}$ and all other real cohomology vanishes.
Hence, if you like, there is a "3-dimensional hole." But IMO one shouldn't take this hole idea too seriously as a description of cohomology.