Let $n=1$ so our $1\times 1$ matrices are just numbers and let $\mathbb{H}$ be real numbers greater than or equal to 1, and $A$ be the number 2. Then $A$ is invertible and it carries elements of $\mathbb{H}$ to $\mathbb{H}$, but $A^{-1}$ carries $1$ to $1/2$ which is not in $\mathbb{H}$.