$(A^2 - A + I)(A+I) = A^3 + I = I$.
To see how one knows that the matrix is invertible by just looking at it, one might recall the general fact:
> If $\sum_{n=0}^{\infty}(-1)^n A^n$ is convergent, then $I+A$ is invertible and one has:
>
> $$(I+A)^{-1} = \sum_{n=0}^{\infty}(-1)^n A^n$$
It's clearly the case here that the said series converges.