What is the lowest dimension $d$ for which the simple random walk on $\mathbb Z^d$ is transient? By "transient" I think they mean that the probability of returning to the initial point is $<1$.

The smallest such $d$ is $3$. Here is a reference.