The Cauchy-Hadamard Theorem tells us that for every power series over $\mathbb C$, there is an $R \in [0, \infty]$ such that the series converges for $|x| < R$ and diverges for $|x| > R$. So yes, it is always a circle of convergence.
Edit: Yes, it can go both ways on the boundary. Usually that's still called a circle of convergence, tough.