Ok, it is not true.
Consider $\dot x = -x +e^{-3t}$.
The solution is $x=c_1e^{-t}-0.5e^{-3t}$ with $c_1=x_0+0.5$.
So $\|x\|$ has a part that is independent from $x_0$, which means that for arbitrarily small $\|x_0\|$, the exponential stability condition breaks.