I know very little about ordered groups, but I believe that one of their properties is that they have unique roots; i.e. for all $n \ge 1$, $x^n=y^n \Rightarrow x=y$.
The group $G$ defined by the presentation $\langle x,y \mid x^2 = y^2 \rangle$ obviously does not have unique roots, so it cannot be orderable, but it is torsion-free and solvable.
To see that, note that the subgroup $Z = \langle x^2 \rangle$ is central, and $G/Z$ is infinite dihedral. So $G$ is solvable. The only torsion elements of $G/Z$ are the images of conjugates of $x$ and $y$, and these all square into $x^2$, so $G$ is torsion-free.