As your matrix is singular in $\epsilon$, it is not too far-fetched to suspect that its eigenvalues will be singular, too. This is supported by the relation between the trace and determinant of a matrix and its eigenvalues, see e.g. here#Eigenvalue_relationships). So (ignoring the fact that for a $2\times 2$ matrix you can calculate its eigenvalues explicitly, and expand the result in powers of $\epsilon$), it seems a good idea to use the series $$ \lambda(\epsilon) = \sum_{j=-N}^\infty \lambda_j \epsilon^j, $$ for some suitable choice of $N$. In your case, $N=1$ will suffice; of course, you can also choose $N=2$ (or higher), but this will just yield $\lambda_{-2} = 0$. Using this approach, you'll find $$ \lambda_1 = \frac{a d- b c}{d} + \mathcal{O}(\epsilon^1)\quad\text{and}\quad \lambda_2 = \frac{d}{\epsilon} + \mathcal{O}(\epsilon^0). $$