It sounds like you want the Gershgorin circle theorem. Since all the off-diagonal matrix entries are at most $1$, you can guarantee that no eigenvalue of your matrix is too small by ensuring that all the diagonal entries are substantially larger than $N-1$.
That is, taking $c=N$ should suffice.