Well, I've found a solution (I didn't think of it myself) so I'm posting it. I'm not sure what the protocol is for answering your own question.
Under the assumption $X,Y$ are not a.s constant, the first answer to this question proves the contrapositive.