Allow me to quote your reasoning:
> 1/5 chance for it to be the last one
Here is what is wrong with your reasoning: it is not guaranteed that only one roll will be a deuce. It is also possible that there are two deuces rolled.
* * *
We need the first four rolls to be not deuce and the last one to be a deuce. Each roll is independent, so we can multiply the probabilities for each roll together.
The probability for a roll to be a deuce is $\dfrac16$, and similarly the probability for a roll to be **not** a deuce is $\dfrac56$. Therefore, the required probability is $\left(\dfrac56\right)^4\left(\dfrac16\right) = \dfrac{625}{7776}$.