Unless I'm mistaken, you can add a sufficiently large "cyclic ladder" to the Frucht graph as in: !alt text
I would argue that, in an automorphism, the right-hand side would need to be mapped to itself. Therefore, an automorphism of the above graph would imply an automorphism of the Frucht graph (and therefore must be trivial).
An infinite version could be constructed by appending two infinite ladders instead (actually, I'm pretty sure you could attach one infinite ladder).