The factorial function is defined to count the number of bijections between finite element sets, namely $n!=$ # $ f: \\{1,..,n\\} \to \\{1,..,n\\}$ that are bijective. There is precisely one bijective map $f : \emptyset \to \emptyset$, namely f is the empty map.
I recognize this is a very odd concept. Hope this helps.