By comparing with the line immediately above it in the paper, and assuming the authors didn't make a typo, it must be the fractional part, which is sometimes considered as "modulo 1". I suppose for these authors, the second argument of "mod" can be dropped when it is 1.