FTDNA will include segments as small as 1cM in X-matches; you'll need to compare in the chromosome browser to see how much you share with these paternal matches. If these matching segments on the X chromosome turn out to be very small segments, they're most likely Identical By Chance (IBC) and can be disregarded.