Example C.7 here states that if $F:X\times Y\to X$ is a measurable function where $X$ and $Y$ are Borel spaces, with $F(\cdot,y)$ being continuous on $X$ for any fixed $y$, and $y_t\sim m$ where $m$ is arbitrary, then $$ x_{t+1} = F(x_t,y_t) $$ is weakly (Feller) continuous Markov process. Your assumptions seem to fit, if I got what you meant by continuity in the first argument.
I also believe that the fact shall hold also for any topological space $X$ and any measurable $Y$, since the proof only uses the fact that $v(F(\cdot,y))$ is a continuous functions of $x$ whenever $v(\cdot)$ is, and the bounded convergence theorem.