Actually, they use that hypothesis in the part
> _a polynomial in $\alpha$ with coefficients that are polynomials in $\beta$ can be formally rewritten as a polynomial in $\beta$ with coefficients that are polynomials in $\alpha$_
to conclude that this new polynomial (seen in $(F[\alpha])[x]$) is not the zero polynomial. This is necessary to conclude that $\beta$ satisfy a **non-zero** polynomial over $F(\alpha)$ so $\beta$ is algebraic over $F(\alpha)$.