The first transcription factors for the first transcription after fertilization are already present in the ovum (egg) before it is fertilized.
Generally, all the machinery needed for transcription, translation, and the rest of the many necessary cellular functions are already present in a cell before it divides and develops. This chain of dependency goes back eons of time to the origin of cells and the very origin of life.