The wpa_supplicant need to gather some information about an AP ( availability , ESSID, BSSID ,Freq , security , channel ...) , for every connect request it will invoke some functions to update the BSS table.
Without the BSS table update the wpa_supplicant can't handle any change on an AP, so it is not possible to skip scanning.