Run some cleaning filament through the extruder at the printing temperature of your PVA or ABS filament, whichever is greater, until the old stuff has been completely displaced. Then load the new filament until the cleaning filament has been completely displaced.
This should be done every time you are switching materials, unless you don't mind disassembling the extruder and/or hotend and clean it out manually.