Your shell's history is saved in the file indicated by the `HISTFILE` variable. So:
unset HISTFILE
This also applies to zsh, but not to ksh which keeps saving to the file indicated by `$HISTFILE` when the shell starts (and conversely, you decide to save your history in ksh once you've started the shell).