This is a wordplay analogous to "holy moly" or "see you later alligator". It's completely nonsense except that it sounds somewhat rhythmical and humorous. See for similar examples. (Note that rhyming in its narrow sense is less important in Japanese.)
( **EDIT** : Or maybe you can think of this as a "prologue to the scat part" since scat consists of meaningless vocals.)
To be clear, and are not "different ways to write dolphin". This English word is always written as in katakana.