do a moonlight flit
British, informal
to leave somewhere secretly at night, usually to avoid paying money that you owe.
We could always do a moonlight flit - that way we wouldn't have to explain about the money.
Cambridge English Idioms Dictionary