duck out

To quietly leave a place or to avoid doing something you were supposed to do.

"We ducked out of the party early because we had an early flight the next morning."