bugger around

To do nothing useful, or to mess someone around.

"We spent the whole afternoon buggering around instead of packing for the trip."