worry back

Avancé (C1) informal

To slowly and carefully move something back, or to keep thinking about a worry and bringing it back to your mind.

"The surgeon slowly worried the bone fragment back into place."