swing back

To move back the other way like a pendulum, or for something (like an election result or fashion) to go back to how it was before.

"The heavy gate swung back and hit him as he walked through."

---