weigh on

To make someone feel worried or sad over a long time, like a heavy weight in their mind.

"The unresolved argument with his brother had been weighing on him for weeks."

---