keep oneself to oneself

To stay out of other people's business and not mix with them much.

"He was a quiet man who kept himself to himself — the neighbours barely knew him."

---