whittle down

To slowly make a big list or number smaller until it's a good size.

"We have whittled the applicants down to just five candidates for the final interview."

---