shave down

To carefully make something smaller or thinner, little by little.

"He shaved down the wooden door so it would close properly."