I have definitely been instructed by someone that should have known what they are doing to use a light stone w/ oil to knock off the small high spots of a number of hydraulic rams. Also fork stanchions in the bike shop.
As long as it's not chopping out the seal you'll be sweet?
And just keep looking for a nice one. Haha