It's a honing rod or honing steel. Honing isn't exactly the same thing as sharpening, but yes it will help the knife cut better.

I've heard it explained that honing is for improving the cutting edge you have, and sharpening is cutting a new edge.