Like George says, grinders can make very aggressive buffers.
Better to buff on the lathe in my opinion, I used to use the Charnwood solely for that purpose and it always worked well.
A bit of threaded stud held in a Jacobs chuck with the tailstock up the other end held three different grades of wheel easily.