Banksia pods are a swine as the fine fur inside them gives you severe itch. If I ever turn them I wear full respirator and afterwards , still wearing respirator go outside and shake down. Then remove all clothing ( inside ) and put in the washing machine. Shower and then sometimes hydrocortisone cream on hands to reduce the itch if it happens.
Ive reacted to Elm before but otherwise generally been ok . I now take precautions but would not turn with gloves on for risks already highlighted above. I have metal turned wearing gloves but my hands are remote from the work and never go near it when machine is turning.