Interesting one. Why this came to mind is I was reading on Timberbits site and David said he left his overnight and he uses CA and I couldn't understand why??
Now I know that I am not alone in leaving them for a short time.
I would be like some of you in doing it immediately but after drilling on the lathe I then put my sanding disc on and I usually do this while the CA is going off!!!