Tim I have not changed my drilling speed for pens ever its how you hold your tongue and join the club mate. Some timbers are mongrel by nature then comes the realisation that innumerable causes have effects, now to isolate them. speed does not become the overriding factor IMHO I drill fast all the time using a variety of drills, for Slimlines Streamlines I useDeWalt Extreme 2 drills getting extraordiary numbers of drillings for each drill. How you arrive at the cause of swelling distortion all the processes have to be examined closely.
There has been a recent question re 6.9 mm drills or 7 mm drills it would appear in your case 6.9 would be horrible. Consistency will rule out variables. Mike your drills. Check your tubes.
Peter.