i think that you are putting too much finish on. I know that everybody has their own method for finishing, and I am far from experienced, but I put a drop or two of oil on a piece of toilet roll, and then about the same in CA. repeat for as many coats as you choose. Even if you choose to use something other than CA, my point is that there is not enough oil/finish on to drip.
Oak is a difficult one, at least the species that we see in the UK are, in that it needs something to fill the grain with to get a smooth finish- how you choose to grain fill is up to you, but it will need something. that is why polish was trapped in yours. I have some oak pens to do- people have suggested using a thin CA glue and wet sanding with it.