I was generalising of course. Not all caravanners (or HGV drivers) are inconsiderate, but sadly those who behave as you do are in the minority. On the other hand there are the raving loonies who will be past no matter what. They are a much worse and more dangerous problem.
As someone once said to me, the two types of drivers I can't stand are those who sit on my tailgate to try to make me go faster and the ones who won't get out of the way when I want to get past.