How close were you to him ?
If he was barely out of the cycle lane and you squeezed by him on his left with only a couple of inches gap, I could understand his point
(if you are turning right, arm out, drifting across to the middle of road, and a car squeezes by you on the inside, how does that feel ? Not good is it - it really pees me off !
There is the fear that if they've misjudged it they'll clip you, plus it means that you're out in the middle of the road with oncoming traffic passing to your right and traffic on your side passing you on the left : can be scary)
But if you were several feet to his left, a big enough safe gap, I don't see any problem at all.