Check the drop.
Chances are, if your forks are suitable for mudguards, the drop on 105 brakes may not be long enough.
I just changed to a 105 groupset, but because of the mudguard, the drop is too long for the 105 front caliper, so I am using a Tektro front till I find a suitable replacement.