Let me quote Chris Juden, Technical Officer of the CTC at you...
Naah, like you say, its only 5mm. Whilst aluminium isn't steel, the alloys they make bikes out of can nevertheless stand just as much bending into shape - so long as you don't repeat the process. How else do you suppose they make it into tubes in the first place, and do that hydroforming thing, and squirt it out of extrusion dies then bend it in circles to make rims?
The one thing aluminium really doesn't tolerate at all well is being flexed back and forth a little way, lots and lots and lots of times. Or a long way fewer times. Five mm is a little way and the number of times you'll be putting a wheel out and in again isn't lots. No worries. The frame will break before a steel one would, but not because you've eased a slightly wider wheel in there.
I'd even venture to cold set an ally frame. The tiny amount of elongation involved must be well within the material specification and it'll be a one-off process. Likewise ally gear hangers can be straightened, just the once and if not bent too much, or maybe twice if bent even less. It's a matter of degree, and cold-setting by 5mm is no big deal.
My bold of course. I've done it. 7.5mm either side of the center line is nowt. Nothing broke. Aluminium alloy is not glass.