Im guessing your budget is about £800-1k?
I heard the Scott speedsters werent all that good, but I never seen one or rode one and cant remember the source of this "opinion". So dont go by that comment, ride one.
I'd look at Trek's in that price range, they give good bang for your buck. Or look at the Boardman range, they do a very nice aluminium framed bike for £800. The Allez is clearly a very nice bike but I personally think they look ugly, the curved top tube is grim. If you can up budget to 1k you could look at the Cannondales or the Trek 2.1, or the equivalent Specialized, giant or even a Planet X carbon bike or the Carbon version of the boardman bike I mentioned above.
If you really like the Felt, get it (If you love the look of your bike you will want to ride it more), and then change the wheels if you have issues? £200 should get you a nice set of wheels some point in the future and thats probly one of the 1st upgrades you would want to make to a bike anyway.
Ride before you buy.