I think for cold weather its even more important than summer in getting the right gear to wear. Being frozen on the bike is never going to make it enjoyable, its all about wearing the right kit so once you've ridden a couple of miles your body temperature reaches a nice comfy level.
Personally I would recommend as a great starting point two things, a really good quality base layer and a buff. My base layer is this one -
http://www.planet-x-bikes.co.uk/i/q...eck_long_sleeve_base_layer___one_size___white. Really top notch quality, keeps body heat in, keeps the sweat and rain away from your skin. 1st step to feeling toasty.
A buff (if you didn't already know) is a magic piece of cloth which does umpteen things, can wear it round your neck, as a full face balaclava, a bandana, over just your chin and ears....you can wear it all year round too as it keeps sweat away from you in summer, and keeps your head warm during winter. Step 2 to feeling toasty.
Beyond that its the usual assortment of long sleeves and legs, right gloves (full fingered when its HOW COLD?!?) and if its slightly damp some sealskinz socks always help. In fact thermal cycling socks are pretty much the 3rd step to feeling toasty.
Keep your feet and head warm, get a good quality base layer for your chest, some gloves for the fingers, and it really shouldn't matter what the weather throws at you. Once you have ridden a couple of miles, you may even feel like shedding some kit!
Don't give up, you will be missing out on some sunny winter rides.