This for me is one of the downsides about cycling and that is the physique.
I am a very similar build to wiggo arms and legs wise i.e. candle sticks with hairs on.
Where I do differ is my trunk, but I really do not want to look like wiggins or contador physique wise, If I could climb like Contador and look like rambo or Jean Claude Van dam I would be happy but I doubt neither will happen........
Welcome to the world of the pro. You can't carry excess bodyweight, any climbing is simply a form of weightlifting, and the less you weigh the better. Hence thin is good. Early season it's quite usual to do long rides and eat very little, all in the cause of better power weight ratio. The trick is keeping the engine (heart/lungs) at full power whilst reducing the weight. It's not unusual to be as low as 3% body fat. I never got that low, which is why I didn't go up climbs very well.
If you look ill, then you are probably close to your best. If you want a lovely "girls love it" body, try another sport that's not so demanding of your time and physique, or just ride for fun (or be a pure trackie!).
One thing will always be the same, regular riding keeps you fit and healthy, and it carries into later life.