Its a tricky call, eh, cos like it or not women are physiologically different. Indeed, men are physiologically different to each other, hence I guess the weight bandings. Hell, everyone is different to everyone else full stop, so why not just bin the gender and weight thing entirely?
It's your call of course, but as it stands at the moment i can see your confusion over where to put yourself, and its wrong that any user should be in that position - there should simply be an option for an individual to switch the choices off.