A bit late with my reply but no i wasn't. I kind of banned myself from using headphones about ten years ago, when i was advised not to use them, as they were affecting my hearing.
Common sense should tell you where to stop with the volume control. I love headphones & have several pairs as well as a dedicated listening rig. They can sound incredible.