When you say "YOU don't need padded shorts".....you mean in your case.I can quite happily go out for a long ride (50+ miles) in jeans on a saddle with minimal padding, you don't need the padded shorts or saddle, it's just a case of what you get used to. I find that if I ride a lot in "regular" clothing then when I come to do a much longer ride and wear the expected attire then I can go pretty much all day with no discomfort.
Even as a kid, in assembly, I couldn't sit on the wooden floor.....my bum/sit bones just won't allow it.
Personally I NEED padded shorts or I am in agony.