You had to be there to understand the hissy, subversive, downright sneering nastiness of the mass ranks of mods. They were evil and lethal when they got into groups of more than 10 or so.
I'll never forget the sight of 50 or so mods mobilising on their ring-ding scooters in a lay-by off the A64 York by-pass as i rode past on my own on my motorbike. I wasn't a greasy Rocker, just a normal bloke on a motorbike, but the jeering animosity that the mods started as they jumped on their scooters to gleefully give chase was really chilling. My bike had the speed to outrun them, as even a 200cc scooter could only just get to 75 or so with the wind behind it, but had I been on a smaller, slower bike, or had I stopped at the traffic lights to get caught, I'm not sure what would have happened.
Don't talk to me about style and cool sophistication. Mods were prats.
... so to answer your suspicion, no, it wasn't as simple as that.