Let me suggest that it's not only cultural: it's also mechanical. Donald Norman talks about "affordances" in design - features or properties of an artefact that encourage it to be used in some ways and discourage other ways. For example, if you are installing a door, you put a flat plate on it if you want it to be pushed open and a handle if you want it to be pulled open
In a car, you have very poor vision of what's going on around you: the bodyworks gets in the way, and your seat and belt discourage you from looking around the bodywork. You have very poor manoeuvrability at low speeds: imagine how well pavements would (not) work if pedestrians could not step to one side and had to "engage reverse gear" before moving backwards. You don't even have particularly good speed control at those low speeds: in order not to stall the engine you must modulate speed by carefully partially disengaging the drive system from the wheels. And to cap it all, the first gear in many cars produces a god-awful unpleasant whine when driven at more than about 5mph, sending a very clear "get up to speed and get me into second" message. In short, the car is not designed to make it convenient or attractive to use at human (0-10mph) speeds and anyone attempting to do so is thereby placed under psychological stress which tends to make them angry or irritable. It is a source of puzzlement to me that more of them don't succumb to "road rage" in these conditions.