Yes that’s correct, but if you keep everything else constant, changing the stem length will have an effect, however most people realise it, and whether consciously or sub consciously, adjust their position ( which is the key ) to account for it / mitigate it.
It’s an aero bike, they tend to be twitchy ( relative to a more conventional road bike, of similar size and general geometry) by design / because of the relative slight geometry differences, and tube shape and construction.
As I said, geometry differences will make more of a difference in handling than 1-2cm of stem length. My bike with the 80mm stem was the most stable handling bike I had. Most smaller framed and WSD bikes come with shorter stems because they are generally for physically smaller people. It can't affect the handling too much because there aren't hordes of females and generally short people complaining the handling of their bikes is too twitchy. I know several female and short riders (I fall into both categories), none of us have issues with our bikes with stems in the 80-100mm range.