If that's your experience, cool, we'll just disagree.
I love my Wilier Zero6 rim-brake bike. I've literally, only yesterday, taken delivery of a brand new set of light carbon hoops for it so that I can run tubeless. I've ordered Extralite chainrings for it. I have a new cassette, new chain and new batteries for the electronic shifting - so I'm still investing in my rim-brake bike. It's a 6kg marvel, very responsive, fast accelerating, comfortable for 200km+ rides and is a joy to climb with. I have also won races on it and half my KOM's were taken training on it.
However...
I don't know a single athlete I race against who finds rim brakes to match disc for stopping power. GCN and other's have done their own testing (you can find the vids) and draw the same conclusion.
We benefitted from disc far sooner in MTB racing since they are proven more effective for sharp descents and corners. The disc brakes modulate better. The same has been proven for road racing too.
No one is suggesting rim brakes do not stop us - modulated correctly with good pads, they work well and I started racing in the 1980's and did so at National Elite level. I've descended climbs in mountains at 100km/h on rim brakes. Discs are just better. On rim I am braking a lot sooner - and therefore scrubbing speed - than I would need to on disc. That's the point.
But...if you ride slowly, then sure, you'll not notice the difference as much - and I like to ride slowly too, taking in the scenery.