Who cares who passes you?
Being out there getting the air is the critical point.
I’ve been cycling for 30 years now. Had to ease off a bit during cancer treatments in my 50s but I tried to keep going, just a few miles along a canal, whatever. There’s always something easy you can do. Then off the back of that illness I learned to love climbing.
I sometimes pass a few folk. I usually don’t - but I just got back off my holibobs which included several rides up/down and around Mont Ventoux. In fact getting up there to see the sunrise was my 60th birthday pressie to myself. Awesome.
Any of us who ride regularly are doing better than anyone our age who only lounges around, and there sure are plenty of them.
There are some good tips here, but the best one is: just do it.