I agree with you, faster cadence = better riding but I think we do it for a variety of reasons. It's better for your knees for one! grinding( turning the crank slowly) is not unaptly named, as it's what your doing to your joints , which can cause health problems in years to come; and it's also grinding your gears away! High Cadence (spinning the crank quickly) makes it easier to make a smooth circle, keeping your power more even and the demands on your body and bike more evenly spread. With a higher rpm your better prepared for changes in terrian, being able to slow your cadence or smoothly shift up a gear.
Aerobic fitness as I understand, is your effort levels where your lungs are able to keep up the supply of oxygen to the blood and this fuels your muscles. If you go beyond this capacity, your body starts burning reserves to make up the shortfall.