A huge amount of it is mental and it's either faith in your ability and kit, or lack of understanding about how close the edge is. When I used to race Motocross, you'd notice that even some of the good guys were sketchy on hills (for low values of good guys, I never did very well) and being able to let the bike go and speed the downhills was a specific skill that got you quicker lap times.
On my Chatham commute, right at the beginning I did a major road down the North Downs heading home and would always see how fast I could go, specifically coming off the hill my 'challenge' was how fast could I take the long sweeping cambered downhill left hander (it just seemed like the best marker, plus diving in to the bend sped you up that little bit more.) I believe I managed 45mph and was looking to go faster. But that was fine for me. I trusted the bike and the tyres to be better than me. They always are.
I've mentioned up thread, you can read the corners and it's easier to do hills you know. Modern technology is a wonderful thing, your bike is almost definitely more capable than you are. Don't do anything to upset it, keep it in good condition and enjoy the free speed. Remember, what goes down, must go up.