Seeing as you only lock up after hitting potholes, it may be that there is not enough brake return spring force to keep the cable outer ferrules in position during bumps. Your return springs are either weak, not dialed in correctly or cable routing/friction has offset the action of the return springs. Also, your cables may be insufficiently supported - on hitting a bump, the mass of the cable may cause it to flop about and pull the ferrules out of their stops, so when you next apply the brake, the lever will not move very far because the ferrule is teetering on the edge of the cable stop, effectively pulling the brake on. After a few minutes riding, you may have enough vibration to bump the cable ferrule back into the correct position fully inside the stop, so the problem appears to go away.