There's a couple things that could be going wrong here, but start with cleaning the brakes. Take them off to do this including releasing the cable. Yours looks a bit manky which won't be helping matters. The cable and pivots need to be clean to do their jobs properly.
When you've done that, watch
this video from about 2 mins in, paying attention to the 3 little holes.
Also check the plastic housing which covers the coiled part of the spring. If that's bent out of shape its usually bollixed and worth just buying new brakes. I've a suspicion that's the issue because the centering screw on the right arm appears to unscrewed quite a bit whereas the left arms screw is about halfway screwed in.