Does it have a locking lever ? - Are you fully unscrewing the presta valve ?
My Silca pump doesn't - its a push on type, but you may need to ensure that the rubber seal in the nozzel is squeezed enough so it has a tight hold.
My Silca one is over 20 years old, and I've just had to fit a washer under the rubber seal to squeeze it tight again.