Not so much swimming as just going through the motions.I am pretty sure the sea is almost always OK. While there might be few beaches which have signs banning swimming I've never seen one.
I personally wouldn't advise swimming in the Thames downstream of Richmond