Blimey, that's not a bad time for that route! It makes sense for you, wanting to end up back in Littleborough.
I do the top section the other way round (anticlockwise), dropping down to the former Blue B-A-ll pub and then either emerging back at the farm and descending through Cragg Vale, or taking the more direct route to Mytholmroyd down Scout Road. The latter route is currently closed to traffic, but you can manhandle your bike round/over the concrete blocks blocking the way. It's a bit sketchy on that descent now - without motor vehicles using it, it has become covered by wet, rotting leaves.