I can understand why a person wouldn't want to put a gel wrapper back in their pocket. It will almost certainly leak some residue and be quite yucky.
My jersey goes in the wash anyway, so gel wrappers would go in the pocket, I normally roll as I suck, so very little if any mess. However, yesterday no gels for me, I lived on Jelly beans, rice cakes and hydration tablets.