Generally I find that cyclists accelerate away from lights faster than cars, i.e. they wouldn't have to wait for you. Looking at the bigger picture, you may actually be causing more inconvenience to those cars behind by sitting in the traffic you than you would going to the front. If you go to the front, for example, you plus 4 cars might make it through due to your nifty acceration, if sit in the queue, you plus 3 cars might make it through as you can then only accelerate as fast the car in front of you, you are also subject to a delay from the car in front of you in order to leave braking room!
If you are referring to them overtaking you again, well that is a non issue provided you don't just sit in primary beyond the junction.
I am NOT saying people should filter universally, or otherwise, just making an observation, by filtering or not filtering, you are affecting yourself (safety wise) much more than you are affecting drivers.
