I only have the keys in the pannier when I'm cycling - so it's happening then. Yep, will definitely think about getting an ipod strap or something instead, or I guess if I had them in a pocket that would be better. Hopefully won't happen again.
Time for scooby doo to investigate.
Exorcise the bike