I love riding fixed.
At first I found descending a little awkward, there are a lot of very steep hills here and after experimenting with gearing and just getting on with it I soon got used to it. While I appreciate you might not be willing to 'persevere' after all, its supposed to be fun and if you feel uncomfortable, you feel uncomfortable, but in my opinion it's worth the effort.
Having got used to it, I enjoy riding fixed more than any of my 'normal' bikes. It's made me a stronger rider, it's made me more aware of road, eg rolling up to junctions and judging the traffic (sparse around here) so I don't have to stop, it's quieter, less wear on parts. I've had a few 'moments' meeting vehicles on lanes and you soon get used to keeping pedalling while braking. These days I find riding a geared bike weird and I forget to freewheel most of the time!
Did I mention, I love riding fixed.