We have the option of a GSHP at the next house since it has an oldish oil boiler and 3 acres of largely unused, clear, flat grass. However, a trenched GSHP (the cheapest option if you have space) would be about £17,500 after grant and the annual saving is very small, certainly not recoverable over even a 20 year system life. The house is hard to insulate, with parts dating to the 1700s, and with room-in-roof layout upstairs. There is 200mm of fibreglass in the small lofts, but not necessarily in the large inaccessible bits where the ceilings slope.
If oil prices were a lot higher then it might be worth it, but not at the moment. I like the idea of GSHPs (I don't like ASHPs due to the cold weather performance) but right now we'd pay much more and get less flexibility in return. The other worry with heat pumps is poor installation by cowboys chasing the grants, reliability and parts availability. There are lots of horror stories.