James,
if you read the guidance notes regarding the referees, you will find out that both the referees should have known you for at least three years. That does not mean they should be in constant touch with you for three years. I am sure your GP is still a suitable referee in this case but only if you have known him for three years. If you have been relocating within the UK during the past few years, that shouldn't be a problem. As long as your GP is willing to act as your referee, you should be fine. The essential criteria for a suitable referee is the duration for which you have known him and not about the frequency of your contact with him. Hope that answers your question.
Amir