Francis Fulford is the son of Lieutenant-Colonel Francis Edgar Anthony Fulford and Joan Shirley, younger daughter of Rear-Admiral C. Maurice Blackman, DSO. He attended Sunningdale School in Berkshire but failed the entrance exam for Eton, and so attended Milton Abbey School in Dorset. He did not progress to any university or higher education.