Walli Sahab was born in Pune, Bihar in old British India in 1908 as Walli Mohammad Khan. Later, his family moved to Panipat, Punjab and then lived in Lahore,Punjab.He started writing poetry when he was quite young. He first started working for Gramophone Company Of India in the early 1930s.