Alfred Hill spent most of his early life in New Zealand. As a child he learned cornet and violin. With his brother John, he traveled to Leipzig in Germany, where both brothers studied at the Royal Conservatorium of Music between 1887 and 1891.