Mary Halsey came from a prominent Milwaukee family. Her father was Jay S. Halsey, Western representative of the Ply metal company and her mother Zoe Halsey (1888-1965) was working as a interior decorator. The Hasey family went to California in the early twenties. Her parents divorced in 1924.