James Ramsey Ullman was born in New York City, the son of Alexander F. Ullman. As a boy, he attended Phillips Academy in Andover, Massachusetts. In 1929 he graduated from Princeton University and moved to Brooklyn to begin work in journalism as a newspaper reporter and feature writer. Ullman decided to try his hand at producing theater.