Patrick J. Andersen was born and grew up in Baltimore, Maryland. His parents were John Murray Wieman, a sportswriter for the Baltimore Sun and scout for the Detroit Tigers Baseball Team, and Gladys Carlon, daughter of Loyal Carlon, conductor and violin teacher for the Peabody Institute in Baltimore.