After failing to sell any of his paintings at a funfair, an artist begins to tell his granddaughter about the origins of his paintings. We are then transported on board a British convict ship headed for New South Wales where we meet six convicts; Toby Nelson (a young boy), Polly Nelson (Toby's older sister), "Dipper" Davey (an old pick-pocket), Big George (a Blacksmith), Jack Doolan (a highwayman), and "Silly Billy" (a village idiot). The five men are selected to do hard labor for the military - under the supervision of Sergeant "Bully" Langden and Corporal "Weasel" Wesley - while Polly (secretly in love with Big George) is sent to work as a servant girl at the governor's home. Toby in the meantime saves a baby koala after Bully and Weasel kill it's mother while hunting, and keeps it as a pet, naming it Yo-Yo.