A member of the fourth generation of a Pennsylvania Quaker family who had emigrated from England, Mifflin was born at Philadelphia in 1744, the son of a rich merchant and local politician. He studied at a Quaker school and then at the College of Philadelphia (later part of the University of Pennsylvania), from which he won a diploma at the age of 16 and whose interests he advanced for the rest of his life.