The federal-style home on Market Street was built in 1816 by an English stonecutter, Peter Paul II.