John Wise, who established Gadsby's Tavern, built this attractive late-Georgian brick edifice as his residence in 1797. In the early 19C a succession of prominent Alexandrians lived in the house. In 1833 the house was purchased by John Lloyd and the house remained in the Lloyd family until 1918. In 1976 it became part of the Alexandria library.