Joseph Habersham's father was an acting Governor of the colony. Joseph did not share his father's political views and became caught up in the revoluationary movement. He was a leader in a raid on an ammunition magazine in Savannah, and was important in the Provincial Congress there in 1775. He participated in raids on English vessels for badly needed ammunition. He became a Major in Georgia's Council of Safety and personally arrested Governor Wright - who later escaped. He continued actively in the Revolution in the Savannah area and promoted to Colonel.

He married Isabella Rae and they had 10 children.

After the Revolution, he served two terms as Speaker of the House in the Georgia Assembly. He signed the charter for the University of Georgia - the first charter granted to a university in America. he was a member of the Continental Congress which ratified the United States Constitution in 1788. He served as mayor of Savannah and was appointed by President Washington to be the first Postmaster General of the United States.

It is believed that he had his summer home near Clarkesville built between 1802 and 1815. There is a marker stating this at the residence of Henry and Joy Lovell, 1475 Hollywood Highway, Clarkesville, Georgia.