Henry S. Brown was born in Clarendon, Vermont on December 26, 1809, the son of William and Thankful (Smith) Brown. He graduated from Colby College in 1832, and from the Vermont Academy of Medicine in 1834. He married Miriam Holton of Westminster, Vermont on March 10, 1855 in Sumpterville, S.C. In the 1850s, Dr. Brown was active in Georgia and was driven from the state by a vigilance committee and in his own words, "without any evidence that I violated any law...or interfered with their peculiar institution."
From the description of Letter, 1861 January 11 : Milwaukee, Wisconsin, to Hon. Mr. Mason W. Tappan. (Vermont Historical Society). WorldCat record id: 762189023