Henry S. Potter, 1851-1918