Henry Wharton, 1664-1695