Hathaway, Caleb, Quaker