William Martin Conway, Lord Conway of Allington, and family