Philip Yorke, Earl of Hardwicke, 1720-1790