James Duncan, Jr., Justice of the peace