James Ormsby, town adjutant