Wigram, Clive, Sir, 1st Baron Wigram of Clewer, Colonel Keeper of the Privy Purse