Norfolk’s top council job has been filled on an interim basis following the departure of the previous chief executive.