Pryme Group boss to exit firm