Premier Daniel Andrews says health officials will have to monitor case numbers for longer before lifting restrictions.