Fix a number of race conditions that can occur during namespace deletion

See merge request !9294