Resolve "Email notifications not sent as expected"

Closes #38862

See merge request gitlab-org/gitlab-ce!15686