Show why a notification email was sent

Closes #41532 and #1366

See merge request gitlab-org/gitlab-ce!16160