See https://gitlab.com/gitlab-org/gitlab-ce/issues/34407

 - Revert https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/12399
 - Update https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/12299
   throttle/debounce to happen immediately and cleanup