Rails prefers require_dependency so that it won't require twice:

## What does this MR do?

Fix warnings for loading constants twice

## Are there points in the code the reviewer needs to double check?

Now it's depending on `require_dependency`.

## Why was this MR needed?

Fixes #20724

Backtrace before this patch: $23876

See merge request !5727