Prevent default click since we change the url manually

Closes #34810

See merge request !12721