Fixed issue boards sidebar close button with new navigation

Closes #35296

See merge request !12991