Rename duplicate migrations and skip them if table/columns are already present

Closes #26868

See merge request !8644