Container build is failing with error: /usr/share/ovn/scripts/ovndb-servers.ocf from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64

[Sandeep Yadav]

Description:

Container build in content-provider jobs are failing with error: /usr/share/ovn/scripts/ovndb-servers.ocf from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64

https://8efeb3f9a97b47933ce3-5a97607e4573b334b582a5ecc4c19d48.ssl.cf1.rackcdn.com/793384/5/check/tripleo-ci-centos-8-content-provider/e3db80b/logs/undercloud/home/zuul/workspace/logs/container-builds/650b3309-5cc4-4bc1-a7ef-bb655d06df69/base/ovn-base/ovn-controller/ovn-controller-build.log
~~~
Error: Transaction test error:
  file /usr/bin/ovn-appctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-detrace from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-ic-nbctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-ic-sbctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-nbctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-sbctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/bin/ovn-trace from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/share/ovn/scripts/ovn-ctl from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/share/ovn/scripts/ovn-lib from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64
  file /usr/share/ovn/scripts/ovndb-servers.ocf from install of ovn-2021-21.03.0-21.el8s.x86_64 conflicts with file from package ovn2.13-20.12.0-85.el8s.x86_64

level=debug msg="error building at step {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=en_US.UTF-8 container=oci] Command:run Args:[dnf -y install openvswitch-ovn-host && dnf clean all && rm -rf /var/cache/dnf] Flags:[] Attrs:map[] Message:RUN dnf -y install openvswitch-ovn-host && dnf clean all && rm -rf /var/cache/dnf Original:RUN dnf -y install openvswitch-ovn-host && dnf clean all && rm -rf /var/cache/dnf}: error while running runtime: exit status 1"
~~~

Another example:

https://639298d85b7c5445986c-4f4959c88baf61b328a5ee5316b2e07f.ssl.cf2.rackcdn.com/793815/4/check/tripleo-ci-centos-8-content-provider/439725b/logs/undercloud/home/zuul/workspace/logs/container-builds/4f3f5a9b-5427-4f64-8d6f-33842a4ef3c1/base/ovn-base/ovn-controller/ovn-controller-build.log

We have faced a similar bug in rhel in the downstream couple of days back:

https://bugzilla.redhat.com/show_bug.cgi?id=1963150

[Sandeep Yadav (sandeepyadav93)]

New ovn package is causing issue:-

In last good run:-

https://458b7eabeaed9e7bde26-c6cd00e15301f9cbec535c910ea1d6bc.ssl.cf2.rackcdn.com/793825/1/check/tripleo-ci-centos-8-content-provider/93dd51a/logs/undercloud/home/zuul/workspace/logs/container-builds/a4c0fbc1-1b0d-4a20-9141-d9291c542095/base/ovn-base/ovn-controller/ovn-controller-build.log
~~~
 ovn2.13-host x86_64 20.12.0-85.el8s centos-nfv-ovs 1.0 M
~~~

In affected job:-
https://8efeb3f9a97b47933ce3-5a97607e4573b334b582a5ecc4c19d48.ssl.cf1.rackcdn.com/793384/5/check/tripleo-ci-centos-8-content-provider/e3db80b/logs/undercloud/home/zuul/workspace/logs/container-builds/650b3309-5cc4-4bc1-a7ef-bb655d06df69/base/ovn-base/ovn-controller/ovn-controller-build.log

~~~
 ovn-2021 x86_64 21.03.0-21.el8s centos-nfv-ovs 4.6 M
 ovn-2021-host x86_64 21.03.0-21.el8s centos-nfv-ovs 1.0 M
~~~

[Sandeep Yadav (sandeepyadav93)]

Master/wallaby are affected:-

wallaby

https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bd5/793181/2/check/tripleo-ci-centos-8-content-provider/bd5185a/logs/container-builds/91898221-2d96-494d-aad8-493141d24ed4/base/ovn-base/ovn-controller/ovn-controller-build.log

[Sandeep Yadav (sandeepyadav93)]

Spoke with Yatin, He temporary untagged ovn-2021 to resolve this.

Snippet of comment from patch: https://review.rdoproject.org/r/c/rdoinfo/+/33919

~~~
Temporary untagged(cbs untag-build nfv8s-openvswitch-2-release ovn-2021-21.03.0-21.el8s) ovn-2021 as it's caused issues in upstream CI for multiple releases, https://bugs.launchpad.net/tripleo/+bug/1930327. happening as current-rdo-openvswitch is pulling ovn-2021 as it's also provides openvswitch2.13-ovn-common,
~~~

ovn-2021 package gone from repo http://mirror.centos.org/centos/8-stream/nfv/x86_64/openvswitch-2/Packages/o/ after that. Once infra mirror syncs, the issue should be resolved.

[Alfredo Moralejo (amoralej)]

Sent rdo-openvswitch patch to workaround this issue even with ovn.2021 present in the repos https://review.rdoproject.org/r/c/rdoinfo/+/33924

[Sandeep Yadav (sandeepyadav93)]

Source http://mirror.dal10.us.leaseweb.net/centos/timestamp.txt was updated at 10:44UTC

Infra mirror should sync in next 2 hours.

i have reached out to #opendev if manual mirror sync is possible to save time and resources.

[Sandeep Yadav (sandeepyadav93)]

This is resolved after ovn-2021 package removed from repo http://mirror.centos.org/centos/8-stream/nfv/x86_64/openvswitch-2/Packages/o/.

Hi Alfredo,

thanks for putting https://review.rdoproject.org/r/c/rdoinfo/+/33924.
I see this is now merged, Do we need anything here or are we good to move this bug to fix_released?

[Sandeep Yadav (sandeepyadav93)]

I just noticed Yatin has posted fixes for older releases as well:-

https://review.rdoproject.org/r/q/topic:%22fix-ovn%22+(status:open%20OR%20status:merged)

Let's wait for these patches to merge.