download_mirror.sh: Permission denied: '/var/lib/rpm/.dbenv.lock

[Scott Little]

Brief Description
-----------------
Parallel package downloads under download_mirror.sh sometimes fail
when one thread can't obtain a lock.

Severity
--------
Minor

Steps to Reproduce
------------------
1) setup a new workspace, or delete several packages previously downloaded under stx-tools/centos-mirror-tools/output/
2) download_mirror.sh

Expected Behavior
------------------
All packages download successfully

Actual Behavior
----------------
occasionally one or more packages fail to download due to contention over /var/lib/rpm/.dbenv.lock

Reproducibility
---------------
Intermittent
< 5%

System Configuration
--------------------
N/A

Branch/Pull Time/Commit
-----------------------
2021-10-21

Last Pass
---------
2021-10-21

Timestamp/Logs
--------------
b1: ovl: Error while doing RPMdb copy-up:
b1: [Errno 13] Permission denied: '/var/lib/rpm/.dbenv.lock'
b1: CENGN_StarlingX-C7.6.1810-sclo-sclo: Check uncompressed DB failed
b1: Warning: elfutils-devel-static-0.176-2.el7.x86_64.rpm not found
b1: Error: elfutils-devel-static-0.176-2.el7.x86_64.rpm not found

Test Activity
-------------
Build

Workaround
----------
Re-run download_mirror.sh

[YU CHENGDE (chant)]

I have the issue too

Timestamp/Logs
--------------
b7: Looking for libXau-1.0.8-2.1.el7.x86_64.rpm
b7: --> run: yumdownloader -q -C -c /localdisk/loadbuild/stx/distro/tmp/yum/yum.conf --releasever=7 --exclude='*.i686' --archlist=noarch,x86_64 libXau-1.0.8-2.1.el7
b7: ovl: Error while doing RPMdb copy-up:
b7: [Errno 13] Permission denied: '/var/lib/rpm/Basenames'
b7: ovl: Error while doing RPMdb copy-up:
b7: [Errno 13] Permission denied: '/var/lib/rpm/Basenames'
b7: url_srpm:http://mirror.starlingx.cengn.ca:80/mirror/centos/centos/mirror.centos.org/centos/7.9.2009/os/x86_64/Packages/libXau-1.0.8-2.1.el7.x86_64.rpm
b7: found_srpm:libXau-1.0.8-2.1.el7.x86_64.rpm
b0: Looking for libXau-devel-1.0.8-2.1.el7.x86_64.rpm
b0: --> run: yumdownloader -q -C -c /localdisk/loadbuild/stx/distro/tmp/yum/yum.conf --releasever=7 --exclude='*.i686' --archlist=noarch,x86_64 libXau-devel-1.0.8-2.1.el7
b0: ovl: Error while doing RPMdb copy-up:
b0: [Errno 13] Permission denied: '/var/lib/rpm/Basenames'
b0: ovl: Error while doing RPMdb copy-up:
b0: [Errno 13] Permission denied: '/var/lib/rpm/Basenames'

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/tools/+/846846

[OpenStack Infra (hudson-openstack)]

Change abandoned by "YU CHENGDE <email address hidden>" on branch: master
Review: https://review.opendev.org/c/starlingx/tools/+/846846
Reason: Abandon the patch because the problem can not reproduce.