quickstart venv: IOError: [Errno 26] Text file busy

[Rafael Folco]

https://logs.rdoproject.org/58/609858/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/22b7d84/job-output.txt.gz#_2018-10-22_13_54_47_902981
2018-10-22 13:54:47.902981 | primary | +(./toci_quickstart.sh:98): ./quickstart.sh --bootstrap --no-clone --working-dir /home/zuul/workspace/.quickstart --playbook noop.yml --retain-inventory undercloud
2018-10-22 13:54:48.111007 | primary | New python executable in /home/zuul/workspace/.quickstart/bin/python2
2018-10-22 13:54:48.111752 | primary | Traceback (most recent call last):
2018-10-22 13:54:48.111894 | primary | File "/usr/lib64/python2.7/runpy.py", line 162, in _run_module_as_main
2018-10-22 13:54:48.112296 | primary | "__main__", fname, loader, pkg_name)
2018-10-22 13:54:48.112437 | primary | File "/usr/lib64/python2.7/runpy.py", line 72, in _run_code
2018-10-22 13:54:48.112559 | primary | exec code in run_globals
2018-10-22 13:54:48.112709 | primary | File "/usr/lib/python2.7/site-packages/virtualenv.py", line 2343, in <module>
2018-10-22 13:54:48.113118 | primary | main()
2018-10-22 13:54:48.113272 | primary | File "/usr/lib/python2.7/site-packages/virtualenv.py", line 712, in main
2018-10-22 13:54:48.113468 | primary | symlink=options.symlink)
2018-10-22 13:54:48.113629 | primary | File "/usr/lib/python2.7/site-packages/virtualenv.py", line 927, in create_environment
2018-10-22 13:54:48.113876 | primary | site_packages=site_packages, clear=clear, symlink=symlink))
2018-10-22 13:54:48.114042 | primary | File "/usr/lib/python2.7/site-packages/virtualenv.py", line 1233, in install_python
2018-10-22 13:54:48.114484 | primary | shutil.copyfile(executable, py_executable)
2018-10-22 13:54:48.114623 | primary | File "/usr/lib64/python2.7/shutil.py", line 83, in copyfile
2018-10-22 13:54:48.115057 | primary | with open(dst, 'wb') as fdst:
2018-10-22 13:54:48.115314 | primary | IOError: [Errno 26] Text file busy: '/home/zuul/workspace/.quickstart/bin/python2'
2018-10-22 13:57:16.877748 | primary | ERROR
2018-10-22 13:57:16.878474 | primary | {
2018-10-22 13:57:16.878567 | primary | "delta": "0:12:27.017682",
2018-10-22 13:57:16.878630 | primary | "end": "2018-10-22 13:57:16.579944",
2018-10-22 13:57:16.878689 | primary | "msg": "non-zero return code",
2018-10-22 13:57:16.878747 | primary | "rc": 1,
2018-10-22 13:57:16.878800 | primary | "start": "2018-10-22 13:44:49.562262"
2018-10-22 13:57:16.878856 | primary | }

https://github.com/openstack/tripleo-quickstart/blame/master/quickstart.sh
https://github.com/openstack/tripleo-quickstart/blob/master/quickstart.sh#L122

https://github.com/openstack-infra/tripleo-ci/blob/master/toci_quickstart.sh#L25-L40
https://github.com/openstack/tripleo-quickstart/commit/f2f6dcb209df33d063382f89a4a5c7620a3c91ac#diff-8846dd18c9ee9c09dadeee541156c2b8L116

virtualenv -p:
  -p PYTHON_EXE, --python=PYTHON_EXE
                        The Python interpreter to use, e.g.,
                        --python=python3.5 will use the python3.5 interpreter
                        to create the new environment. The default is the
                        interpreter that virtualenv was installed with
                        (/usr/bin/python2)

[Sorin Sbarnea (ssbarnea)]

This is really weird and looks like this https://stackoverflow.com/questions/40403502/oerror-errno-26-text-file-busy-myvirtualenv-bin-python

Shortly this could have being caused by another python process using the same virtuanenv.

Do we run more than one job on the same slave? Are we sure we don't have leftovers from previous executions?