pytest-2.8.0 leads to verify-fuel-library-python job fail

[Vasyl Saienko]

+++ basename /home/jenkins/workspace/verify-fuel-library-python_VENV
++ '[' verify-fuel-library-python_VENV = __ ']'
+++ basename /home/jenkins/workspace/verify-fuel-library-python_VENV
++ PS1='(verify-fuel-library-python_VENV)'
++ export PS1
++ alias 'pydoc=python -m pydoc'
++ '[' -n /bin/bash -o -n '' ']'
++ hash -r
+ pip install 'tox>=1.8'
Requirement already satisfied (use --upgrade to upgrade): tox>=1.8 in /home/jenkins/workspace/verify-fuel-library-python_VENV/lib/python2.6/site-packages
Cleaning up...
+ /bin/bash /home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/python_run_tests.sh
Doing a clean up.
Starting flake8 checks...
pep8 create: /home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/.tox/pep8
pep8 installdeps: hacking == 0.10.1
pep8 installed: argparse==1.3.0,flake8==2.2.4,hacking==0.10.1,mccabe==0.2.1,pbr==0.11.0,pep8==1.5.7,pyflakes==0.8.1,six==1.9.0,wheel==0.24.0
pep8 runtests: PYTHONHASHSEED='418654180'
pep8 runtests: commands[0] | flake8 ../../deployment
___________________________________ summary ____________________________________
  pep8: commands succeeded
  congratulations :)
Starting Python tests...
py26 create: /home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/.tox/py26
py26 installdeps: -r/home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/python-test-requirements.txt
py26 installed: argparse==1.3.0,Babel==2.0,cliff==1.15.0,cmd2==0.6.8,debtcollector==0.8.0,funcsigs==0.4,iso8601==0.1.10,mock==1.3.0,monotonic==0.3,msgpack-python==0.4.6,netaddr==0.7.18,netifaces==0.10.4,oslo.config==2.4.0,oslo.i18n==2.6.0,oslo.serialization==1.9.0,oslo.utils==2.5.0,pbr==1.8.0,prettytable==0.7.2,py==1.4.30,pyparsing==2.0.3,pytest==2.8.0,python-keystoneclient==1.7.1,python-neutronclient==3.0.0,pytz==2015.4,PyYAML==3.11,requests==2.7.0,simplejson==3.8.0,six==1.9.0,stevedore==1.8.0,unicodecsv==0.14.0,wheel==0.24.0,wrapt==1.10.5
py26 runtests: PYTHONHASHSEED='1551107562'
py26 runtests: commands[0] | py.test -v ../../deployment
============================= test session starts ==============================
platform linux2 -- Python 2.6.9, pytest-2.8.0, py-1.4.30, pluggy-0.3.1 -- /home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/.tox/py26/bin/python2.6
cachedir: ../../deployment/.cache
rootdir: /home/jenkins/workspace/verify-fuel-library-python/deployment, inifile:
collecting ... collected 0 items

=============================== in 0.84 seconds ===============================
ERROR: InvocationError: '/home/jenkins/workspace/verify-fuel-library-python/utils/jenkins/.tox/py26/bin/py.test -v ../../deployment'
___________________________________ summary ____________________________________
ERROR: py26: commands failed
Failed tests: Python
Build step 'Execute shell' marked build as failure
[description-setter] Description set: Failed tests: Python
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Email sending was cancelled by user script.
Finished: FAILURE

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/7.0
Review: https://review.openstack.org/225617

[Vasyl Saienko (vsaienko)]

with >pytest2.8.0 py26, py27 exit with code "5" when there is no file to check

https://paste.mirantis.net/show/1150/

[Vasyl Saienko (vsaienko)]

Not sure that Bug #1497664 is duplicate. Since as shown https://paste.mirantis.net/show/1150/ py26 returns no errors, while exit status is "5".

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/225635

[Sebastian Kalinowski (prmtl)]

Exit code 5 indicates that there were no tests collected, which in fact is a desired behavior that was introduced in py.test 2.8 (so actually it's OK that it shows a problem that even there are python files, we do not have tests for it).
It's OK for a quick fix to pin the version, but a proper way would be to handle it correctly in python_run_tests.sh and print a warining that we do not have any tests collected.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/225635
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=d4b127833e05ea27bacad90da0d0ae6c699d44b1
Submitter: Jenkins
Branch: master

commit d4b127833e05ea27bacad90da0d0ae6c699d44b1
Author: vsaienko <email address hidden>
Date: Mon Sep 21 13:34:22 2015 +0300

    exclude pytest 2.8.0

     py26 test failed with pytest 2.8.0

    Change-Id: I9788b066f25991574402d22e917caf48ba2de9e5
    Closes-Bug: #1497933

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/225617
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=3468283010742418697899ad1ca5d9d552420189
Submitter: Jenkins
Branch: stable/7.0

commit 3468283010742418697899ad1ca5d9d552420189
Author: vsaienko <email address hidden>
Date: Mon Sep 21 13:34:22 2015 +0300

    exclude pytest 2.8.0

     py26 test failed with pytest 2.8.0

    Change-Id: I9788b066f25991574402d22e917caf48ba2de9e5
    Closes-Bug: #1497933