InterpreterNotFound: python2.6

[Joe Gordon]

http://logs.openstack.org/11/68411/9/gate/gate-heat-python26/3e62244/console.html#_2014-02-18_22_52_46_241

2014-02-18 22:52:46.241 | py26 create: /home/jenkins/workspace/gate-heat-python26/.tox/py26
2014-02-18 22:52:46.241 | ERROR: InterpreterNotFound: python2.6

logstash query: message:"ERROR: InterpreterNotFound: python2.6" AND filename:"console.html" AND build_name:*python26

This hasn't happened for over 24 hours.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/75220

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/75220
Committed: https://git.openstack.org/cgit/openstack-infra/elastic-recheck/commit/?id=b3cf2dac16ca9e022f35a69648d4a3261a898d79
Submitter: Jenkins
Branch: master

commit b3cf2dac16ca9e022f35a69648d4a3261a898d79
Author: Joe Gordon <email address hidden>
Date: Thu Feb 20 14:52:18 2014 -0800

    Add fingerprint for bug 1282795

    Bug 1282795 is an infra bug that hasn't happened in 24 hours, this is
    mainly for tracking purposes.

    Change-Id: Ibbb6e6d746b4459480e681a6e1d3f0ef079bdb15
    Related-Bug: #1282795

[Jeremy Stanley (fungi)]

This is a strange one since tox is a Python program and it's complaining that it can't find the python interpreter well into its execution. This could imply that it's failing to find the interpreter it thinks it should have linked into the virtualenv, so maybe it was a failure to create the symlink? Anyway, one hit in the last 14 days so this is still happening but not often enough to be able to easily track down a cause.

[Launchpad Janitor (janitor)]

[Expired for OpenStack Core Infrastructure because there has been no activity for 60 days.]

[wingwj (wingwj)]

Why close the bug? I met it again on 2014/06/16, it's still existed..
Please look at PS5 of https://review.openstack.org/#/c/67613/, the link of log is http://logs.openstack.org/13/67613/5/check/gate-nova-python26/85a3974/console.html

[Jeremy Stanley (fungi)]

Switched from expired back to incomplete since it still seems to happen occasionally but I have no bright ideas for how to diagnose it further. (Nobody "closed" the bug, Launchpad just automatically expires bugs with no activity after 60 days.)

[Clint Byrum (clint-fewbar)]

Seeing as this has an elastic-recheck query and it happens (albeit, infrequently) I think this is Confirmed at the least.. if not Triaged. Just because we dont' know how to fix it doesn't mean it is an incomplete report that needs more info.

[Jeremy Stanley (fungi)]

I can get behind confirmed status for this (as in we confirm that there is some sort of bug somewhere resulting in this behavior), but it's still incomplete in the sense that we don't have enough information to know what's causing it.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/106435

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/106435
Committed: https://git.openstack.org/cgit/openstack-infra/config/commit/?id=f990f0684dc7ca57a463f2d5a18a74e5b9b6bd68
Submitter: Jenkins
Branch: master

commit f990f0684dc7ca57a463f2d5a18a74e5b9b6bd68
Author: Jeremy Stanley <email address hidden>
Date: Fri Jul 11 16:54:19 2014 +0000

    Collect tox logs from job runs

    Copy any files from .tox/*/logs into a tox subdirectory of the job
    log artifact URL. This should enable deeper debugging of the
    occasional failures we see which appear to be defects in tox or
    within the system impacting its ability to start the test runner.

    Change-Id: Id8d5d74d140436f4b05740cbd98249aef7ae51d4
    Related-Bug: #1282795

[Jeremy Stanley (fungi)]

A search on logstash.openstack.org for message:"InterpreterNotFound:" AND tags:console over the past 7 days yields "No events matched" so not much to go on.

[Dolph Mathews (dolph)]

Two instances of bug 1331938 (one of the dupes of this bug) on stable/icehouse in the past 24 hours on openstack/requirements jobs:

  http://logs.openstack.org/49/128849/1/check/gate-requirements-pypy/f5fdbae/console.html
  http://logs.openstack.org/11/122711/1/check/gate-requirements-pypy/32ed8ad/console.html

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/128984

[Jeremy Stanley (fungi)]

Awesome--according to the console logs, the nodes these ran on were bare-precise rather than py3k-precise, so I think we've introduced a node selection error in our zuul configuration. Looking into it now.

[Jeremy Stanley (fungi)]

Oh, right... we're running jobs for all stable/icehouse changes on Ubuntu Precise but going forward we're only supporting PyPy on Ubuntu Trusty. This means we should not run gate-{name}-pypy jobs on stable/icehouse changes.

[Jeremy Stanley (fungi)]

That misconfiguration is fixed by https://review.openstack.org/129014 but I'm leaving this bug open since we've been seeing this symptom for other unexplained reasons long before the change which would have introduced the cause of these particular hits.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/128984
Committed: https://git.openstack.org/cgit/openstack-infra/elastic-recheck/commit/?id=3bd0c3d24f12d3b046867db0eb5bc9944b9a3b21
Submitter: Jenkins
Branch: master

commit 3bd0c3d24f12d3b046867db0eb5bc9944b9a3b21
Author: Dolph Mathews <email address hidden>
Date: Thu Oct 16 16:07:55 2014 +0000

    restore query for InterpreterNotFound

    for some reason this query was deleted, even though the referenced bug
    is still open. restoring it and expanding scope to match the pypy
    failures on stable/icehouse, which are marked as a dupe in LP (see the
    two bugs below).

    Change-Id: I759148eb2805ad54efedf8b35fcb994012aa9037
    Related-Bug: 1282795
    Related-Bug: 1331938

[Matt Riedemann (mriedem)]

We don't have py26 jobs anymore so invalidating this bug now.