CI job "gate-manila-tempest-dsvm-neutron-no-share-servers" fails very often

[Valeriy Ponomaryov]

We have several CI tempest jobs with different Manila configurations.

And one of them where share servers are not used - "gate-manila-tempest-dsvm-neutron-no-share-servers" fails too often.

Example:

http://logs.openstack.org/92/173692/20/check/gate-manila-tempest-dsvm-neutron-no-share-servers/6709fd9/console.html

Observations:

- job fails on timeout of 65 minutes
- job results do not save logs if timeout was reached, so we do not have logs for services
- from available console log we see that all test suites that do create shares failed

Assumption:
- Nova VM fails to be created by devstack and then none of shares can be created because of it.

[Valeriy Ponomaryov (vponomaryov)]

From logs [1]:

...

Server fd1a:d1ec:71d2:0:f816:3eff:feb1:4670 is not available via SSH. Waiting...

...

[1]: http://logs.openstack.org/63/182263/3/check/gate-manila-tempest-dsvm-neutron-no-share-servers/aae32a9/logs/screen-m-shr.txt.gz#_2015-05-12_17_24_59_245

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/183158

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/183158
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=d9ffd53a0e80790a65854d7def9e72d03fe72fc9
Submitter: Jenkins
Branch: master

commit d9ffd53a0e80790a65854d7def9e72d03fe72fc9
Author: Valeriy Ponomaryov <email address hidden>
Date: Thu May 14 21:22:39 2015 +0300

    Make generic driver use only ipv4 addresses from service instances

    If Nova VM has two types of addresses for same network then in case
    of generic driver mode without handling of share servers could be taken ipv6
    address, but Manila won't be able to connect using it. So, make generic
    driver smarter to get only ipv4 addresses from service instance.

    Change-Id: Ia16b47d83fdd91edb5d77ead460c3c3381b4b232
    Closes-Bug: #1452653

[John Griffith (john-griffith)]

Still seeing this, might be a new issue, but based on ERQ the setup failure and resultant inability to schedule c-vols seems to be consistent.

message:"Insufficient free space for volume creation on host" AND tags:"screen-c-sch.txt" AND NOT build_name:"gate-rally-dsvm-cinder" AND build_name:"gate-manila-tempest-dsvm-neutron-no-share-servers"

[John Griffith (john-griffith)]

By the way, here's a recent example: http://logs.openstack.org/50/187550/4/check/gate-manila-tempest-dsvm-neutron-no-share-servers/6b2eca0/logs/screen-m-shr.txt.gz

[Valeriy Ponomaryov (vponomaryov)]

It is pretty stable for a month. Closing.