scenario test_load_balancer_basic fails

[Oleg Bondarev]

http://logs.openstack.org/98/81098/2/check/check-tempest-dsvm-neutron-pg/df24b97/console.html

2014-03-19 09:58:15.379 | Traceback (most recent call last):
2014-03-19 09:58:15.379 | File "tempest/test.py", line 121, in wrapper
2014-03-19 09:58:15.379 | return f(self, *func_args, **func_kwargs)
2014-03-19 09:58:15.379 | File "tempest/scenario/test_load_balancer_basic.py", line 225, in test_load_balancer_basic
2014-03-19 09:58:15.379 | self._check_load_balancing()
2014-03-19 09:58:15.379 | File "tempest/scenario/test_load_balancer_basic.py", line 213, in _check_load_balancing
2014-03-19 09:58:15.379 | "http://{0}/".format(self.vip_ip)).read())
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/urllib.py", line 86, in urlopen
2014-03-19 09:58:15.380 | return opener.open(url)
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/urllib.py", line 207, in open
2014-03-19 09:58:15.380 | return getattr(self, name)(url)
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/urllib.py", line 345, in open_http
2014-03-19 09:58:15.380 | errcode, errmsg, headers = h.getreply()
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/httplib.py", line 1102, in getreply
2014-03-19 09:58:15.380 | response = self._conn.getresponse()
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/httplib.py", line 1030, in getresponse
2014-03-19 09:58:15.380 | response.begin()
2014-03-19 09:58:15.380 | File "/usr/lib/python2.7/httplib.py", line 407, in begin
2014-03-19 09:58:15.381 | version, status, reason = self._read_status()
2014-03-19 09:58:15.381 | File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
2014-03-19 09:58:15.381 | line = self.fp.readline()
2014-03-19 09:58:15.381 | File "/usr/lib/python2.7/socket.py", line 430, in readline
2014-03-19 09:58:15.381 | data = recv(1)
2014-03-19 09:58:15.381 | IOError: [Errno socket error] [Errno 104] Connection reset by peer

[Mauro S M Rodrigues (maurorodrigues)]

I can't point out what is causing this, anyway, there are several tracebacks available in
http://logs.openstack.org/98/81098/2/check/check-tempest-dsvm-neutron-pg/df24b97/logs/screen-q-lbaas.txt.gz

seems to me that one of the ballancers had a problem, although it passed the connection check, so maybe adding a retry with a timeout at https://github.com/openstack/tempest/blob/master/tempest/scenario/test_load_balancer_basic.py#L213 will help to solve this issue.

Adding neutron team to see their thoughts

[Oleg Bondarev (obondarev)]

Seems "Cannot open network namespace: No such file or directory\n" traces are unrelated and will likely be fixed by https://review.openstack.org/#/c/81098/.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/81537
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=14b6611efea4c9658c611e8cfcfb42fc7dd82f55
Submitter: Jenkins
Branch: master

commit 14b6611efea4c9658c611e8cfcfb42fc7dd82f55
Author: Eugene Nikanorov <email address hidden>
Date: Wed Mar 19 18:00:35 2014 +0400

    Fix namespace exist() method

    Fix namespace exist() method for it shall not be called with a root.
    Also, don't run it under the namespace so garbage_collect_namespace
    method can run without rootwrap and not withi a ns.

    As a result of fixing namespace listing the patch also fixes the
    regression introduced (bug/1294603) to loadbalancer agent respawning
    haproxy due to inability to list namespaces properly.

    Change-Id: I0dc4d01b0c1c04887ec6ad5766ec7c6c96903faa
    Closes-Bug: #1297594
    Closes-Bug: #1294603

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/82480
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=55d1314dde67ddafbb699d618bfba74bf6ad7714
Submitter: Jenkins
Branch: master

commit 55d1314dde67ddafbb699d618bfba74bf6ad7714
Author: Eugene Nikanorov <email address hidden>
Date: Mon Mar 24 15:39:21 2014 +0400

    Unskip load balancer basic scenario test

    Corresponding bug 1294603 was fixed by commit
    I0dc4d01b0c1c04887ec6ad5766ec7c6c96903faa

    Due to recent changes in neutron and nova which
    fixed security groups for ml2 plugin
    If004db60e084f4cea095ca9ecccb0537240d4183 and I3bbcfc67036ab7389c82720add0bc0fc627bfee0,
    one should create security group rules to allow traffic on specific tcp port.
    So patch adds rules to allow ingress traffic
    for ports 80 and 88.

    Closes-Bug: #1294603
    Change-Id: Idff6d27611adda502e6e3f7e0d37f3acbda41d03