Constant tracebacks with eventlet 0.18.2

Bug #1544801 reported by Jesse Keating
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Cinder
Invalid
Undecided
Unassigned
Glance
Invalid
Undecided
Unassigned
OpenStack Compute (nova)
Invalid
Undecided
Davanum Srinivas (DIMS)
neutron
Expired
Undecided
Unassigned

Bug Description

Kilo builds, with eventlet 0.18.2 have a constant traceback:

2016-02-12 00:47:01.126 3936 DEBUG nova.api.openstack.wsgi [-] Calling method '<bound method Versions.index of <nova.api.openstack.compute.versions.Versions object at 0x7f05a0acfbd0>>' _process_stack /opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:783
2016-02-12 00:47:01.129 3936 INFO nova.osapi_compute.wsgi.server [-] Traceback (most recent call last):
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/wsgi.py", line 501, in handle_one_response
    write(b''.join(towrite))
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/wsgi.py", line 442, in write
    _writelines(towrite)
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/support/__init__.py", line 62, in safe_writelines
    writeall(fd, item)
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/support/__init__.py", line 67, in writeall
    fd.write(buf)
  File "/usr/lib/python2.7/socket.py", line 324, in write
    self.flush()
  File "/usr/lib/python2.7/socket.py", line 303, in flush
    self._sock.sendall(view[write_offset:write_offset+buffer_size])
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/greenio/base.py", line 383, in sendall
    tail = self.send(data, flags)
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/greenio/base.py", line 377, in send
    return self._send_loop(self.fd.send, data, flags)
  File "/opt/bbc/openstack-11.0-bbc153/nova/local/lib/python2.7/site-packages/eventlet/greenio/base.py", line 364, in _send_loop
    return send_method(data, *args)
error: [Errno 104] Connection reset by peer

This is happening across nova, neutron, glance, etc..

Dropping back to eventlet < 0.18.0 works.

Revision history for this message
Markus Zoeller (markus_z) (mzoeller) wrote :

@Jesse Keating:

The periodic check for stable/kilo python27 shows no failure [1]
although it uses eventlet version 0.18.2 [2].

* What's the exact version of Nova you are using?
* What are the steps which lead to that traceback?

Please switch the status back to "new" after you provided the needed
information.

References:
[1] http://logs.openstack.org/periodic-stable/periodic-nova-python27-kilo/0015699/testr_results.html.gz
[2] http://logs.openstack.org/periodic-stable/periodic-nova-python27-kilo/0015699/console.html#_2016-02-12_07_12_51_249

Changed in nova:
status: New → Incomplete
Revision history for this message
Markus Zoeller (markus_z) (mzoeller) wrote :

I double-checked in a local VM with Devstack if I can create an Instance with latest "stable/kilo" code and it worked.

Nova version:
    $ git log --no-merges --oneline -1
    d95b321 Replace eventlet-based raw socket client with requests

Eventlet version:
    $ pip show eventlet
    ---
    Metadata-Version: 2.0
    Name: eventlet
    Version: 0.18.2
    Summary: Highly concurrent networking library
    Home-page: http://eventlet.net
    Author: Linden Lab
    Author-email: <email address hidden>
    License: UNKNOWN
    Location: /usr/local/lib/python2.7/dist-packages
    Requires: greenlet

Revision history for this message
Matt Riedemann (mriedem) wrote :
Changed in nova:
status: Incomplete → Confirmed
Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
Matt Riedemann (mriedem) wrote :

Someone should probably open an issue against eventlet. This was the change:

https://github.com/eventlet/eventlet/commit/b7380fdc70fde26777f4f141da3f01570e870cac

Revision history for this message
Jesse Keating (jesse-keating) wrote :
Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote :

Looks like this dropped off

Changed in nova:
status: Confirmed → Invalid
assignee: nobody → Davanum Srinivas (DIMS) (dims-v)
Changed in cinder:
status: New → Invalid
Revision history for this message
Armando Migliaccio (armando-migliaccio) wrote :

This bug is > 180 days without activity. We are unsetting assignee and milestone and setting status to Incomplete in order to allow its expiry in 60 days.

If the bug is still valid, then update the bug status.

Changed in neutron:
status: New → Incomplete
Revision history for this message
Cyril Roelandt (cyril-roelandt) wrote :

I don't think this has been an issue in recent versions of Glance/Python/Eventlet. I'll close this bug, feel free to reopen if needed.

Changed in glance:
status: New → Invalid
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for neutron because there has been no activity for 60 days.]

Changed in neutron:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers