'unicode' does not have the buffer interface

[Abhijeet Jain]

Due to new setuptools release we might have problems in all OpenStack projects - new_setuptools + python 2.x + pbr == big problem

2014-06-02 07:51:24.673 | + sudo PIP_DOWNLOAD_CACHE=/var/cache/pip http_proxy= https_proxy= no_proxy= /usr/local/bin/pip install --build=/tmp/pip-build.zyNKF /opt/stack/new/pycadf
2014-06-02 07:51:25.000 | DEPRECATION: --no-install, --no-download, --build, and --no-clean are deprecated. See https://github.com/pypa/pip/issues/906.
2014-06-02 07:51:25.039 | Unpacking /opt/stack/new/pycadf
2014-06-02 07:51:25.039 | Running setup.py (path:/tmp/pip-jYQO4H-build/setup.py) egg_info for package from file:///opt/stack/new/pycadf
2014-06-02 07:51:25.541 | Traceback (most recent call last):
2014-06-02 07:51:25.579 | File "<string>", line 17, in <module>
2014-06-02 07:51:25.580 | File "/tmp/pip-jYQO4H-build/setup.py", line 30, in <module>
2014-06-02 07:51:25.580 | pbr=True)
2014-06-02 07:51:25.580 | File "/usr/lib/python2.7/distutils/core.py", line 152, in setup
2014-06-02 07:51:25.580 | dist.run_commands()
2014-06-02 07:51:25.580 | File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
2014-06-02 07:51:25.580 | self.run_command(cmd)
2014-06-02 07:51:25.581 | File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
2014-06-02 07:51:25.581 | cmd_obj.run()
2014-06-02 07:51:25.581 | File "<string>", line 14, in replacement_run
2014-06-02 07:51:25.581 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 368, in write_requirements
2014-06-02 07:51:25.581 | _write_requirements(data, dist.install_requires)
2014-06-02 07:51:25.581 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 363, in _write_requirements
2014-06-02 07:51:25.582 | stream.writelines(lines)
2014-06-02 07:51:25.582 | TypeError: 'unicode' does not have the buffer interface
2014-06-02 07:51:25.637 | Complete output from command python setup.py egg_info:
2014-06-02 07:51:25.661 | running egg_info
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | creating pip-egg-info/pycadf.egg-info
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | Traceback (most recent call last):
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | File "<string>", line 17, in <module>
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | File "/tmp/pip-jYQO4H-build/setup.py", line 30, in <module>
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | pbr=True)
2014-06-02 07:51:25.662 |
2014-06-02 07:51:25.662 | File "/usr/lib/python2.7/distutils/core.py", line 152, in setup
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | dist.run_commands()
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | self.run_command(cmd)
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | cmd_obj.run()
2014-06-02 07:51:25.663 |
2014-06-02 07:51:25.663 | File "<string>", line 14, in replacement_run
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.664 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 368, in write_requirements
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.664 | _write_requirements(data, dist.install_requires)
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.664 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 363, in _write_requirements
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.664 | stream.writelines(lines)
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.664 | TypeError: 'unicode' does not have the buffer interface
2014-06-02 07:51:25.664 |
2014-06-02 07:51:25.665 | ----------------------------------------

For more details :
http://logs.openstack.org/10/87910/5/check/check-grenade-dsvm/6e093ba/console.html#_2014-06-02_07_51_25_662

[Pavlo Shchelokovskyy (pshchelo)]

I'm seeing the same but for python-keystoneclient

2014-06-02 10:23:37.803 | creating python_keystoneclient.egg-info
2014-06-02 10:23:37.803 |
2014-06-02 10:23:37.803 | Traceback (most recent call last):
2014-06-02 10:23:37.803 |
2014-06-02 10:23:37.803 | File "<string>", line 17, in <module>
2014-06-02 10:23:37.803 |
2014-06-02 10:23:37.804 | File "/opt/stack/new/python-keystoneclient/setup.py", line 30, in <module>
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.804 | pbr=True)
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.804 | File "/usr/lib/python2.7/distutils/core.py", line 152, in setup
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.804 | dist.run_commands()
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.804 | File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.804 | self.run_command(cmd)
2014-06-02 10:23:37.804 |
2014-06-02 10:23:37.805 | File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
2014-06-02 10:23:37.805 |
2014-06-02 10:23:37.805 | cmd_obj.run()
2014-06-02 10:23:37.805 |
2014-06-02 10:23:37.805 | File "<string>", line 14, in replacement_run
2014-06-02 10:23:37.805 |
2014-06-02 10:23:37.805 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 368, in write_requirements
2014-06-02 10:23:37.805 |
2014-06-02 10:23:37.805 | _write_requirements(data, dist.install_requires)
2014-06-02 10:23:37.805 |
2014-06-02 10:23:37.805 | File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 363, in _write_requirements
2014-06-02 10:23:37.806 |
2014-06-02 10:23:37.806 | stream.writelines(lines)
2014-06-02 10:23:37.806 |
2014-06-02 10:23:37.806 | TypeError: 'unicode' does not have the buffer interface
2014-06-02 10:23:37.806 |
2014-06-02 10:23:37.806 | ----------------------------------------
2014-06-02 10:23:37.806 | Cleaning up...
2014-06-02 10:23:37.807 | Command python setup.py egg_info failed with error code 1 in /opt/stack/new/python-keystoneclient

more info: http://logs.openstack.org/29/96129/6/check/check-grenade-dsvm/d3b764e/console.html

[Andrey Pavlov (apavlov-e)]

my two failed reviews for tempest with same logs
https://review.openstack.org/#/c/96460/
https://review.openstack.org/#/c/97139/

[Dina Belova (dbelova)]

The same for some of the the ceilometer Jenkins jobs failings - in the https://review.openstack.org/#/c/97176/ and https://review.openstack.org/#/c/96781/ at least

[Dina Belova (dbelova)]

New setuptools release is the problem - it's everywhere

[Dina Belova (dbelova)]

here is the link to one of the discussions about this issue: https://bitbucket.org/pypa/setuptools/issue/213/regression-setuptools-37-installation

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/97221

[Alex Gaynor (alex-gaynor)]

Bug has been fixed upstream: https://bitbucket.org/pypa/setuptools/issue/213/newest-setuptools-breaks-installation-of we need to make sure we have the latest (4.0.1) setuptools and everything should be golden.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/97221
Committed: https://git.openstack.org/cgit/openstack-infra/elastic-recheck/commit/?id=09bbc594f3c9dd9edcd1c93f44428a2f34c1a68d
Submitter: Jenkins
Branch: master

commit 09bbc594f3c9dd9edcd1c93f44428a2f34c1a68d
Author: Sean Dague <email address hidden>
Date: Mon Jun 2 08:40:11 2014 -0400

    added bug for setuptools 3.7 breaking the world

    Change-Id: Iee923bcd05f0435e46dc7f119d1ad63bab815c38
    Related-Bug: #1325514

[James Polley (tchaypo)]

I've updated this to "fix releaseD" as 3.7.1/4.0.1 seem to fix the problem.