mariadb10 libs are needed when building the repo

Bug #1565128 reported by Kevin Carter
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Critical
Kevin Carter
Liberty
Fix Committed
Medium
Miguel Alejandro Cantu
Mitaka
Fix Released
Critical
Jesse Pretorius
Trunk
Fix Released
Critical
Kevin Carter

Bug Description

The mariadb10 client libs are required to build a proper repository of wheels. Without them the repo build process will use the libs as provided by the base operating system which are old and wrong.

### Example error ###
In [1]: import MySQLdb
---------------------------------------------------------------------------
ImportError Traceback (most recent call last)
<ipython-input-1-dd22983d5391> in <module>()
----> 1 import MySQLdb

/usr/local/lib/python2.7/dist-packages/MySQLdb/__init__.py in <module>()
     17 from MySQLdb.release import __version__, version_info, __author__
     18
---> 19 import _mysql
     20
     21 if version_info != _mysql.version_info:

ImportError: libmariadbclient.so.18: cannot open shared object file: No such file or directory

### Example of the wrong and correct libs ###
  http://paste.openstack.org/show/492788/

To resolve this the galera_client role should be a dependency of the repo_build role.

Changed in openstack-ansible:
status: New → Triaged
importance: Undecided → Critical
assignee: nobody → Kevin Carter (kevin-carter)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-repo_build (master)

Fix proposed to branch: master
Review: https://review.openstack.org/300686

Changed in openstack-ansible:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-repo_build (master)

Reviewed: https://review.openstack.org/300686
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-repo_build/commit/?id=9e6b78a9b459eebbae87c97ea474c724f50bd3e3
Submitter: Jenkins
Branch: master

commit 9e6b78a9b459eebbae87c97ea474c724f50bd3e3
Author: Kevin Carter <email address hidden>
Date: Fri Apr 1 17:37:28 2016 -0500

    Add the galera_client dependency to the repo build

    This change is required because without it the client libraries
    used to build the MySQL-Python packages will depend on the base
    system and they will be wrong.

    This is an example of the issue:
      http://paste.openstack.org/show/492788/

    This will cause multi node production issues when building a
    standalong repository outside of the the OpenStack gate.

    Closes-Bug: #1565128
    Change-Id: I6536993523f02ba49da741b9ea21535eb33fe402
    Signed-off-by: Kevin Carter <email address hidden>

Changed in openstack-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-repo_build (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/301103

no longer affects: openstack-ansible/liberty
no longer affects: openstack-ansible/kilo
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-repo_build (stable/mitaka)

Reviewed: https://review.openstack.org/301103
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-repo_build/commit/?id=0ce640328e484fcb442fdae66bb7edee9ce4d232
Submitter: Jenkins
Branch: stable/mitaka

commit 0ce640328e484fcb442fdae66bb7edee9ce4d232
Author: Kevin Carter <email address hidden>
Date: Fri Apr 1 17:37:28 2016 -0500

    Add the galera_client dependency to the repo build

    This change is required because without it the client libraries
    used to build the MySQL-Python packages will depend on the base
    system and they will be wrong.

    This is an example of the issue:
      http://paste.openstack.org/show/492788/

    This will cause multi node production issues when building a
    standalong repository outside of the the OpenStack gate.

    Closes-Bug: #1565128
    Change-Id: I6536993523f02ba49da741b9ea21535eb33fe402
    Signed-off-by: Kevin Carter <email address hidden>
    (cherry picked from commit 9e6b78a9b459eebbae87c97ea474c724f50bd3e3)

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible-repo_build 13.0.1

This issue was fixed in the openstack/openstack-ansible-repo_build 13.0.1 release.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote :

This issue was fixed in the openstack/openstack-ansible-repo_build 13.0.1 release.

Revision history for this message
Charles Farquhar (cfarquhar) wrote :

This affects Liberty as well if the repo is being built locally rather than fetched from rpc-repo.rackspace.com.

I either don't have privileges to mark Liberty as an affected branch or didn't find the correct place to do so. Can someone please mark Liberty as affected?

Revision history for this message
Jesse Pretorius (jesse-pretorius) wrote :

Hi Charles,

From Liberty onwards the repo is always built locally and is never copied from anywhere. There is a considerable amount of gate testing confirming that everything works so I'd be interested in understand more about the custom configuration implemented that can be used to verify the problem.

Thanks.

Revision history for this message
Thierry Carrez (ttx) wrote : Fix included in openstack/openstack-ansible-repo_build 14.0.0.0b1

This issue was fixed in the openstack/openstack-ansible-repo_build 14.0.0.0b1 development milestone.

Revision history for this message
Miguel Alejandro Cantu (miguel-cantu) wrote :

@cfarquhar
Sorry if this is kind of a late comment. I'm going to work on reproducing the problem you spoke of on liberty. Could you give me more insight on the environment you had set up? What it just a straight up, out-of-the-box, liberty install?

Revision history for this message
Miguel Alejandro Cantu (miguel-cantu) wrote :

I've noticed the same behavior on the liberty branch. The mariadb10 client libs are incorrect on the repo server.
http://paste.openstack.org/show/543424/

I'm going to work on getting this backported to liberty.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (liberty)

Fix proposed to branch: liberty
Review: https://review.openstack.org/348533

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (liberty)

Reviewed: https://review.openstack.org/348533
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=53f446e3d72720a5b00e275c5948504c5ab650a0
Submitter: Jenkins
Branch: liberty

commit 53f446e3d72720a5b00e275c5948504c5ab650a0
Author: Miguel Alex Cantu <email address hidden>
Date: Thu Jul 28 19:57:10 2016 +0000

    Add the galera_client dependency to the repo build

    This change is required because without it the client libraries
    used to build the MySQL-Python packages will depend on the base
    system and they will be wrong.

    In the original backport, galera_client was set as a dependency
    of the repo_build role. However, due to galera_client's
    dependency on pip_lock_down in liberty, the galera_client role
    must be invoked with pip_no_index=false.

    This is an example of the issue:
      http://paste.openstack.org/show/543424/

    This is the same command when this fix is in place:
      http://paste.openstack.org/show/543436/

    Backport for change I6536993523f02ba49da741b9ea21535eb33fe402

    Change-Id: I8e62bf2e09217e5fb47d021dfa7f754c09297c62
    Closes-Bug: #1565128

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible 12.2.1

This issue was fixed in the openstack/openstack-ansible 12.2.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.