lint/syntax/unit/litums jobs are failing because of error with bundle install

Bug #1917457 reported by Takashi Kajinami
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
puppet-openstack-integration
Fix Released
Critical
Takashi Kajinami
puppet-openstack-spec-helper
Fix Released
Critical
Takashi Kajinami

Bug Description

Currently lint/syntax/unit/litmus jobs are failing.
It seems that all of failures are caused by the error during installing http-parser

~~~
2021-03-02 09:13:31.662628 | ubuntu-bionic | Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

2021-03-02 09:13:31.662707 | ubuntu-bionic |

2021-03-02 09:13:31.662727 | ubuntu-bionic | current directory:

2021-03-02 09:13:31.662745 | ubuntu-bionic | /home/zuul/workspace/openstack-nova/.bundled_gems/gems/http-parser-1.2.3/ext

2021-03-02 09:13:31.662762 | ubuntu-bionic | /usr/bin/ruby2.5 -rrubygems

2021-03-02 09:13:31.662779 | ubuntu-bionic | /usr/share/rubygems-integration/all/gems/rake-12.3.1/exe/rake

2021-03-02 09:13:31.662796 | ubuntu-bionic | RUBYARCHDIR=/home/zuul/workspace/openstack-nova/.bundled_gems/extensions/x86_64-linux/2.5.0/http-parser-1.2.3

2021-03-02 09:13:31.662814 | ubuntu-bionic | RUBYLIBDIR=/home/zuul/workspace/openstack-nova/.bundled_gems/extensions/x86_64-linux/2.5.0/http-parser-1.2.3

2021-03-02 09:13:31.662831 | ubuntu-bionic | /usr/bin/ruby2.5: No such file or directory --

2021-03-02 09:13:31.662848 | ubuntu-bionic | /usr/share/rubygems-integration/all/gems/rake-12.3.1/exe/rake (LoadError)

2021-03-02 09:13:31.662865 | ubuntu-bionic |

2021-03-02 09:13:31.662881 | ubuntu-bionic | rake failed, exit code 1

2021-03-02 09:13:31.662897 | ubuntu-bionic |

2021-03-02 09:13:31.662913 | ubuntu-bionic | Gem files will remain installed in

2021-03-02 09:13:31.662952 | ubuntu-bionic | /home/zuul/workspace/openstack-nova/.bundled_gems/gems/http-parser-1.2.3 for

2021-03-02 09:13:31.662974 | ubuntu-bionic | inspection.

2021-03-02 09:13:31.662991 | ubuntu-bionic | Results logged to

2021-03-02 09:13:31.663008 | ubuntu-bionic | /home/zuul/workspace/openstack-nova/.bundled_gems/extensions/x86_64-linux/2.5.0/http-parser-1.2.3/gem_make.out

2021-03-02 09:13:31.663025 | ubuntu-bionic |

2021-03-02 09:13:31.663041 | ubuntu-bionic | An error occurred while installing http-parser (1.2.3), and Bundler cannot

2021-03-02 09:13:31.663057 | ubuntu-bionic | continue.

2021-03-02 09:13:31.663074 | ubuntu-bionic | Make sure that `gem install http-parser -v '1.2.3' --source

2021-03-02 09:13:31.663090 | ubuntu-bionic | 'https://rubygems.org/'` succeeds before bundling.

2021-03-02 09:13:31.663120 | ubuntu-bionic |

2021-03-02 09:13:31.663138 | ubuntu-bionic | In Gemfile:

2021-03-02 09:13:31.663155 | ubuntu-bionic | puppet-openstack_spec_helper was resolved to 18.0.0, which depends on

2021-03-02 09:13:31.663171 | ubuntu-bionic | puppet_litmus was resolved to 0.25.1, which depends on

2021-03-02 09:13:31.663188 | ubuntu-bionic | rspec_honeycomb_formatter was resolved to 0.2.1, which depends on

2021-03-02 09:13:31.663204 | ubuntu-bionic | honeycomb-beeline was resolved to 2.4.0, which depends on

2021-03-02 09:13:31.663220 | ubuntu-bionic | libhoney was resolved to 1.18.0, which depends on

2021-03-02 09:13:31.663237 | ubuntu-bionic | http was resolved to 4.4.1, which depends on

2021-03-02 09:13:31.663253 | ubuntu-bionic | http-parser

2021-03-02 09:13:31.939816 | ubuntu-bionic | ERROR
~~~

https://zuul.opendev.org/t/openstack/build/94e1e8bcc71b4909b94777f4829252a4/log/job-output.txt#1364-1396

Revision history for this message
Takashi Kajinami (kajinamit) wrote :

https://github.com/cotag/http-parser/issues/2
https://github.com/httprb/http/issues/572

It seems like there is something doesn't work well with rake package in Ubuntu.
I see that ubuntu nodes have rake 12.3.1 which comes from ubuntu packaging and that is causing a problem.

However we see that the failure in centos is a bit different (sh: rake: command not found).

https://zuul.opendev.org/t/openstack/build/efd39f46491e4896b6a15638dda1bb1a/log/job-output.txt#2216-2280

Revision history for this message
Takashi Kajinami (kajinamit) wrote :

I tried pinning bundler to 2.2.11[1] but seems like it can solve the problem.
I see that lint/syntax jobs passed. Let's see how the others go.
 https://review.opendev.org/c/openstack/puppet-openstack-integration/+/778184

Another solution might be to install the latest rake and get rid of the package
coming from distro.

Note that we need the same fix to spec_helper as well.
 https://review.opendev.org/c/openstack/puppet-openstack_spec_helper/+/778185

I haven't identified dependencies between two repos so it's not yet clear whether we can fix the problem one by one.
(if we need to fix both repos at the same time then we need some tricks to merge the first one)

Revision history for this message
Takashi Kajinami (kajinamit) wrote :

I noticed the issue is observed only in Victoria and master.
It seems that the problem is triggered by puppet_litmus package(which requires http-parser as its depnedency) and ussri and older branches are not affected because they use beaker instead of litmus.

Changed in puppet-openstack-integration:
status: New → In Progress
Changed in puppet-openstack-spec-helper:
status: New → In Progress
Changed in puppet-openstack-integration:
importance: Undecided → Critical
Changed in puppet-openstack-spec-helper:
importance: Undecided → Critical
Changed in puppet-openstack-integration:
assignee: nobody → Takashi Kajinami (kajinamit)
Changed in puppet-openstack-spec-helper:
assignee: nobody → Takashi Kajinami (kajinamit)
Revision history for this message
Takashi Kajinami (kajinamit) wrote :
Changed in puppet-openstack-integration:
status: In Progress → Fix Released
Changed in puppet-openstack-spec-helper:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/puppet-openstack_spec_helper victoria-eol

This issue was fixed in the openstack/puppet-openstack_spec_helper victoria-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/puppet-openstack_spec_helper yoga-eom

This issue was fixed in the openstack/puppet-openstack_spec_helper yoga-eom release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.