SM:Centos:mainline 2746: Provision not starting due to issues under module packaging

[sundarkh]

SM:Centos:mainline 2746: Provision not starting due to issues under module packaging

1) Install SM (Ubuntu)mainline 2746 liberty
2) Add Centos7.2 , Contrail mainline 2746 liberty package(tgz) in the SM database
3) Reimage the target node with centos7.2; Observe that reimage goes succesfully
4) Inititate a provision from SM,
5) Observe that the Provision gets stuck with

Oct 12 23:07:50 nodec33 puppet-agent[11968]: Could not retrieve catalog from remote server: Error 400 on SERVER: Unknown function suffix at /etc/puppet/environments/centos72liberty2746/modules/contrail/manifests/params.pp:895 on node nodec33.englab.juniper.net
Oct 12 23:07:50 nodec33 puppet-agent[11968]: Not using cache on failed catalog
Oct 12 23:07:50 nodec33 puppet-agent[11968]: Could not retrieve catalog; skipping run
Oct 12 23:07:50 nodec33 puppet: /usr/share/ruby/vendor_ruby/puppet/ag
ent.rb:87:in `exit': no implicit conversion from nil to integer (TypeError)

Note : When the contrail package(rpm) is used to provision , the error message observed is different from the above

Oct 13 00:31:47 nodeg37 puppet-agent[11210]: Could not request certificate: Error 400 on SERVER: header too long

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/24880
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/24880
Committed: http://github.org/Juniper/contrail-server-manager/commit/3abcabbe95cb0006273c39b22b4e60420d65e762
Submitter: Zuul
Branch: master

commit 3abcabbe95cb0006273c39b22b4e60420d65e762
Author: Dheeraj Gautam <email address hidden>
Date: Thu Oct 13 15:35:52 2016 -0700

SM-Third-Party: Fix rpm puppet build

Partial-Bug: #1632960

use correct directary for builddir

Change-Id: I71b69a4240e89ef1c9471a28360c0a9f113960ce

[sundarkh (sundar-kh)]

Issue seen with build 3007

[Ritam Gangopadhyay (ritam)]

Provisioning on build 1 of R3.2 gets stuck at database_completed state because it runs into declaration errors when openstack provisioning is started. Here are the sequential errors seen. This is blocking all sanity on centos build on mainline for long and R3.2 as of now.

Oct 24 20:54:34 localhost puppet-agent[10975]: Could not retrieve catalog from remote server: Error 400 on SERVER: Duplicate declaration: Keystone_config[database/min_pool_size] is already declared in file /etc/puppet/environments/centos72mitaka1/modules/keystone/manifests/db.pp:100; cannot redeclare at /etc/puppet/environments/centos72mitaka1/modules/contrail/manifests/profile/openstack/keystone.pp:69 on node nodeh8.englab.juniper.net

Oct 24 21:05:35 localhost puppet-agent[22149]: Could not retrieve catalog from remote server: Error 400 on SERVER: Duplicate declaration: Glance_api_config[database/min_pool_size] is already declared in file /etc/puppet/environments/centos72mitaka1/modules/glance/manifests/api/db.pp:99; cannot redeclare at /etc/puppet/environments/centos72mitaka1/modules/contrail/manifests/profile/openstack/glance.pp:77 on node nodeh8.englab.juniper.net

Oct 24 21:07:35 localhost puppet-agent[24371]: Could not retrieve catalog from remote server: Error 400 on SERVER: Duplicate declaration: Glance_registry_config[database/min_pool_size] is already declared in file /etc/puppet/environments/centos72mitaka1/modules/glance/manifests/registry/db.pp:99; cannot redeclare at /etc/puppet/environments/centos72mitaka1/modules/contrail/manifests/profile/openstack/glance.pp:77 on node nodeh8.englab.juniper.net

[Dheeraj Gautam (dgautam)]

This is due to a change related to mitaka module updates. (refer bug-id https://bugs.launchpad.net/juniperopenstack/+bug/1628325) https://review.opencontrail.org/#/c/25206/ (R3.2) and https://review.opencontrail.org/#/c/24958/ (master). This change was merged today morning into R3.2. corresponding change to was not merged into master before R3.2 was pulled off.

Also the issue you are facing is not specific centos. Even Ubuntu provisioning will fail due to the same reason.

[Ritam Gangopadhyay (ritam)]

The above issue is not centos specific and seems to be accross all SKU's so opening a new bug to track it.

[Ritam Gangopadhyay (ritam)]

closing the R3.2 scope