periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria is failing with Error while evaluating a Resource Statement, Duplicate declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared

Bug #1903828 reported by Sandeep Yadav
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Unassigned

Bug Description

Description:-

periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria is failing with Error while evaluating a Resource Statement, Duplicate declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared at (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77); cannot redeclare (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77)

Issue started on 10th Nov

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria

Logs:-

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/8ffc7a9/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/93bb9c8/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

~~~
<13>Nov 10 23:04:54 puppet-user: Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared at (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77); cannot redeclare (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77) (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77, column: 5) (file: /etc/puppet/modules/tripleo/manifests/profile/base/certmonger_user.pp, line: 258) on node standalone-0.ooo.test", "stderr_lines": ["<13>Nov 10 23:04:42 puppet-user: Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5", "<13>Nov 10 23:04:53 puppet-user: (file: /etc/puppet/hiera.yaml)", "<13>Nov 10 23:04:53 puppet-user: Warning: Undefined variable '::deploy_config_name'; ", "<13>Nov 10 23:04:53 puppet-user: (file & line not available)", "<13>Nov 10 23:04:53 puppet-user: Warning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/6.14/deprecated_language.html", "<13>Nov 10 23:04:53 puppet-user: (file & line not available)", "<13>Nov 10 23:04:53 puppet-user: Warning: Undefined variable '::nova::params::vncproxy_service_name'; class nova::params has not been evaluated", "<13>Nov 10 23:04:53 puppet-user: (file & line not available)", "<13>Nov 10 23:04:53 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/profile/base/database/mysql/client.pp, line: 89, column: 8)", "<13>Nov 10 23:04:54 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/packages.pp, line: 39, column: 69)", "<13>Nov 10 23:04:54 puppet-user: Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared at (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77); cannot redeclare (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77) (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77, column: 5) (file: /etc/puppet/modules/tripleo/manifests/profile/base/certmonger_user.pp, line: 258) on node standalone-0.ooo.test"], "stdout": "", "stdout_lines": []}
2020-11-10 23:04:55.880868 | fa163e8d-e793-7fdf-be52-000000001225 | TIMING | Wait for puppet host configuration to finish | standalone-0 | 0:13:27.738031 | 13.18s

PLAY RECAP *********************************************************************
standalone-0 : ok=231 changed=133 unreachable=0 failed=1 skipped=84 rescued=0 ignored=
~~~

summary: periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria is
failing with Error while evaluating a Resource Statement, Duplicate
- declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared at
- (file: /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line:
- 77); cannot redeclare (file:
- /etc/puppet/modules/tripleo/manifests/certmonger/qemu.pp, line: 77)
+ declaration: Exec[/etc/pki/CA/certs/qemu.pem] is already declared
Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :

Hello All,

periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria job runs are not hitting Duplicate declaration error(reported in this bug) anymore since yesterday.

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/1bf7f31/job-output.txt

Jobs have passed the standalone deploy steps and now failing at tempest

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/1bf7f31/logs/undercloud/var/log/containers/nova/nova-compute.log.txt.gz
~~~
2020-11-11 11:45:05.748 7 WARNING oslo_privsep.priv_context [req-3bef255f-d9ca-45ae-8c57-83268bf4c3a4 22751d4280194fa49f9b8c9c14bb0738 e4a59df6fbd64223bfeca8774d5244f5 - default default] privsep daemon already running: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-11-11T11:45:04.314113Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.
~~~

We have an ongoing bug for the above issue - https://bugs.launchpad.net/tripleo/+bug/1903508

Checking with Martin/Adee to know which patch fixed the issue.

Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :

Hello,

Checked with Martin, Affected jobs were running without https://review.opendev.org/#/c/760522/

After merge of above patch, we are no longer hitting the issue.

Affected jobs:-

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/8ffc7a9/logs/undercloud/var/log/extra/package-list-installed.txt.gz
~~~
openstack-tripleo-heat-templates.noarch 13.0.1-0.20201107080412.2363387.el8 @delorean-current
~~~

Latest jobs:-

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-victoria/1bf7f31/logs/undercloud/var/log/extra/package-list-installed.txt.gz
~~~
openstack-tripleo-heat-templates.noarch 13.0.1-0.20201111031929.6e59a84.el8 @delorean-current
~~~

https://github.com/openstack/tripleo-heat-templates/commits/stable/victoria

~~~
Use bind mounts for tls certificates - 6e59a84
~~~

Closing this bug, fixed by https://review.opendev.org/#/c/760522/

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.