tripleo

Error: Unable to find a match: fence-agents-all"

Bug #1955559 reported by chandan kumar on 2021-12-22

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	tripleo	Fix Released	High	Unassigned	tripleo yoga-1

Bug Description

CentOS Stream 9 featureset002 OVB job failed at overcloud deploy[1]

```
2021-12-22 04:35:58 | 2021-12-22 04:35:58.781171 | fa163ed0-f418-6d83-c4a0-000000002616 | FATAL | Wait for puppet host configuration to finish | overcloud-controller-0 | error={"ansible_job_id": "115158628160.20935", "attempts": 4, "changed": true, "cmd": "set -o pipefail; puppet apply --modulepath=/etc/puppet/modules:/opt/stack/puppet-modules:/usr/share/openstack-puppet/modules --detailed-exitcodes --summarize --color=false /var/lib/tripleo-config/puppet_step_config.pp 2>&1 | logger -s -t puppet-user", "delta": "0:00:08.229334", "end": "2021-12-22 09:35:57.029322", "failed_when_result": true, "finished": 1, "msg": "non-zero return code", "rc": 6, "results_file": "/tmp/.ansible_async/115158628160.20935", "start": "2021-12-22 09:35:48.799988", "started": 1, "stderr": "<13>Dec 22 09:35:48 puppet-user: Error: Facter: error while resolving custom facts in /usr/share/openstack-puppet/modules/kmod/lib/facter/kmod.rb: expected argument to be a String, Symbol, or Hash\n<13>Dec 22 09:35:54 puppet-user: Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5\n<13>Dec 22 09:35:54 puppet-user: (file: /etc/puppet/hiera.yaml)\n<13>Dec 22 09:35:54 puppet-user: Warning: Undefined variable '::deploy_config_name'; \n<13>Dec 22 09:35:54 puppet-user: (file & line not available)\n<13>Dec 22 09:35:54 puppet-user: Warning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.10/deprecated_language.html\n<13>Dec 22 09:35:54 puppet-user: (file & line not available)\n<13>Dec 22 09:35:54 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/profile/base/database/mysql/client.pp, line: 89, column: 8)\n<13>Dec 22 09:35:54 puppet-user: error: Could not connect to controller: Connection refused\n<13>Dec 22 09:35:54 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/packages.pp, line: 39, column: 69)\n<13>Dec 22 09:35:54 puppet-user: Notice: Compiled catalog for overcloud-controller-0.localdomain in environment production in 0.68 seconds\n<13>Dec 22 09:35:54 puppet-user: Notice: /Stage[main]/Tripleo::Profile::Base::Database::Mysql::Client/File[/etc/my.cnf.d/tripleo.cnf]/ensure: created\n<13>Dec 22 09:35:54 puppet-user: Notice: /Stage[main]/Tripleo::Profile::Base::Database::Mysql::Client/Augeas[tripleo-mysql-client-conf]/returns: executed successfully\n<13>Dec 22 09:35:55 puppet-user: Error: Execution of '/bin/dnf -d 0 -e 1 -y install fence-agents-all' returned 1: Error: Unable to find a match: fence-agents-all\n<13>Dec 22 09:35:55 puppet-user: Error: /Stage[main]/Pacemaker::Install/Package[fence-agents-all]/ensure: change from 'purged' to 'present' failed: Execution of '/bin/dnf -d 0 -e 1 -y install fence-agents-all' returned 1: Error: Unable to find a match: fence-agents-all\n<13>Dec 22 09:35:55 puppet-user: Notice: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_debug_ini]: Dependency Package[fence-agents-all] has failures: true\n<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_debug_ini]: Skipping because of failed dependencies\n<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_bind_addr]: Skipping because of failed dependencies\n<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/User[hacluster]: Skipping because of failed dependencies\n<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[pcsd]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[reauthenticate-across-all-nodes]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[auth-successful-across-all-nodes]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[Create Cluster tripleo_cluster]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[Start Cluster tripleo_cluster]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[corosync]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[pacemaker]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[wait-for-settle]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[overcloud-ca]/File[/etc/pki/ca-trust/source/anchors/overcloud-ca.pem]/ensure: defined content as '{sha256}696ab523a4a032b3df87e9ebde539ba48edd4f717b6a45a2261ad58c8aa329bc'\n<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[overcloud-ca]/Exec[trust-ca-overcloud-ca]: Triggered 'refresh' from 1 event\n<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[undercloud-ca]/File[/etc/pki/ca-trust/source/anchors/undercloud-ca.pem]/ensure: defined content as '{sha256}6cf91ce1b7ef27144b1c87f71ecf12f22141afd04ba0eea8260d811d6a1aa268'\n<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[undercloud-ca]/Exec[trust-ca-undercloud-ca]: Triggered 'refresh' from 1 event\n<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]: Skipping because of failed dependencies\n<13>Dec 22 09:35:56 puppet-user: Notice: Applied catalog in 2.08 seconds\n<13>Dec 22 09:35:56 puppet-user: Application:\n<13>Dec 22 09:35:56 puppet-user: Initial environment: production\n<13>Dec 22 09:35:56 puppet-user: Converged environment: production\n<13>Dec 22 09:35:56 puppet-user: Run mode: user\n<13>Dec 22 09:35:56 puppet-user: Changes:\n<13>Dec 22 09:35:56 puppet-user: Total: 6\n<13>Dec 22 09:35:56 puppet-user: Events:\n<13>Dec 22 09:35:56 puppet-user: Failure: 1\n<13>Dec 22 09:35:56 puppet-user: Success: 6\n<13>Dec 22 09:35:56 puppet-user: Total: 7\n<13>Dec 22 09:35:56 puppet-user: Resources:\n<13>Dec 22 09:35:56 puppet-user: Failed: 1\n<13>Dec 22 09:35:56 puppet-user: Skipped: 12\n<13>Dec 22 09:35:56 puppet-user: Restarted: 2\n<13>Dec 22 09:35:56 puppet-user: Changed: 6\n<13>Dec 22 09:35:56 puppet-user: Out of sync: 7\n<13>Dec 22 09:35:56 puppet-user: Total: 31\n<13>Dec 22 09:35:56 puppet-user: Time:\n<13>Dec 22 09:35:56 puppet-user: Filebucket: 0.00\n<13>Dec 22 09:35:56 puppet-user: Schedule: 0.00\n<13>Dec 22 09:35:56 puppet-user: File: 0.03\n<13>Dec 22 09:35:56 puppet-user: Augeas: 0.05\n<13>Dec 22 09:35:56 puppet-user: Exec: 0.43\n<13>Dec 22 09:35:56 puppet-user: Package: 0.65\n<13>Dec 22 09:35:56 puppet-user: Config retrieval: 0.77\n<13>Dec 22 09:35:56 puppet-user: Last run: 1640165756\n<13>Dec 22 09:35:56 puppet-user: Transaction evaluation: 2.07\n<13>Dec 22 09:35:56 puppet-user: Catalog application: 2.08\n<13>Dec 22 09:35:56 puppet-user: Total: 2.08\n<13>Dec 22 09:35:56 puppet-user: Version:\n<13>Dec 22 09:35:56 puppet-user: Config: 1640165754\n<13>Dec 22 09:35:56 puppet-user: Puppet: 7.10.0", "stderr_lines": ["<13>Dec 22 09:35:48 puppet-user: Error: Facter: error while resolving custom facts in /usr/share/openstack-puppet/modules/kmod/lib/facter/kmod.rb: expected argument to be a String, Symbol, or Hash", "<13>Dec 22 09:35:54 puppet-user: Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5", "<13>Dec 22 09:35:54 puppet-user: (file: /etc/puppet/hiera.yaml)", "<13>Dec 22 09:35:54 puppet-user: Warning: Undefined variable '::deploy_config_name'; ", "<13>Dec 22 09:35:54 puppet-user: (file & line not available)", "<13>Dec 22 09:35:54 puppet-user: Warning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.10/deprecated_language.html", "<13>Dec 22 09:35:54 puppet-user: (file & line not available)", "<13>Dec 22 09:35:54 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/profile/base/database/mysql/client.pp, line: 89, column: 8)", "<13>Dec 22 09:35:54 puppet-user: error: Could not connect to controller: Connection refused", "<13>Dec 22 09:35:54 puppet-user: Warning: Unknown variable: '::deployment_type'. (file: /etc/puppet/modules/tripleo/manifests/packages.pp, line: 39, column: 69)", "<13>Dec 22 09:35:54 puppet-user: Notice: Compiled catalog for overcloud-controller-0.localdomain in environment production in 0.68 seconds", "<13>Dec 22 09:35:54 puppet-user: Notice: /Stage[main]/Tripleo::Profile::Base::Database::Mysql::Client/File[/etc/my.cnf.d/tripleo.cnf]/ensure: created", "<13>Dec 22 09:35:54 puppet-user: Notice: /Stage[main]/Tripleo::Profile::Base::Database::Mysql::Client/Augeas[tripleo-mysql-client-conf]/returns: executed successfully", "<13>Dec 22 09:35:55 puppet-user: Error: Execution of '/bin/dnf -d 0 -e 1 -y install fence-agents-all' returned 1: Error: Unable to find a match: fence-agents-all", "<13>Dec 22 09:35:55 puppet-user: Error: /Stage[main]/Pacemaker::Install/Package[fence-agents-all]/ensure: change from 'purged' to 'present' failed: Execution of '/bin/dnf -d 0 -e 1 -y install fence-agents-all' returned 1: Error: Unable to find a match: fence-agents-all", "<13>Dec 22 09:35:55 puppet-user: Notice: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_debug_ini]: Dependency Package[fence-agents-all] has failures: true", "<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_debug_ini]: Skipping because of failed dependencies", "<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/File_line[pcsd_bind_addr]: Skipping because of failed dependencies", "<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/User[hacluster]: Skipping because of failed dependencies", "<13>Dec 22 09:35:55 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[pcsd]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[reauthenticate-across-all-nodes]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[auth-successful-across-all-nodes]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[Create Cluster tripleo_cluster]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[Start Cluster tripleo_cluster]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[corosync]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Service/Service[pacemaker]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Corosync/Exec[wait-for-settle]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[overcloud-ca]/File[/etc/pki/ca-trust/source/anchors/overcloud-ca.pem]/ensure: defined content as '{sha256}696ab523a4a032b3df87e9ebde539ba48edd4f717b6a45a2261ad58c8aa329bc'", "<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[overcloud-ca]/Exec[trust-ca-overcloud-ca]: Triggered 'refresh' from 1 event", "<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[undercloud-ca]/File[/etc/pki/ca-trust/source/anchors/undercloud-ca.pem]/ensure: defined content as '{sha256}6cf91ce1b7ef27144b1c87f71ecf12f22141afd04ba0eea8260d811d6a1aa268'", "<13>Dec 22 09:35:56 puppet-user: Notice: /Stage[main]/Tripleo::Trusted_cas/Tripleo::Trusted_ca[undercloud-ca]/Exec[trust-ca-undercloud-ca]: Triggered 'refresh' from 1 event", "<13>Dec 22 09:35:56 puppet-user: Warning: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]: Skipping because of failed dependencies", "<13>Dec 22 09:35:56 puppet-user: Notice: Applied catalog in 2.08 seconds", "<13>Dec 22 09:35:56 puppet-user: Application:", "<13>Dec 22 09:35:56 puppet-user: Initial environment: production", "<13>Dec 22 09:35:56 puppet-user: Converged environment: production", "<13>Dec 22 09:35:56 puppet-user: Run mode: user", "<13>Dec 22 09:35:56 puppet-user: Changes:", "<13>Dec 22 09:35:56 puppet-user: Total: 6", "<13>Dec 22 09:35:56 puppet-user: Events:", "<13>Dec 22 09:35:56 puppet-user: Failure: 1", "<13>Dec 22 09:35:56 puppet-user: Success: 6", "<13>Dec 22 09:35:56 puppet-user: Total: 7", "<13>Dec 22 09:35:56 puppet-user: Resources:", "<13>Dec 22 09:35:56 puppet-user: Failed: 1", "<13>Dec 22 09:35:56 puppet-user: Skipped: 12", "<13>Dec 22 09:35:56 puppet-user: Restarted: 2", "<13>Dec 22 09:35:56 puppet-user: Changed: 6", "<13>Dec 22 09:35:56 puppet-user: Out of sync: 7", "<13>Dec 22 09:35:56 puppet-user: Total: 31", "<13>Dec 22 09:35:56 puppet-user: Time:", "<13>Dec 22 09:35:56 puppet-user: Filebucket: 0.00", "<13>Dec 22 09:35:56 puppet-user: Schedule: 0.00", "<13>Dec 22 09:35:56 puppet-user: File: 0.03", "<13>Dec 22 09:35:56 puppet-user: Augeas: 0.05", "<13>Dec 22 09:35:56 puppet-user: Exec: 0.43", "<13>Dec 22 09:35:56 puppet-user: Package: 0.65", "<13>Dec 22 09:35:56 puppet-user: Config retrieval: 0.77", "<13>Dec 22 09:35:56 puppet-user: Last run: 1640165756", "<13>Dec 22 09:35:56 puppet-user: Transaction evaluation: 2.07", "<13>Dec 22 09:35:56 puppet-user: Catalog application: 2.08", "<13>Dec 22 09:35:56 puppet-user: Total: 2.08", "<13>Dec 22 09:35:56 puppet-user: Version:", "<13>Dec 22 09:35:56 puppet-user: Config: 1640165754", "<13>Dec 22 09:35:56 puppet-user: Puppet: 7.10.0"], "stdout": "", "stdout_lines": []}
2021-12-22 04:35:58 | 2021-12-22 04:35:58.790151 | fa163ed0-f418-6d83-c4a0-000000002616 | TIMING | Wait for puppet host configuration to finish | overcloud-controller-0 | 0:14:09.631118 | 10.14s
```

I think 818184: Only install required/supported fence agents | https://review.opendev.org/c/openstack/tripleo-puppet-elements/+/818184 caused the issue.

We need to make similar change in https://codesearch.openstack.org/?q=fence-agents-all&i=nope&literal=nope&files=&excludeFiles=&repos=

Logs:
[1.] https://logserver.rdoproject.org/13/36713/17/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/e85b70a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

Tags: