Activity log for bug #1850846

Date Who What changed Old value New value Message
2019-10-31 18:58:10 Zachary Zehring bug added bug
2019-10-31 18:59:06 Zachary Zehring description There appears to be a race condition between libvirt and the ceilometer-agent-compute service. We had an environment where all the agent services were not reporting instance metrics for ceilometer. We found that all the ceilometer-agent-compute services had the following error status: ceilometer-agent-compute[2706]: libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock-ro': No such file or directory Some things of note: - all /var/log/ceilometer/ceilometer-agent-compute.log files were empty - the service was in "active (running)" - ceilometer-agent charm is on latest version - virsh/libvirtd is on 5.0.0 A ceilometer-agent-compute service restart fixed the issue and enabled instance metric gathering. There appears to be a race condition between libvirt and the ceilometer-agent-compute service. We had an environment where all the agent services were not reporting instance metrics for ceilometer. We found that all the ceilometer-agent-compute services had the following error status: ceilometer-agent-compute[2706]: libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock-ro': No such file or directory Some things of note: - all /var/log/ceilometer/ceilometer-agent-compute.log files were empty - the service was in "active (running)" - ceilometer-agent charm is on latest version - virsh/libvirtd is on 5.0.0 A ceilometer-agent-compute service restart fixed the issue and enabled instance metric gathering. It may be beneficial to put a check to ensure ceilometer-agent-compute service is not only running but functioning as expected.
2019-11-01 10:11:48 Alex Kavanagh charm-ceilometer-agent: status New Incomplete
2020-01-01 04:17:30 Launchpad Janitor charm-ceilometer-agent: status Incomplete Expired