SolQA saw this on 2 juju 3.1.6 candidate runs over the weekend.
testrun 1: https://solutions.qa.canonical.com/testruns/1639761c-78bf-40fc-9941-c0d154fb0ff8 crashdump 1: https://oil-jenkins.canonical.com/artifacts/1639761c-78bf-40fc-9941-c0d154fb0ff8/generated/generated/openstack/juju-crashdump-openstack-2023-10-01-18.33.41.tar.gz testrun 2: https://solutions.qa.canonical.com/testruns/ef1a6e6e-cf3e-40ce-a07e-46cad78300c7 crashdump 2: https://oil-jenkins.canonical.com/artifacts/ef1a6e6e-cf3e-40ce-a07e-46cad78300c7/generated/generated/openstack/juju-crashdump-openstack-2023-10-02-00.11.13.tar.gz
Error logs 2023-10-01 15:29:37 DEBUG unit.rabbitmq-server/2.juju-log server.go:325 Not updating clients: leader node is ready:False, client node is ready:False 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 Traceback (most recent call last): 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/install.real", line 1243, in <module> 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 rabbit.assess_status(rabbit.ConfigRenderer(rabbit.CONFIG_FILES())) 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/rabbit_utils.py", line 210, in __init__ 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 ctxt.update(svc_context()) 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/rabbitmq_context.py", line 146, in __call__ 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 ssl_mode, external_ca = ssl_utils.get_ssl_mode() 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/ssl_utils.py", line 64, in get_ssl_mode 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 relation_certs = get_relation_cert_data() 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/ssl_utils.py", line 59, in get_relation_cert_data 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 _, hostname = get_unit_amqp_endpoint_data() 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/hooks/ssl_utils.py", line 47, in get_unit_amqp_endpoint_data 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 ip = get_relation_ip( 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/charmhelpers/contrib/network/ip.py", line 571, in get_relation_ip 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 address = network_get_primary_address(interface) 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/charmhelpers/core/hookenv.py", line 1180, in inner_translate_exc2 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 return f(*args, **kwargs) 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/var/lib/juju/agents/unit-rabbitmq-server-2/charm/charmhelpers/core/hookenv.py", line 1374, in network_get_primary_address 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 response = subprocess.check_output( 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/usr/lib/python3.10/subprocess.py", line 421, in check_output 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 File "/usr/lib/python3.10/subprocess.py", line 526, in run 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 raise CalledProcessError(retcode, process.args, 2023-10-01 15:29:37 WARNING unit.rabbitmq-server/2.install logger.go:60 subprocess.CalledProcessError: Command '['network-get', '--primary-address', 'amqp']' returned non-zero exit status 1. 2023-10-01 15:29:37 ERROR juju.worker.uniter.operation runhook.go:180 hook "install" (via explicit, bespoke hook script) failed: exit status 1
SolQA saw this on 2 juju 3.1.6 candidate runs over the weekend.
testrun 1: https:/ /solutions. qa.canonical. com/testruns/ 1639761c- 78bf-40fc- 9941-c0d154fb0f f8 /oil-jenkins. canonical. com/artifacts/ 1639761c- 78bf-40fc- 9941-c0d154fb0f f8/generated/ generated/ openstack/ juju-crashdump- openstack- 2023-10- 01-18.33. 41.tar. gz /solutions. qa.canonical. com/testruns/ ef1a6e6e- cf3e-40ce- a07e-46cad78300 c7 /oil-jenkins. canonical. com/artifacts/ ef1a6e6e- cf3e-40ce- a07e-46cad78300 c7/generated/ generated/ openstack/ juju-crashdump- openstack- 2023-10- 02-00.11. 13.tar. gz
crashdump 1: https:/
testrun 2: https:/
crashdump 2: https:/
Error logs server/ 2.juju- log server.go:325 Not updating clients: leader node is ready:False, client node is ready:False server/ 2.install logger.go:60 Traceback (most recent call last): server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/install. real", line 1243, in <module> server/ 2.install logger.go:60 rabbit. assess_ status( rabbit. ConfigRenderer( rabbit. CONFIG_ FILES() )) server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/rabbit_ utils.py" , line 210, in __init__ server/ 2.install logger.go:60 ctxt.update( svc_context( )) server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/rabbitmq_ context. py", line 146, in __call__ server/ 2.install logger.go:60 ssl_mode, external_ca = ssl_utils. get_ssl_ mode() server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/ssl_ utils.py" , line 64, in get_ssl_mode server/ 2.install logger.go:60 relation_certs = get_relation_ cert_data( ) server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/ssl_ utils.py" , line 59, in get_relation_ cert_data server/ 2.install logger.go:60 _, hostname = get_unit_ amqp_endpoint_ data() server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ hooks/ssl_ utils.py" , line 47, in get_unit_ amqp_endpoint_ data server/ 2.install logger.go:60 ip = get_relation_ip( server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ charmhelpers/ contrib/ network/ ip.py", line 571, in get_relation_ip server/ 2.install logger.go:60 address = network_ get_primary_ address( interface) server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ charmhelpers/ core/hookenv. py", line 1180, in inner_translate _exc2 server/ 2.install logger.go:60 return f(*args, **kwargs) server/ 2.install logger.go:60 File "/var/lib/ juju/agents/ unit-rabbitmq- server- 2/charm/ charmhelpers/ core/hookenv. py", line 1374, in network_ get_primary_ address server/ 2.install logger.go:60 response = subprocess. check_output( server/ 2.install logger.go:60 File "/usr/lib/ python3. 10/subprocess. py", line 421, in check_output server/ 2.install logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, server/ 2.install logger.go:60 File "/usr/lib/ python3. 10/subprocess. py", line 526, in run server/ 2.install logger.go:60 raise CalledProcessEr ror(retcode, process.args, server/ 2.install logger.go:60 subprocess. CalledProcessEr ror: Command '['network-get', '--primary- address' , 'amqp']' returned non-zero exit status 1. uniter. operation runhook.go:180 hook "install" (via explicit, bespoke hook script) failed: exit status 1
2023-10-01 15:29:37 DEBUG unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 WARNING unit.rabbitmq-
2023-10-01 15:29:37 ERROR juju.worker.