From rabbitmq logs:
2023-09-22T18:47:44.446Z [rabbitmq] 2023-09-22 18:47:44.446579+00:00 [info] <0.228.0> Will try to lock with peer discovery backend rabbit_peer_discovery_k8s[0m 2023-09-22T18:47:44.447Z [rabbitmq] [38;5;214m2023-09-22 18:47:44.447602+00:00 [warning] <0.489.0> Description: "Authenticity is not established by certificate path validation"[0m 2023-09-22T18:47:44.447Z [rabbitmq] [38;5;214m2023-09-22 18:47:44.447602+00:00 [warning] <0.489.0> Reason: "Option {verify, verify_peer} and cacertfile/cacerts is missing"[0m 2023-09-22T18:47:44.447Z [rabbitmq] [38;5;214m2023-09-22 18:47:44.447602+00:00 [warning] <0.489.0> [0m 2023-09-22T18:47:48.451Z [rabbitmq] [38;5;160m2023-09-22 18:47:48.451012+00:00 [error] <0.228.0> Failed to fetch a list of nodes from Kubernetes API: {failed_connect,[{to_address,{"kubernetes.default.svc.cluster.local",443}},[0m 2023-09-22T18:47:48.451Z [rabbitmq] [38;5;160m2023-09-22 18:47:48.451012+00:00 [error] <0.228.0> {inet,[inet],timeout}]}[0m 2023-09-22T18:47:48.452Z [rabbitmq] [38;5;214m2023-09-22 18:47:48.452228+00:00 [warning] <0.491.0> Description: "Authenticity is not established by certificate path validation"[0m 2023-09-22T18:47:48.452Z [rabbitmq] [38;5;214m2023-09-22 18:47:48.452228+00:00 [warning] <0.491.0> Reason: "Option {verify, verify_peer} and cacertfile/cacerts is missing"[0m 2023-09-22T18:47:48.452Z [rabbitmq] [38;5;214m2023-09-22 18:47:48.452228+00:00 [warning] <0.491.0> [0m 2023-09-22T18:47:52.454Z [rabbitmq] [38;5;160m2023-09-22 18:47:52.454747+00:00 [error] <0.228.0> Failed to lock with peer discovery backend rabbit_peer_discovery_k8s: "{failed_connect,[{to_address,{\"kubernetes.default.svc.cluster.local\",443}},\n {inet,[inet],timeout}]}"[0m
Looks like the certificate verification for the K8S API endpoint used for discovery of peers failed.
From rabbitmq logs:
2023-09- 22T18:47: 44.446Z [rabbitmq] 2023-09-22 18:47:44. 446579+ 00:00 [info] <0.228.0> Will try to lock with peer discovery backend rabbit_ peer_discovery_ k8s[0m 22T18:47: 44.447Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:44. 447602+ 00:00 [warning] <0.489.0> Description: "Authenticity is not established by certificate path validation"[0m 22T18:47: 44.447Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:44. 447602+ 00:00 [warning] <0.489.0> Reason: "Option {verify, verify_peer} and cacertfile/cacerts is missing"[0m 22T18:47: 44.447Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:44. 447602+ 00:00 [warning] <0.489.0> [0m 22T18:47: 48.451Z [rabbitmq] [38;5; 160m2023- 09-22 18:47:48. 451012+ 00:00 [error] <0.228.0> Failed to fetch a list of nodes from Kubernetes API: {failed_ connect, [{to_address, {"kubernetes. default. svc.cluster. local", 443}}, [0m 22T18:47: 48.451Z [rabbitmq] [38;5; 160m2023- 09-22 18:47:48. 451012+ 00:00 [error] <0.228.0> {inet,[ inet],timeout} ]}[0m 22T18:47: 48.452Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:48. 452228+ 00:00 [warning] <0.491.0> Description: "Authenticity is not established by certificate path validation"[0m 22T18:47: 48.452Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:48. 452228+ 00:00 [warning] <0.491.0> Reason: "Option {verify, verify_peer} and cacertfile/cacerts is missing"[0m 22T18:47: 48.452Z [rabbitmq] [38;5; 214m2023- 09-22 18:47:48. 452228+ 00:00 [warning] <0.491.0> [0m 22T18:47: 52.454Z [rabbitmq] [38;5; 160m2023- 09-22 18:47:52. 454747+ 00:00 [error] <0.228.0> Failed to lock with peer discovery backend rabbit_ peer_discovery_ k8s: "{failed_ connect, [{to_address, {\"kubernetes. default. svc.cluster. local\" ,443}}, \n {inet,[ inet],timeout} ]}"[0m
2023-09-
2023-09-
2023-09-
2023-09-
2023-09-
2023-09-
2023-09-
2023-09-
2023-09-
Looks like the certificate verification for the K8S API endpoint used for discovery of peers failed.