Comment 13 for bug 2023668

Revision history for this message
Boris Lukashev (rageltman) wrote (last edit ):

@VO LE HUY: yup, all sorts of services - designate, nova, cinder. Verified that they have proper authentication set and see them logging in as `openstack` successfully, immediately followed by the crash:
```
2023-06-22 05:12:31.897517+00:00 [info] <0.84962.0> accepting AMQP connection <0.84962.0> (10.0.2.10:44912 -> 10.0.2.12:5672)
2023-06-22 05:12:31.898704+00:00 [info] <0.84962.0> Connection <0.84962.0> (10.0.2.10:44912 -> 10.0.2.12:5672) has a client-provided name: designate-central:29677:f5298188-4683-45ba-b265-733af7c30123
2023-06-22 05:12:31.899375+00:00 [info] <0.84962.0> connection <0.84962.0> (10.0.2.10:44912 -> 10.0.2.12:5672 - designate-central:29677:f5298188-4683-45ba-b265-733af7c30123): user 'openstack' authenticated and granted access to vhost '/'
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> crasher:
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> initial call: rabbit_reader:init/3
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> pid: <0.84962.0>
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> registered_name: []
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> exception exit: {unexpected_message,{'EXIT',#Port<0.8188>,einval}}
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> in function rabbit_reader:handle_other/2 (rabbit_reader.erl, line 641)
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> in call from rabbit_reader:mainloop/4 (rabbit_reader.erl, line 532)
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> in call from rabbit_reader:run/1 (rabbit_reader.erl, line 454)
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> in call from rabbit_reader:start_connection/4 (rabbit_reader.erl, line 353)
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> ancestors: [<0.84960.0>,<0.53806.0>,<0.53805.0>,<0.53804.0>,<0.53802.0>,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> <0.53801.0>,rabbit_sup,<0.53325.0>]
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> message_queue_len: 0
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> messages: []
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> links: [<0.84960.0>]
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> dictionary: [{process_name,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {rabbit_reader,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> <<"10.0.2.10:44912 -> 10.0.2.12:5672 - designate-central:29677:f5298188-4683-45ba-b265-733af7c30123">>}},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {connection_user_provided_name,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> <<"designate-central:29677:f5298188-4683-45ba-b265-733af7c30123">>},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {client_properties,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> [{<<"product">>,longstr,<<"py-amqp">>},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<<"product_version">>,longstr,<<"5.0.9">>},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<<"capabilities">>,table,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> [{<<"authentication_failure_close">>,bool,true},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<<"connection.blocked">>,bool,true},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<<"consumer_cancel_notify">>,bool,true}]},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<<"connection_name">>,longstr,
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> <<"designate-central:29677:f5298188-4683-45ba-b265-733af7c30123">>}]},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {{ch_pid,<0.84971.0>},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {1,#Ref<0.576209348.2143027202.53448>}},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {{channel,1},
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> {<0.84971.0>,{method,rabbit_framing_amqp_0_9_1}}}]
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> trap_exit: true
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> status: running
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> heap_size: 4185
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> stack_size: 28
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> reductions: 12103
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0> neighbours:
2023-06-22 05:12:31.900039+00:00 [error] <0.84962.0>
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> supervisor: {<0.84960.0>,rabbit_connection_sup}
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> errorContext: child_terminated
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> reason: {unexpected_message,{'EXIT',#Port<0.8188>,einval}}
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> offender: [{pid,<0.84962.0>},
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {id,reader},
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {mfargs,{rabbit_reader,start_link,
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> [<0.84961.0>,
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {acceptor,{10.0.2,12},5672}]}},
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {restart_type,intrinsic},
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {shutdown,300000},
2023-06-22 05:12:31.900663+00:00 [error] <0.84960.0> {child_type,worker}]
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> supervisor: {<0.84960.0>,rabbit_connection_sup}
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> errorContext: shutdown
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> reason: reached_max_restart_intensity
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> offender: [{pid,<0.84962.0>},
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {id,reader},
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {mfargs,{rabbit_reader,start_link,
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> [<0.84961.0>,
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {acceptor,{10.0.2,12},5672}]}},
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {restart_type,intrinsic},
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {shutdown,300000},
2023-06-22 05:12:31.900831+00:00 [error] <0.84960.0> {child_type,worker}]
```

Any chance the OpenSSL version changed in the container?
 https://stackoverflow.com/questions/57165818/crypto-server-exception-exit-einval-erlang-open-port-spawn-crypto-drv-e