ceph mgr not start on ha clustered ceph mon

Bug #1832596 reported by Luis Felipe Domínguez Vega
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceph Monitor Charm
Invalid
Undecided
Unassigned
ceph (Ubuntu)
Expired
Undecided
Unassigned

Bug Description

I'm using Ceph Mon charm #38 with hacluster and vip, when i execute 'ceph status' show:

```
    health: HEALTH_WARN
            no active mgr
```

with `journalctl -u ceph-mgr@<server_name>` show:

```
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: terminate called after throwing an instance of 'std::runtime_error'
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: what(): value type is 1 not 0
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: *** Caught signal (Aborted) **
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: in thread 7ff5bca61700 thread_name:fn_anonymous
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable)
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 1: (()+0x256d40) [0x55c64227ad40]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 2: (()+0x12890) [0x7ff5c7f8a890]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 3: (gsignal()+0xc7) [0x7ff5c7082e97]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 4: (abort()+0x141) [0x7ff5c7084801]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 5: (()+0x8c957) [0x7ff5c7a77957]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 6: (()+0x92ab6) [0x7ff5c7a7dab6]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 7: (()+0x92af1) [0x7ff5c7a7daf1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 8: (()+0x92d24) [0x7ff5c7a7dd24]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 9: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::alloc
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 10: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allo
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 11: (MetadataUpdate::finish(int)+0x451) [0x55c6421999d1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 12: (Context::complete(int)+0x9) [0x55c64213acb9]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 13: (Finisher::finisher_thread_entry()+0x12e) [0x7ff5c8d1e65e]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 14: (()+0x76db) [0x7ff5c7f7f6db]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 15: (clone()+0x3f) [0x7ff5c716588f]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 2019-06-12 13:10:13.567 7ff5bca61700 -1 *** Caught signal (Aborted) **
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: in thread 7ff5bca61700 thread_name:fn_anonymous
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable)
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 1: (()+0x256d40) [0x55c64227ad40]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 2: (()+0x12890) [0x7ff5c7f8a890]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 3: (gsignal()+0xc7) [0x7ff5c7082e97]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 4: (abort()+0x141) [0x7ff5c7084801]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 5: (()+0x8c957) [0x7ff5c7a77957]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 6: (()+0x92ab6) [0x7ff5c7a7dab6]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 7: (()+0x92af1) [0x7ff5c7a7daf1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 8: (()+0x92d24) [0x7ff5c7a7dd24]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 9: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::alloc
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 10: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allo
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 11: (MetadataUpdate::finish(int)+0x451) [0x55c6421999d1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 12: (Context::complete(int)+0x9) [0x55c64213acb9]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 13: (Finisher::finisher_thread_entry()+0x12e) [0x7ff5c8d1e65e]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 14: (()+0x76db) [0x7ff5c7f7f6db]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 15: (clone()+0x3f) [0x7ff5c716588f]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 0> 2019-06-12 13:10:13.567 7ff5bca61700 -1 *** Caught signal (Aborted) **
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: in thread 7ff5bca61700 thread_name:fn_anonymous
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable)
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 1: (()+0x256d40) [0x55c64227ad40]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 2: (()+0x12890) [0x7ff5c7f8a890]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 3: (gsignal()+0xc7) [0x7ff5c7082e97]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 4: (abort()+0x141) [0x7ff5c7084801]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 5: (()+0x8c957) [0x7ff5c7a77957]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 6: (()+0x92ab6) [0x7ff5c7a7dab6]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 7: (()+0x92af1) [0x7ff5c7a7daf1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 8: (()+0x92d24) [0x7ff5c7a7dd24]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 9: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::alloc
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 10: (json_spirit::Value_impl<json_spirit::Config_map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allo
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 11: (MetadataUpdate::finish(int)+0x451) [0x55c6421999d1]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 12: (Context::complete(int)+0x9) [0x55c64213acb9]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 13: (Finisher::finisher_thread_entry()+0x12e) [0x7ff5c8d1e65e]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 14: (()+0x76db) [0x7ff5c7f7f6db]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: 15: (clone()+0x3f) [0x7ff5c716588f]
Jun 12 13:10:13 vital-shark ceph-mgr[1842381]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Jun 12 13:10:13 vital-shark systemd[1]: <email address hidden>: Main process exited, code=killed, status=6/ABRT
Jun 12 13:10:13 vital-shark systemd[1]: <email address hidden>: Failed with result 'signal'.
Jun 12 13:10:23 vital-shark systemd[1]: <email address hidden>: Service hold-off time over, scheduling restart.
Jun 12 13:10:23 vital-shark systemd[1]: <email address hidden>: Scheduled restart job, restart counter is at 3.
```

Tags: ceph ceph-mgr ha
Revision history for this message
Luis Felipe Domínguez Vega (luis.dominguez) wrote :

    what(): value type is 1 not 0

That message from the JSON Spirit library indicate that is expected a NULL, but found a OBJECT, so i don't known where is.... something with configuration??? but is from vanilla deploy of ceph

Revision history for this message
Luis Felipe Domínguez Vega (luis.dominguez) wrote :

well, now i deploy another unit to a LXD (the others are on same metal machine than ceph-osd) and ceph-mgr is running

Revision history for this message
James Page (james-page) wrote :

Moving bug task to ceph package (as this is unlikely to be a charm issue).

Please can you provide details on which version of the ceph packages you are using.

Changed in charm-ceph-mon:
status: New → Invalid
Changed in ceph (Ubuntu):
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for ceph (Ubuntu) because there has been no activity for 60 days.]

Changed in ceph (Ubuntu):
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.