corosync upgrade on 2018-01-02 caused pacemaker to fail
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack HA Cluster Charm |
Invalid
|
Undecided
|
Unassigned | ||
corosync (Debian) |
Fix Released
|
Unknown
|
|||
corosync (Ubuntu) |
Fix Released
|
Medium
|
Nish Aravamudan | ||
Trusty |
Won't Fix
|
Medium
|
Nish Aravamudan | ||
Xenial |
Fix Released
|
High
|
Eric Desrochers | ||
Artful |
Fix Released
|
High
|
Eric Desrochers | ||
Bionic |
Fix Released
|
Medium
|
Nish Aravamudan | ||
pacemaker (Ubuntu) |
Fix Released
|
Medium
|
Nish Aravamudan | ||
Trusty |
Won't Fix
|
Medium
|
Nish Aravamudan | ||
Xenial |
Fix Released
|
High
|
Eric Desrochers | ||
Artful |
Fix Released
|
High
|
Eric Desrochers |
Bug Description
[Impact]
When corosync and pacemaker are both installed, a corosync upgrade caused pacemaker to fail. pacemaker will need to be restarted manually to work again, it won't recover by itself.
[Test Case]
1) Have corosync (< 2.3.5-3ubuntu2) and pacemaker (< 1.1.14-2ubuntu1.3) installed
2) Make sure corosync & pacemaker are running via systemctl status cmd.
3) Upgrade corosync
4) Look corosync and pacemaker via systemctl status cmd again.
You will notice pacemaker is dead (inactive) and doesn't recover, unless a systemctl start pacemaker is done manually.
[Regression Potential]
Regression potential is low, it doesn't change corosync/pacemaker core functionality. This patch make sure thing goes smoother at the packaging level during a corosync upgrade where pacemaker is installed/involved.
This can also be useful in particular in situation where the system has "unattended-
For the symbol tag change in Artful to (optional), please refer yourself to comment #60 from slangasek.
For the asctime change in Artful, please refer yourself to comment #51 & comment #52.
Note that both Artful changes in pacemaker above are only necessary for the package to build (even as-is without this patch). They aren't a requirement for the patch the work, but for the src pkg to build.
[Other Info]
XENIAL Merge-proposal:
https:/
https:/
[Original Description]
During upgrades on 2018-01-02, corosync and it's libs were upgraded:
(from a trusty/mitaka cloud)
Upgrade: libcmap4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), corosync:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcfg6:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcpg4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libquorum5:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcorosync-
During this process, it appears that pacemaker service is restarted and it errors:
syslog:Jan 2 16:09:33 juju-machine-
syslog:Jan 2 16:09:34 juju-machine-
syslog:Jan 2 16:14:32 juju-machine-
syslog:Jan 2 16:14:32 juju-machine-
syslog:Jan 2 16:14:32 juju-machine-
syslog:Jan 2 16:14:32 juju-machine-
syslog:Jan 2 16:14:32 juju-machine-
Also affected xenial/ocata
Related branches
- Canonical Server: Pending requested
-
Diff: 29024 lines (+28165/-0) (has conflicts)51 files modifiedChangeLog (+4/-0)
attrd/commands.c (+1207/-0)
configure.ac (+71/-0)
crmd/crmd_metadata.c (+272/-0)
crmd/crmd_metadata.h (+58/-0)
crmd/lrm.c (+2593/-0)
debian/changelog (+22/-0)
debian/control (+4/-0)
debian/libcrmcommon3.symbols (+390/-0)
debian/pacemaker.postinst (+12/-0)
debian/pacemaker.preinst (+16/-0)
debian/patches/CVE-2018-1687x-1.patch (+185/-0)
debian/patches/CVE-2018-1687x-2.patch (+484/-0)
debian/patches/CVE-2018-1687x-3.patch (+609/-0)
debian/patches/CVE-2018-1687x-4.patch (+708/-0)
debian/patches/CVE-2018-1687x-5.patch (+425/-0)
debian/patches/CVE-2018-1687x-6.patch (+63/-0)
debian/patches/CVE-2019-3885.patch (+132/-0)
debian/patches/lp1866119-Fix-attrd-ensure-node-name-is-broadcast.patch (+117/-0)
debian/patches/lp1866119-Fix-crmd-avoid-double-free.patch (+28/-0)
debian/patches/lp1866119-Fix-pengine-unfence-before-probing.patch (+108/-0)
debian/patches/lp1866119-Refactor-pengine-functionize.patch (+81/-0)
debian/patches/pacemaker_is_partof_corosync.patch (+24/-0)
debian/patches/portability-define-EKEYREJECTED-if-necessary.patch (+24/-0)
debian/patches/series (+19/-0)
doc/Pacemaker_Explained/en-US/Ch-Advanced-Resources.txt (+3/-0)
doc/Pacemaker_Explained/en-US/Ch-Stonith.txt (+956/-0)
extra/resources/ifspeed (+544/-0)
fencing/remote.c (+2122/-0)
include/crm/pengine/internal.h (+4/-0)
include/crm/pengine/status.h (+302/-0)
lib/common/strings.c (+4/-0)
lib/pengine/clone.c (+8/-0)
lib/pengine/container.c (+1459/-0)
lib/pengine/native.c (+26/-0)
lib/pengine/utils.c (+9/-0)
lrmd/main.c (+639/-0)
lrmd/pacemaker_remote.service.in (+41/-0)
lrmd/test.c (+615/-0)
mcp/pacemaker.service.in (+83/-0)
pengine/allocate.c (+2557/-0)
pengine/constraints.c (+2916/-0)
pengine/container.c (+974/-0)
pengine/native.c (+3431/-0)
tools/crm_mon.c (+2218/-0)
tools/crm_resource.c (+177/-0)
tools/crm_resource.h (+23/-0)
tools/crm_resource_print.c (+23/-0)
tools/crm_resource_runtime.c (+118/-0)
tools/regression.sh (+815/-0)
tools/regression.validity.exp (+442/-0)
summary: |
- corosync upgrade on 2018-01-02 caused pacemaker daemon restart to fail + corosync upgrade on 2018-01-02 caused pacemaker to fail |
Changed in charm-hacluster: | |
status: | New → Invalid |
Changed in corosync (Ubuntu): | |
assignee: | nobody → Nish Aravamudan (nacc) |
Changed in corosync (Ubuntu): | |
status: | New → Incomplete |
tags: | added: regression-update |
tags: | added: sts |
Changed in corosync (Ubuntu): | |
assignee: | Eric Desrochers (slashd) → Victor Tapia (vtapia) |
no longer affects: | pacemaker (Ubuntu) |
Changed in corosync (Ubuntu Bionic): | |
assignee: | Victor Tapia (vtapia) → Eric Desrochers (slashd) |
Changed in corosync (Ubuntu Artful): | |
assignee: | nobody → Eric Desrochers (slashd) |
no longer affects: | pacemaker (Ubuntu Trusty) |
no longer affects: | pacemaker (Ubuntu Xenial) |
no longer affects: | pacemaker (Ubuntu Zesty) |
no longer affects: | pacemaker (Ubuntu Artful) |
no longer affects: | pacemaker (Ubuntu Bionic) |
Changed in corosync (Ubuntu Zesty): | |
assignee: | nobody → Eric Desrochers (slashd) |
Changed in corosync (Ubuntu Xenial): | |
assignee: | nobody → Eric Desrochers (slashd) |
Changed in corosync (Ubuntu Trusty): | |
assignee: | nobody → Victor Tapia (vtapia) |
Changed in corosync (Ubuntu Bionic): | |
importance: | Undecided → Medium |
Changed in corosync (Ubuntu Artful): | |
importance: | Undecided → Medium |
Changed in corosync (Ubuntu Zesty): | |
importance: | Undecided → Medium |
Changed in corosync (Ubuntu Xenial): | |
importance: | Undecided → Medium |
Changed in corosync (Ubuntu Trusty): | |
importance: | Undecided → Medium |
Changed in corosync (Ubuntu Bionic): | |
assignee: | Eric Desrochers (slashd) → Nish Aravamudan (nacc) |
no longer affects: | corosync (Ubuntu Zesty) |
tags: | removed: regression-update |
Changed in corosync (Debian): | |
status: | Unknown → New |
Changed in corosync (Ubuntu Artful): | |
assignee: | Eric Desrochers (slashd) → Nish Aravamudan (nacc) |
Changed in corosync (Ubuntu Xenial): | |
assignee: | Eric Desrochers (slashd) → Nish Aravamudan (nacc) |
Changed in corosync (Ubuntu Trusty): | |
assignee: | Victor Tapia (vtapia) → Nish Aravamudan (nacc) |
tags: | added: id-5a53cc961fb7361dbac726f8 |
Changed in pacemaker (Ubuntu): | |
status: | New → In Progress |
status: | In Progress → Fix Released |
assignee: | nobody → Nish Aravamudan (nacc) |
importance: | Undecided → Medium |
no longer affects: | corosync (Ubuntu Artful) |
no longer affects: | corosync (Ubuntu Xenial) |
no longer affects: | corosync (Ubuntu Trusty) |
Changed in corosync (Ubuntu Trusty): | |
assignee: | nobody → Eric Desrochers (slashd) |
importance: | Undecided → Medium |
status: | New → Won't Fix |
assignee: | Eric Desrochers (slashd) → Nish Aravamudan (nacc) |
Changed in pacemaker (Ubuntu Trusty): | |
assignee: | nobody → Nish Aravamudan (nacc) |
importance: | Undecided → Medium |
status: | New → Won't Fix |
Changed in corosync (Ubuntu Xenial): | |
assignee: | nobody → Eric Desrochers (slashd) |
importance: | Undecided → High |
status: | New → In Progress |
Changed in corosync (Ubuntu Artful): | |
assignee: | nobody → Eric Desrochers (slashd) |
importance: | Undecided → High |
status: | New → In Progress |
Changed in pacemaker (Ubuntu Xenial): | |
assignee: | nobody → Eric Desrochers (slashd) |
importance: | Undecided → High |
status: | New → In Progress |
Changed in pacemaker (Ubuntu Artful): | |
assignee: | nobody → Eric Desrochers (slashd) |
importance: | Undecided → High |
status: | New → In Progress |
description: | updated |
description: | updated |
description: | updated |
description: | updated |
tags: |
added: verification-done-xenial removed: verification-needed-xenial |
Changed in corosync (Debian): | |
status: | New → Fix Released |
more log context:
https:/ /pastebin. ubuntu. com/26307592/