Activity log for bug #1911900

Date Who What changed Old value New value Message
2021-01-15 11:36:09 Ponnuvel Palaniyappan bug added bug
2021-01-15 11:36:22 Ponnuvel Palaniyappan description When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 We need to backport upstream bug [0] to Octopus. It's been fixed in upstream master branch. Upstream backport is in progress [1]. Once that's merged, this needs to be SRU'ed to Octopus. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337 When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 We need to backport upstream bug [0] to Octopus. It's been fixed in upstream master branch. Upstream backport is in progress [1]. Once that's merged, this needs to be SRU'ed to Octopus. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337
2021-01-16 01:58:38 Ponnuvel Palaniyappan tags seg sts
2021-01-25 13:56:24 Ponnuvel Palaniyappan cloud-archive: status New In Progress
2021-01-25 20:12:17 Ponnuvel Palaniyappan summary Active scrub blocks upmap balancer [SRU] Active scrub blocks upmap balancer
2021-01-25 20:12:28 Ponnuvel Palaniyappan description When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 We need to backport upstream bug [0] to Octopus. It's been fixed in upstream master branch. Upstream backport is in progress [1]. Once that's merged, this needs to be SRU'ed to Octopus. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337 [Impact] When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 in the logs. Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done. This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1]. [Test Case] In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects. Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus). Perform some I/O so that data goes to the rest of the OSDs. Then start deep-scrubbing and re-add the previously taken down so balancing start to happen. [Regression potential] Low potential. This is a bug fix of a previously correct code. If anything goes wrong, the balancer module might not function properly and thus leaving the cluster unbalanced and potentially requiring manual balancing. [Other Info] It's been accepted upstream and backported to Octopus. Ref [0] and [1]. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337
2021-01-25 20:24:31 Ponnuvel Palaniyappan bug task added ceph (Ubuntu)
2021-01-25 20:26:01 Ponnuvel Palaniyappan nominated for series Ubuntu Focal
2021-01-25 20:26:01 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Focal)
2021-01-25 20:26:01 Ponnuvel Palaniyappan nominated for series Ubuntu Groovy
2021-01-25 20:26:01 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Groovy)
2021-01-25 20:26:01 Ponnuvel Palaniyappan nominated for series Ubuntu Hirsute
2021-01-25 20:26:01 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Hirsute)
2021-01-25 20:45:57 Ponnuvel Palaniyappan bug task deleted ceph (Ubuntu Hirsute)
2021-01-25 20:46:09 Ponnuvel Palaniyappan bug task deleted ceph (Ubuntu Groovy)
2021-01-25 20:46:15 Ponnuvel Palaniyappan bug task deleted ceph (Ubuntu Focal)
2021-01-25 20:48:06 Ponnuvel Palaniyappan affects ceph (Ubuntu) focal (Ubuntu)
2021-01-25 20:48:32 Ponnuvel Palaniyappan affects focal (Ubuntu) ceph (Ubuntu)
2021-01-25 21:01:36 Ponnuvel Palaniyappan nominated for series cloud-archive/ussuri
2021-01-25 21:01:36 Ponnuvel Palaniyappan bug task added cloud-archive/ussuri
2021-01-26 09:17:09 Edward Hope-Morley tags seg sts seg sts sts-sru-needed
2021-01-26 16:48:55 Ponnuvel Palaniyappan nominated for series Ubuntu Focal
2021-01-26 16:48:55 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Focal)
2021-01-26 16:48:55 Ponnuvel Palaniyappan nominated for series Ubuntu Hirsute
2021-01-26 16:48:55 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Hirsute)
2021-01-26 16:48:55 Ponnuvel Palaniyappan nominated for series Ubuntu Groovy
2021-01-26 16:48:55 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Groovy)
2021-01-26 16:48:55 Ponnuvel Palaniyappan nominated for series Ubuntu Bionic
2021-01-26 16:48:55 Ponnuvel Palaniyappan bug task added ceph (Ubuntu Bionic)
2021-01-29 17:14:39 Ponnuvel Palaniyappan cloud-archive: importance Undecided Medium
2021-01-29 17:14:41 Ponnuvel Palaniyappan cloud-archive/ussuri: importance Undecided Medium
2021-01-29 17:14:43 Ponnuvel Palaniyappan ceph (Ubuntu Bionic): importance Undecided Medium
2021-01-29 17:14:44 Ponnuvel Palaniyappan ceph (Ubuntu Focal): importance Undecided Medium
2021-01-29 17:14:47 Ponnuvel Palaniyappan ceph (Ubuntu Groovy): importance Undecided Medium
2021-01-29 17:14:49 Ponnuvel Palaniyappan ceph (Ubuntu Hirsute): importance Undecided Medium
2021-02-01 13:56:18 Ponnuvel Palaniyappan ceph (Ubuntu Bionic): status New In Progress
2021-02-01 13:57:07 Ponnuvel Palaniyappan attachment added focal-octopus.debdiff https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5458789/+files/focal-octopus.debdiff
2021-02-01 16:29:16 Ubuntu Foundations Team Bug Bot tags seg sts sts-sru-needed patch seg sts sts-sru-needed
2021-02-01 16:29:25 Ubuntu Foundations Team Bug Bot bug added subscriber Ubuntu Sponsors Team
2021-02-01 16:54:54 Corey Bryant description [Impact] When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 in the logs. Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done. This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1]. [Test Case] In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects. Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus). Perform some I/O so that data goes to the rest of the OSDs. Then start deep-scrubbing and re-add the previously taken down so balancing start to happen. [Regression potential] Low potential. This is a bug fix of a previously correct code. If anything goes wrong, the balancer module might not function properly and thus leaving the cluster unbalanced and potentially requiring manual balancing. [Other Info] It's been accepted upstream and backported to Octopus. Ref [0] and [1]. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337 [Impact] When scrubs are in progress, balancer stop due to the bug [0]. And shows: <timestamp> calc_pg_upmaps abort due to max <= 0 in the logs. Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done. This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1]. [Test Case] In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects. Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus). Perform some I/O so that data goes to the rest of the OSDs. Then start deep-scrubbing and re-add the previously taken down so balancing start to happen. [Regression potential] Low potential. This is a bug fix of a previously correct code. If anything goes wrong, the balancer module might not function properly and thus leaving the cluster unbalanced and potentially requiring manual balancing. [Other Info] It's been accepted upstream and backported to Octopus. Ref [0] and [1]. [0] https://tracker.ceph.com/issues/48309 [1] https://github.com/ceph/ceph/pull/38337 For Hirsute, James is working on a snapshot of Pacific and that should include the fix for this.
2021-02-01 16:55:03 Corey Bryant ceph (Ubuntu Hirsute): status New Triaged
2021-02-01 16:55:06 Corey Bryant ceph (Ubuntu Groovy): status New Triaged
2021-02-01 16:55:09 Corey Bryant ceph (Ubuntu Focal): status New Triaged
2021-02-01 16:55:40 Corey Bryant cloud-archive/ussuri: status New Triaged
2021-02-01 16:55:50 Corey Bryant cloud-archive: status In Progress Invalid
2021-02-01 17:17:39 Ponnuvel Palaniyappan attachment added new-focal-octopus.debdiff https://bugs.launchpad.net/cloud-archive/+bug/1911900/+attachment/5458823/+files/new-focal-octopus.debdiff
2021-02-04 16:17:25 Chris MacNaughton bug added subscriber Ubuntu Stable Release Updates Team
2021-02-08 10:50:47 Łukasz Zemczak ceph (Ubuntu Groovy): status Triaged Fix Committed
2021-02-08 10:50:52 Łukasz Zemczak bug added subscriber SRU Verification
2021-02-08 10:50:55 Łukasz Zemczak tags patch seg sts sts-sru-needed patch seg sts sts-sru-needed verification-needed verification-needed-groovy
2021-02-08 10:51:30 Łukasz Zemczak removed subscriber Ubuntu Sponsors Team
2021-02-08 10:52:43 Łukasz Zemczak ceph (Ubuntu Focal): status Triaged Fix Committed
2021-02-08 10:52:47 Łukasz Zemczak tags patch seg sts sts-sru-needed verification-needed verification-needed-groovy patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy
2021-02-12 07:16:08 Chris MacNaughton cloud-archive/ussuri: status Triaged Fix Committed
2021-02-12 07:16:09 Chris MacNaughton tags patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy verification-ussuri-needed
2021-02-22 23:01:33 Ponnuvel Palaniyappan attachment added sru_focal_ceph15.2.8.txt https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5466037/+files/sru_focal_ceph15.2.8.txt
2021-02-22 23:01:52 Ponnuvel Palaniyappan tags patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy verification-ussuri-needed patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-needed
2021-02-22 23:59:10 Ponnuvel Palaniyappan attachment added sru_ceph15.2.8_ussuri.txt https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5466042/+files/sru_ceph15.2.8_ussuri.txt
2021-02-22 23:59:49 Ponnuvel Palaniyappan tags patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-needed patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-done
2021-02-23 19:28:25 Corey Bryant ceph (Ubuntu Hirsute): status Triaged Fix Released
2021-02-23 20:28:37 Ponnuvel Palaniyappan attachment added sru_groovy.txt https://bugs.launchpad.net/cloud-archive/+bug/1911900/+attachment/5466340/+files/sru_groovy.txt
2021-02-23 20:28:53 Ponnuvel Palaniyappan tags patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-done patch seg sts sts-sru-needed verification-done-focal verification-done-groovy verification-needed verification-ussuri-done
2021-02-23 20:29:02 Ponnuvel Palaniyappan tags patch seg sts sts-sru-needed verification-done-focal verification-done-groovy verification-needed verification-ussuri-done patch seg sts sts-sru-needed verification-done verification-done-focal verification-done-groovy verification-ussuri-done
2021-03-01 10:48:45 Launchpad Janitor ceph (Ubuntu Groovy): status Fix Committed Fix Released
2021-03-01 10:49:01 Łukasz Zemczak removed subscriber Ubuntu Stable Release Updates Team
2021-03-01 11:03:21 Launchpad Janitor ceph (Ubuntu Focal): status Fix Committed Fix Released
2021-03-01 12:55:48 Chris MacNaughton cloud-archive/ussuri: status Fix Committed Fix Released
2021-04-12 14:01:34 Edward Hope-Morley ceph (Ubuntu Bionic): status In Progress New
2021-04-12 14:01:42 Edward Hope-Morley cloud-archive: assignee Ponnuvel Palaniyappan (pponnuvel)
2021-04-12 14:41:11 Ponnuvel Palaniyappan ceph (Ubuntu Bionic): status New Invalid