2021-01-15 11:36:09 |
Ponnuvel Palaniyappan |
bug |
|
|
added bug |
2021-01-15 11:36:22 |
Ponnuvel Palaniyappan |
description |
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
We need to backport upstream bug [0] to Octopus. It's been fixed in upstream
master branch.
Upstream backport is in progress [1]. Once that's merged, this needs to be
SRU'ed to Octopus.
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337 |
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
We need to backport upstream bug [0] to Octopus. It's been fixed in upstream master branch.
Upstream backport is in progress [1]. Once that's merged, this needs to be
SRU'ed to Octopus.
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337 |
|
2021-01-16 01:58:38 |
Ponnuvel Palaniyappan |
tags |
|
seg sts |
|
2021-01-25 13:56:24 |
Ponnuvel Palaniyappan |
cloud-archive: status |
New |
In Progress |
|
2021-01-25 20:12:17 |
Ponnuvel Palaniyappan |
summary |
Active scrub blocks upmap balancer |
[SRU] Active scrub blocks upmap balancer |
|
2021-01-25 20:12:28 |
Ponnuvel Palaniyappan |
description |
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
We need to backport upstream bug [0] to Octopus. It's been fixed in upstream master branch.
Upstream backport is in progress [1]. Once that's merged, this needs to be
SRU'ed to Octopus.
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337 |
[Impact]
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
in the logs.
Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done.
This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1].
[Test Case]
In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects.
Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus).
Perform some I/O so that data goes to the rest of the OSDs.
Then start deep-scrubbing and re-add the previously taken down so balancing start to happen.
[Regression potential]
Low potential. This is a bug fix of a previously correct code.
If anything goes wrong, the balancer module might not function properly and thus
leaving the cluster unbalanced and potentially requiring manual balancing.
[Other Info]
It's been accepted upstream and backported to Octopus. Ref [0] and [1].
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337 |
|
2021-01-25 20:24:31 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu) |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Focal |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Focal) |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Groovy |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Groovy) |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Hirsute |
|
2021-01-25 20:26:01 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Hirsute) |
|
2021-01-25 20:45:57 |
Ponnuvel Palaniyappan |
bug task deleted |
ceph (Ubuntu Hirsute) |
|
|
2021-01-25 20:46:09 |
Ponnuvel Palaniyappan |
bug task deleted |
ceph (Ubuntu Groovy) |
|
|
2021-01-25 20:46:15 |
Ponnuvel Palaniyappan |
bug task deleted |
ceph (Ubuntu Focal) |
|
|
2021-01-25 20:48:06 |
Ponnuvel Palaniyappan |
affects |
ceph (Ubuntu) |
focal (Ubuntu) |
|
2021-01-25 20:48:32 |
Ponnuvel Palaniyappan |
affects |
focal (Ubuntu) |
ceph (Ubuntu) |
|
2021-01-25 21:01:36 |
Ponnuvel Palaniyappan |
nominated for series |
|
cloud-archive/ussuri |
|
2021-01-25 21:01:36 |
Ponnuvel Palaniyappan |
bug task added |
|
cloud-archive/ussuri |
|
2021-01-26 09:17:09 |
Edward Hope-Morley |
tags |
seg sts |
seg sts sts-sru-needed |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Focal |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Focal) |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Hirsute |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Hirsute) |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Groovy |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Groovy) |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
nominated for series |
|
Ubuntu Bionic |
|
2021-01-26 16:48:55 |
Ponnuvel Palaniyappan |
bug task added |
|
ceph (Ubuntu Bionic) |
|
2021-01-29 17:14:39 |
Ponnuvel Palaniyappan |
cloud-archive: importance |
Undecided |
Medium |
|
2021-01-29 17:14:41 |
Ponnuvel Palaniyappan |
cloud-archive/ussuri: importance |
Undecided |
Medium |
|
2021-01-29 17:14:43 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Bionic): importance |
Undecided |
Medium |
|
2021-01-29 17:14:44 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Focal): importance |
Undecided |
Medium |
|
2021-01-29 17:14:47 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Groovy): importance |
Undecided |
Medium |
|
2021-01-29 17:14:49 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Hirsute): importance |
Undecided |
Medium |
|
2021-02-01 13:56:18 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Bionic): status |
New |
In Progress |
|
2021-02-01 13:57:07 |
Ponnuvel Palaniyappan |
attachment added |
|
focal-octopus.debdiff https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5458789/+files/focal-octopus.debdiff |
|
2021-02-01 16:29:16 |
Ubuntu Foundations Team Bug Bot |
tags |
seg sts sts-sru-needed |
patch seg sts sts-sru-needed |
|
2021-02-01 16:29:25 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
2021-02-01 16:54:54 |
Corey Bryant |
description |
[Impact]
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
in the logs.
Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done.
This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1].
[Test Case]
In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects.
Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus).
Perform some I/O so that data goes to the rest of the OSDs.
Then start deep-scrubbing and re-add the previously taken down so balancing start to happen.
[Regression potential]
Low potential. This is a bug fix of a previously correct code.
If anything goes wrong, the balancer module might not function properly and thus
leaving the cluster unbalanced and potentially requiring manual balancing.
[Other Info]
It's been accepted upstream and backported to Octopus. Ref [0] and [1].
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337 |
[Impact]
When scrubs are in progress, balancer stop due to the bug [0]. And shows:
<timestamp> calc_pg_upmaps abort due to max <= 0
in the logs.
Typically when deep-scrub is done in maintenance windows and can take few hours. If balancing is paused for the duration, it can affect client I/O performance later when balacing starts happening after deep-scrub is done.
This bug was introduced in Octopus. We need to backport upstream bug [0] to just Octopus. It's been fixed in upstream master branch [1].
[Test Case]
In an Octopus Ceph cluster that has some data (large enough to be able to notice balancing), take down one or more OSDs to introduce "unbalanced" objects.
Make sure Ceph balancer module is enabled and active (which should be the default case in Octopus).
Perform some I/O so that data goes to the rest of the OSDs.
Then start deep-scrubbing and re-add the previously taken down so balancing start to happen.
[Regression potential]
Low potential. This is a bug fix of a previously correct code.
If anything goes wrong, the balancer module might not function properly and thus
leaving the cluster unbalanced and potentially requiring manual balancing.
[Other Info]
It's been accepted upstream and backported to Octopus. Ref [0] and [1].
[0] https://tracker.ceph.com/issues/48309
[1] https://github.com/ceph/ceph/pull/38337
For Hirsute, James is working on a snapshot of Pacific and that should include the fix for this. |
|
2021-02-01 16:55:03 |
Corey Bryant |
ceph (Ubuntu Hirsute): status |
New |
Triaged |
|
2021-02-01 16:55:06 |
Corey Bryant |
ceph (Ubuntu Groovy): status |
New |
Triaged |
|
2021-02-01 16:55:09 |
Corey Bryant |
ceph (Ubuntu Focal): status |
New |
Triaged |
|
2021-02-01 16:55:40 |
Corey Bryant |
cloud-archive/ussuri: status |
New |
Triaged |
|
2021-02-01 16:55:50 |
Corey Bryant |
cloud-archive: status |
In Progress |
Invalid |
|
2021-02-01 17:17:39 |
Ponnuvel Palaniyappan |
attachment added |
|
new-focal-octopus.debdiff https://bugs.launchpad.net/cloud-archive/+bug/1911900/+attachment/5458823/+files/new-focal-octopus.debdiff |
|
2021-02-04 16:17:25 |
Chris MacNaughton |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
2021-02-08 10:50:47 |
Łukasz Zemczak |
ceph (Ubuntu Groovy): status |
Triaged |
Fix Committed |
|
2021-02-08 10:50:52 |
Łukasz Zemczak |
bug |
|
|
added subscriber SRU Verification |
2021-02-08 10:50:55 |
Łukasz Zemczak |
tags |
patch seg sts sts-sru-needed |
patch seg sts sts-sru-needed verification-needed verification-needed-groovy |
|
2021-02-08 10:51:30 |
Łukasz Zemczak |
removed subscriber Ubuntu Sponsors Team |
|
|
|
2021-02-08 10:52:43 |
Łukasz Zemczak |
ceph (Ubuntu Focal): status |
Triaged |
Fix Committed |
|
2021-02-08 10:52:47 |
Łukasz Zemczak |
tags |
patch seg sts sts-sru-needed verification-needed verification-needed-groovy |
patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy |
|
2021-02-12 07:16:08 |
Chris MacNaughton |
cloud-archive/ussuri: status |
Triaged |
Fix Committed |
|
2021-02-12 07:16:09 |
Chris MacNaughton |
tags |
patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy |
patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy verification-ussuri-needed |
|
2021-02-22 23:01:33 |
Ponnuvel Palaniyappan |
attachment added |
|
sru_focal_ceph15.2.8.txt https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5466037/+files/sru_focal_ceph15.2.8.txt |
|
2021-02-22 23:01:52 |
Ponnuvel Palaniyappan |
tags |
patch seg sts sts-sru-needed verification-needed verification-needed-focal verification-needed-groovy verification-ussuri-needed |
patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-needed |
|
2021-02-22 23:59:10 |
Ponnuvel Palaniyappan |
attachment added |
|
sru_ceph15.2.8_ussuri.txt https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5466042/+files/sru_ceph15.2.8_ussuri.txt |
|
2021-02-22 23:59:49 |
Ponnuvel Palaniyappan |
tags |
patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-needed |
patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-done |
|
2021-02-23 19:28:25 |
Corey Bryant |
ceph (Ubuntu Hirsute): status |
Triaged |
Fix Released |
|
2021-02-23 20:28:37 |
Ponnuvel Palaniyappan |
attachment added |
|
sru_groovy.txt https://bugs.launchpad.net/cloud-archive/+bug/1911900/+attachment/5466340/+files/sru_groovy.txt |
|
2021-02-23 20:28:53 |
Ponnuvel Palaniyappan |
tags |
patch seg sts sts-sru-needed verification-done-focal verification-needed verification-needed-groovy verification-ussuri-done |
patch seg sts sts-sru-needed verification-done-focal verification-done-groovy verification-needed verification-ussuri-done |
|
2021-02-23 20:29:02 |
Ponnuvel Palaniyappan |
tags |
patch seg sts sts-sru-needed verification-done-focal verification-done-groovy verification-needed verification-ussuri-done |
patch seg sts sts-sru-needed verification-done verification-done-focal verification-done-groovy verification-ussuri-done |
|
2021-03-01 10:48:45 |
Launchpad Janitor |
ceph (Ubuntu Groovy): status |
Fix Committed |
Fix Released |
|
2021-03-01 10:49:01 |
Łukasz Zemczak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
2021-03-01 11:03:21 |
Launchpad Janitor |
ceph (Ubuntu Focal): status |
Fix Committed |
Fix Released |
|
2021-03-01 12:55:48 |
Chris MacNaughton |
cloud-archive/ussuri: status |
Fix Committed |
Fix Released |
|
2021-04-12 14:01:34 |
Edward Hope-Morley |
ceph (Ubuntu Bionic): status |
In Progress |
New |
|
2021-04-12 14:01:42 |
Edward Hope-Morley |
cloud-archive: assignee |
Ponnuvel Palaniyappan (pponnuvel) |
|
|
2021-04-12 14:41:11 |
Ponnuvel Palaniyappan |
ceph (Ubuntu Bionic): status |
New |
Invalid |
|