| 2020-03-21 08:23:30 |
dongdong tao |
bug |
|
|
added bug |
| 2020-03-21 08:23:51 |
dongdong tao |
ceph (Ubuntu): assignee |
|
dongdong tao (taodd) |
|
| 2020-03-24 12:04:47 |
James Page |
summary |
backport the multipart fix to luminous |
rgw: unable to abort multipart upload after the bucket got resharded |
|
| 2020-03-24 12:05:43 |
James Page |
nominated for series |
|
Ubuntu Bionic |
|
| 2020-03-24 12:05:43 |
James Page |
bug task added |
|
ceph (Ubuntu Bionic) |
|
| 2020-03-24 12:05:51 |
James Page |
ceph (Ubuntu): status |
New |
Fix Released |
|
| 2020-03-24 12:05:55 |
James Page |
ceph (Ubuntu Bionic): status |
New |
Triaged |
|
| 2020-03-24 12:05:58 |
James Page |
ceph (Ubuntu Bionic): importance |
Undecided |
High |
|
| 2020-07-07 02:35:45 |
dongdong tao |
description |
There is a bug during the resharding for those multipart entries.
For all the multipart entries, the hash source should be the object name so that all those entries can still be
distributed to one same bucket index shard object.
Right now the code just calculate the shard id based on each entry's name, which is wrong
This can cause the bucket not able to abort the multipart upload and leave the stale multiple entries behind.
The fix is already merged into the mimic and nautilus. but upstream didn't backport it to luminous
fix is here https://github.com/ceph/ceph/pull/32617
upstream bug report: https://tracker.ceph.com/issues/43583 |
[Impact]
This bug will cause the bucket not able to abort the multipart upload and leaving the stale multiple entries behind for those buckets which had partial multipart uploads before the resharding.
[Test Case]
Deploy a latest luminous(12.2.13) ceph cluter
Create a bucket
upload a big file (200M+) to that bucket
Press "Ctrl + C" after several part (each part is 15M) had been uploaded
Manually reshard the bucket to 4 shards
Abort the multipart uploading
Without the fix, you will not able to abort the previous uploading
[Regression Potential]
Low - this fix has been accept upstream in later releases since from Mimic.
[Original Bug Report]
There is a bug during the resharding for those multipart entries.
For all the multipart entries, the hash source should be the object name so that all those entries can still be
distributed to one same bucket index shard object.
Right now the code just calculate the shard id based on each entry's name, which is wrong
This can cause the bucket not able to abort the multipart upload and leave the stale multiple entries behind.
https://tracker.ceph.com/issues/43583 |
|
| 2020-07-07 02:38:44 |
dongdong tao |
attachment added |
|
bionic.debdiff https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1868364/+attachment/5390343/+files/bionic.debdiff |
|
| 2020-07-07 02:43:10 |
dongdong tao |
tags |
|
sts sts-sru-needed |
|
| 2020-07-07 08:30:22 |
Edward Hope-Morley |
bug task added |
|
cloud-archive |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/train |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/train |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/stein |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/stein |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/queens |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/queens |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/rocky |
|
| 2020-07-20 13:37:28 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/rocky |
|
| 2020-07-20 13:37:36 |
Edward Hope-Morley |
cloud-archive/train: status |
New |
Fix Released |
|
| 2020-07-21 08:32:51 |
Edward Hope-Morley |
cloud-archive/stein: status |
New |
Fix Released |
|
| 2020-07-23 07:39:20 |
James Page |
cloud-archive/rocky: status |
New |
Won't Fix |
|
| 2020-08-11 12:47:14 |
dongdong tao |
description |
[Impact]
This bug will cause the bucket not able to abort the multipart upload and leaving the stale multiple entries behind for those buckets which had partial multipart uploads before the resharding.
[Test Case]
Deploy a latest luminous(12.2.13) ceph cluter
Create a bucket
upload a big file (200M+) to that bucket
Press "Ctrl + C" after several part (each part is 15M) had been uploaded
Manually reshard the bucket to 4 shards
Abort the multipart uploading
Without the fix, you will not able to abort the previous uploading
[Regression Potential]
Low - this fix has been accept upstream in later releases since from Mimic.
[Original Bug Report]
There is a bug during the resharding for those multipart entries.
For all the multipart entries, the hash source should be the object name so that all those entries can still be
distributed to one same bucket index shard object.
Right now the code just calculate the shard id based on each entry's name, which is wrong
This can cause the bucket not able to abort the multipart upload and leave the stale multiple entries behind.
https://tracker.ceph.com/issues/43583 |
[Impact]
This bug will cause the bucket not able to abort the multipart upload and leaving the stale multiple entries behind for those buckets which had partial multipart uploads before the resharding.
[Test Case]
Deploy a latest luminous(12.2.13) ceph cluter
Create a bucket
upload a big file (200M+) to that bucket
Press "Ctrl + C" after several part (each part is 15M) had been uploaded
Manually reshard the bucket to 4 shards
Abort the multipart uploading
Without the fix, you will not able to abort the previous uploading
[Regression Potential]
Low - this fix has been accept upstream in later releases since from Mimic, but it there is a super large multipart uploads, all the multi-entry will now be correctly mapped to the expected shard, which will cause this shard contain more omap entries than before, which might some slow when listing the shard
[Original Bug Report]
There is a bug during the resharding for those multipart entries.
For all the multipart entries, the hash source should be the object name so that all those entries can still be
distributed to one same bucket index shard object.
Right now the code just calculate the shard id based on each entry's name, which is wrong
This can cause the bucket not able to abort the multipart upload and leave the stale multiple entries behind.
https://tracker.ceph.com/issues/43583 |
|
| 2020-08-12 01:44:34 |
dongdong tao |
attachment added |
|
bug1868364.patch https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1868364/+attachment/5400889/+files/bug1868364.patch |
|
| 2020-08-13 12:37:36 |
Corey Bryant |
cloud-archive/queens: status |
New |
Triaged |
|
| 2020-08-13 12:37:37 |
Corey Bryant |
cloud-archive/queens: importance |
Undecided |
High |
|
| 2020-08-13 12:37:42 |
Corey Bryant |
cloud-archive: status |
New |
Invalid |
|
| 2020-08-13 12:37:57 |
Corey Bryant |
cloud-archive: status |
Invalid |
Fix Released |
|
| 2020-08-13 12:39:20 |
Corey Bryant |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2020-08-13 12:39:29 |
Corey Bryant |
summary |
rgw: unable to abort multipart upload after the bucket got resharded |
[SRU] rgw: unable to abort multipart upload after the bucket got resharded |
|
| 2020-08-19 14:10:28 |
Robie Basak |
ceph (Ubuntu Bionic): status |
Triaged |
Fix Committed |
|
| 2020-08-19 14:10:30 |
Robie Basak |
bug |
|
|
added subscriber SRU Verification |
| 2020-08-19 14:10:33 |
Robie Basak |
tags |
sts sts-sru-needed |
sts sts-sru-needed verification-needed verification-needed-bionic |
|
| 2020-08-20 15:28:35 |
Corey Bryant |
cloud-archive/queens: status |
Triaged |
Fix Committed |
|
| 2020-08-20 15:28:36 |
Corey Bryant |
tags |
sts sts-sru-needed verification-needed verification-needed-bionic |
sts sts-sru-needed verification-needed verification-needed-bionic verification-queens-needed |
|
| 2020-08-21 09:20:40 |
dongdong tao |
tags |
sts sts-sru-needed verification-needed verification-needed-bionic verification-queens-needed |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-needed |
|
| 2020-08-21 09:22:04 |
dongdong tao |
tags |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-needed |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-done |
|
| 2020-08-21 09:27:22 |
dongdong tao |
tags |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-done |
sts sts-sru-needed verification-bionic-done verification-needed verification-queens-done |
|
| 2020-08-26 07:06:54 |
dongdong tao |
tags |
sts sts-sru-needed verification-bionic-done verification-needed verification-queens-done |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-done |
|
| 2020-08-31 01:28:47 |
Mathew Hodson |
tags |
sts sts-sru-needed verification-bionic-done verification-done verification-queens-done |
sts sts-sru-needed verification-done verification-done-bionic verification-queens-done |
|
| 2020-09-03 13:14:41 |
Łukasz Zemczak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2020-09-03 13:14:39 |
Launchpad Janitor |
ceph (Ubuntu Bionic): status |
Fix Committed |
Fix Released |
|
| 2020-09-03 18:53:51 |
Corey Bryant |
cloud-archive/queens: status |
Fix Committed |
Fix Released |
|
