Activity log for bug #424671

Date Who What changed Old value New value Message
2009-09-05 04:19:54 Bryce Harrington bug added bug
2009-09-05 04:20:42 Bryce Harrington attachment added test_attachments.py http://launchpadlibrarian.net/31332453/test_attachments.py
2009-10-20 18:42:01 Gary Poster launchpadlib: status New Triaged
2009-10-20 18:42:05 Gary Poster launchpadlib: importance Undecided High
2009-10-20 18:42:14 Gary Poster launchpadlib: assignee Leonard Richardson (leonardr)
2010-01-06 17:40:03 Leonard Richardson affects launchpadlib launchpad-foundations
2010-01-06 17:40:17 Leonard Richardson tags api
2010-07-19 08:12:22 Martin Pool bug added subscriber Martin Pool
2010-07-20 15:01:01 Gary Poster tags api api performance
2010-07-22 03:43:15 Robert Collins tags api performance api performance timeout
2010-07-22 03:46:37 Robert Collins description [Problem] Performance processing attachments when referencing the message object really slows things down [Discussion] I love launchpadlib and use it a LOT for helping me get my work done on X.org. X.org bugs are really all about file attachments - crash dumps, log files, config files, yada yada. Pretty much every launchpadlib script I write deals with attachments in some way. However, if you want to get the name of the uploader of the attachment, or when it was uploaded, this causes scripts to run a LOT slower. For interactive scripts this can result in it taking over a minute to load the bug. Even for non-interactive scripts this delay really reduces their usefulness. I would like to see launchpadlib provide better optimized access to these details. Attached is a test script I've used to do some performance measurements when different data is requested on a bug's attachments. \time -f "%E" ./test_attachments.py Results ====== 0. Just titles: 5.18 sec 1. do_a: 12.58 2. do_message: 42.33 3. do_a + do_message: 51.38 4. do_fb: 11.68 5. do_a + do_fb: 17.95 6. do_a + do_fb + do_message: 1:14.90 7. do_content: 11.84 8. do_a + do_content: 24.87 9. do_a + do_fb + do_content: 25.59 10. do_a + do_fb + do_message + do_content: 1:08.76 As you can see, it's faster to get all the files content (including printing contents to the screen!) than to print only the owner/date_created/subject of the file, by like an order of magnitude Something feels wrong - I would expect the difference between #1 and #3 to be on the order of maybe 4 sec max, not 40 sec. In this example bug, there is only a single message on the bug, compared with like 20 attachments, so you would expect #3 to be faster than #8, not take twice as long. [Problem] Performance processing attachments when referencing the message object really slows things down https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1662A100 [Discussion] I love launchpadlib and use it a LOT for helping me get my work done on X.org. X.org bugs are really all about file attachments - crash dumps, log files, config files, yada yada. Pretty much every launchpadlib script I write deals with attachments in some way. However, if you want to get the name of the uploader of the attachment, or when it was uploaded, this causes scripts to run a LOT slower. For interactive scripts this can result in it taking over a minute to load the bug. Even for non-interactive scripts this delay really reduces their usefulness. I would like to see launchpadlib provide better optimized access to these details. Attached is a test script I've used to do some performance measurements when different data is requested on a bug's attachments. \time -f "%E" ./test_attachments.py Results ====== 0. Just titles: 5.18 sec 1. do_a: 12.58 2. do_message: 42.33 3. do_a + do_message: 51.38 4. do_fb: 11.68 5. do_a + do_fb: 17.95 6. do_a + do_fb + do_message: 1:14.90 7. do_content: 11.84 8. do_a + do_content: 24.87 9. do_a + do_fb + do_content: 25.59 10. do_a + do_fb + do_message + do_content: 1:08.76 As you can see, it's faster to get all the files content (including printing contents to the screen!) than to print only the owner/date_created/subject of the file, by like an order of magnitude Something feels wrong - I would expect the difference between #1 and #3 to be on the order of maybe 4 sec max, not 40 sec. In this example bug, there is only a single message on the bug, compared with like 20 attachments, so you would expect #3 to be faster than #8, not take twice as long.
2010-07-22 04:12:48 Robert Collins description [Problem] Performance processing attachments when referencing the message object really slows things down https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1662A100 [Discussion] I love launchpadlib and use it a LOT for helping me get my work done on X.org. X.org bugs are really all about file attachments - crash dumps, log files, config files, yada yada. Pretty much every launchpadlib script I write deals with attachments in some way. However, if you want to get the name of the uploader of the attachment, or when it was uploaded, this causes scripts to run a LOT slower. For interactive scripts this can result in it taking over a minute to load the bug. Even for non-interactive scripts this delay really reduces their usefulness. I would like to see launchpadlib provide better optimized access to these details. Attached is a test script I've used to do some performance measurements when different data is requested on a bug's attachments. \time -f "%E" ./test_attachments.py Results ====== 0. Just titles: 5.18 sec 1. do_a: 12.58 2. do_message: 42.33 3. do_a + do_message: 51.38 4. do_fb: 11.68 5. do_a + do_fb: 17.95 6. do_a + do_fb + do_message: 1:14.90 7. do_content: 11.84 8. do_a + do_content: 24.87 9. do_a + do_fb + do_content: 25.59 10. do_a + do_fb + do_message + do_content: 1:08.76 As you can see, it's faster to get all the files content (including printing contents to the screen!) than to print only the owner/date_created/subject of the file, by like an order of magnitude Something feels wrong - I would expect the difference between #1 and #3 to be on the order of maybe 4 sec max, not 40 sec. In this example bug, there is only a single message on the bug, compared with like 20 attachments, so you would expect #3 to be faster than #8, not take twice as long. [Problem] Performance processing attachments when referencing the message object really slows things down https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1662A100 [Discussion] I love launchpadlib and use it a LOT for helping me get my work done on X.org. X.org bugs are really all about file attachments - crash dumps, log files, config files, yada yada. Pretty much every launchpadlib script I write deals with attachments in some way. However, if you want to get the name of the uploader of the attachment, or when it was uploaded, this causes scripts to run a LOT slower. For interactive scripts this can result in it taking over a minute to load the bug. Even for non-interactive scripts this delay really reduces their usefulness. I would like to see launchpadlib provide better optimized access to these details. Attached is a test script I've used to do some performance measurements when different data is requested on a bug's attachments. \time -f "%E" ./test_attachments.py Results ====== 0. Just titles: 5.18 sec 1. do_a: 12.58 2. do_message: 42.33 3. do_a + do_message: 51.38 4. do_fb: 11.68 5. do_a + do_fb: 17.95 6. do_a + do_fb + do_message: 1:14.90 7. do_content: 11.84 8. do_a + do_content: 24.87 9. do_a + do_fb + do_content: 25.59 10. do_a + do_fb + do_message + do_content: 1:08.76 As you can see, it's faster to get all the files content (including printing contents to the screen!) than to print only the owner/date_created/subject of the file, by like an order of magnitude Something feels wrong - I would expect the difference between #1 and #3 to be on the order of maybe 4 sec max, not 40 sec. In this example bug, there is only a single message on the bug, compared with like 20 attachments, so you would expect #3 to be faster than #8, not take twice as long. Fixes we need to CP from devel ======================== revno: 11156 [merge] committer: Launchpad Patch Queue Manager <launchpad@pqm.canonical.com> branch nick: launchpad timestamp: Mon 2010-07-19 18:32:16 +0100 message: [r=lifeless][ui=none][bug=606914] Bug.initial_message has been changed to no longer materialise every message on a Bug before returning the first one.
2010-09-09 22:24:35 Bryce Harrington attachment added output.txt https://bugs.edge.launchpad.net/launchpad-foundations/+bug/424671/+attachment/1563282/+files/output.txt
2010-09-19 05:48:46 Robert Collins tags api performance timeout api performance
2011-03-10 06:18:19 Bryce Harrington attachment added test_attachments.py https://bugs.launchpad.net/launchpad/+bug/424671/+attachment/1898058/+files/test_attachments.py
2011-03-10 06:18:50 Bryce Harrington attachment added output.txt https://bugs.launchpad.net/launchpad/+bug/424671/+attachment/1898059/+files/output.txt
2012-01-03 13:50:18 Robert Collins launchpad: assignee Leonard Richardson (leonardr)