Timeout error when accessing ~ubuntu-security/+archive

[Jamie Strandboge]

Trying to access https://launchpad.net/~ubuntu-security/+archive results in Timeout error OOPS. Using:
https://launchpad.net/~ubuntu-security/+archive?batch=5 works (but it is slow). However, using https://launchpad.net/~ubuntu-security/+archive/+delete-packages?batch=5 does not work at all. This PPA and the webapp are critical for Ubuntu Security updates and USN publication.

[Julian Edwards (julian-edwards)]

Celso, can you take a look at this with highest priority please? I think we need to start profiling the code for the archive index page, it's too slow when the number of packages increases beyond a critical point.

We also need to batch the delete/copy package pages but that's a separate bug.

[Julian Edwards (julian-edwards)]

Related oopses:

https://devpad.canonical.com/~matsubara/oops.cgi/2008-11-25/B2401
https://devpad.canonical.com/~matsubara/oops.cgi/2008-11-25/EB123
https://devpad.canonical.com/~matsubara/oops.cgi/2008-11-25/A2572

[Celso Providelo (cprov)]

The obsolete packages were deleted manually using `lp-remove-package.py`.

The +delete-packages isn't batched using the default mechanism, that's why it passing '?batch=5' didn't help.

After profiling the PPA index page the 'Package size counters' page section was identified as the most expensive & less important part. So, we decided to remove it until we can find a quicker way to provide those statistics.

We will also reduce the number of records presented in +delete-package from 50 to 20.

[Celso Providelo (cprov)]

Urgent changes removing package counters and archive size and also limiting the number of records presented in +delete-packages landed in RF 7349. It will be on edge tonight.

[Celso Providelo (cprov)]

Let re-enable the repository size section by populating it via XHR after the page is loaded.

[Celso Providelo (cprov)]

Based on the timeout drops we have experience in edge I think we can close this bug. Please feel free to reopen it if your page can't be loaded in a reasonable time