HWDevice:EntryResource:getSubmissions timeouts at high batch offset

[Robert Collins]

 22 SELECT DISTINCT HWSubmission.contactable, HWSubmission.date_created, HWSubmission.date_submitted, ... D HWSubmissionDevice.submission = HWSubmission.id ORDER BY HWSubmission.id LIMIT $INT OFFSET $INT:
   GET: 22 Robots: 0 Local: 0
      6 https://api.launchpad.net/beta/+hwdb/+device/365 (HWDevice:EntryResource:getSubmissions)
       OOPS-1989AQ136, OOPS-1989CC117, OOPS-1989D138, OOPS-1989F123, OOPS-1989H151
      6 https://api.launchpad.net/beta/+hwdb/+device/8 (HWDevice:EntryResource:getSubmissions)
       OOPS-1989AZ13, OOPS-1989BA19, OOPS-1989CD16, OOPS-1989CL19, OOPS-1989DY22
      4 https://api.launchpad.net/beta/+hwdb/+device/36 (HWDevice:EntryResource:getSubmissions)
       OOPS-1989AU124, OOPS-1989AY131, OOPS-1989CJ85, OOPS-1989CQ99
   [3 other URLs]

18. 68 6580ms SQL-launchpad-main-master
SELECT DISTINCT HWSubmission.contactable,
                HWSubmission.date_created,
                HWSubmission.date_submitted,
                HWSubmission.distroarchseries,
                HWSubmission.format,
                HWSubmission.id,
                HWSubmission.OWNER, HWSubmission.private,
                                    HWSubmission.raw_emailaddress,
                                    HWSubmission.raw_submission,
                                    HWSubmission.status,
                                    HWSubmission.submission_key,
                                    HWSubmission.system_fingerprint
FROM HWDevice,
     HWDeviceDriverLink,
     HWSubmission,
     HWSubmissionDevice
WHERE NOT HWSubmission.private
  AND HWDeviceDriverLink.device = HWDevice.id
  AND HWDevice.id = 365
  AND HWSubmissionDevice.device_driver_link = HWDeviceDriverLink.id
  AND HWSubmissionDevice.submission = HWSubmission.id
ORDER BY HWSubmission.id LIMIT 76
OFFSET 122025

 -

[Robert Collins (lifeless)]

This is a case where a server side map-reduce would help, or cheaper batches.

[Ian Booth (wallyworld)]

Demoting to High since hwdb functionality is deprecated in lp.

[Colin Watson (cjwatson)]

We've removed the hardware database, so this is no longer applicable.