Activity log for bug #669717

Date Who What changed Old value New value Message
2010-11-02 00:17:55 Robert Collins bug added bug
2010-11-08 10:53:18 Julian Edwards tags dba timeout dba ppa timeout
2010-11-23 23:56:38 Robert Collins description OOPS-1765EB1552 Branch: launchpad-rev-11793 Revno: 11793 SQL time: 11615 ms Non-sql time: 1970 ms Total time: 13585 ms Statement Count: 207 https://edge.launchpad.net/%7Eguido-iodice/+archive/guiodiclucid/+index?start=350&batch=50 Many slow queries. @200 queries we need need them all to average well under 50ms. The slowest: 1 2802.0 1 SQL-launchpad-main-slave (SELECT SourcePackagePublishingHistory.archive, SourcePackagePublishingHistory.component, SourcePackagePublishingHistory.datecreated, SourcePackagePublishingHistory.datemadepending, SourcePackagePublishingHistory.datepublished, SourcePackagePublishingHistory.dateremoved, SourcePackagePublishingHistory.datesuperseded, SourcePackagePublishingHistory.distroseries, SourcePackagePublishingHistory.id, SourcePackagePublishingHistory.pocket, SourcePackagePublishingHistory.removal_comment, SourcePackagePublishingHistory.removed_by, SourcePackagePublishingHistory.scheduleddeletiondate, SourcePackagePublishingHistory.section, SourcePackagePublishingHistory.sourcepackagerelease, SourcePackagePublishingHistory.status, SourcePackagePublishingHistory.supersededby, BinaryPackageBuild.distro_arch_series, BinaryPackageBuild.id, BinaryPackageBuild.package_build, BinaryPackageBuild.source_package_release, DistroArchSeries.architecturetag, DistroArchSeries.distroseries, DistroArchSeries.enabled, DistroArchSeries.id, DistroArchSeries.official, DistroArchSeries.owner, DistroArchSeries.package_count, DistroArchSeries.processorfamily, DistroArchSeries.supports_virtualized FROM BinaryPackageBuild, DistroArchSeries, PackageBuild, SourcePackagePublishingHistory WHERE BinaryPackageBuild.package_build = PackageBuild.id AND BinaryPackageBuild.distro_arch_series = DistroArchSeries.id AND SourcePackagePublishingHistory.distroseries = DistroArchSeries.distroseries AND SourcePackagePublishingHistory.sourcepackagerelease = BinaryPackageBuild.source_package_release AND SourcePackagePublishingHistory.id IN (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) AND BinaryPackageBuild.id IN (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) ORDER BY SourcePackagePublishingHistory.id, DistroArchSeries.architecturetag) EXCEPT (SELECT SourcePackagePublishingHistory.archive, SourcePackagePublishingHistory.component, SourcePackagePublishingHistory.datecreated, SourcePackagePublishingHistory.datemadepending, SourcePackagePublishingHistory.datepublished, SourcePackagePublishingHistory.dateremoved, SourcePackagePublishingHistory.datesuperseded, SourcePackagePublishingHistory.distroseries, SourcePackagePublishingHistory.id, SourcePackagePublishingHistory.pocket, SourcePackagePublishingHistory.removal_comment, SourcePackagePublishingHistory.removed_by, SourcePackagePublishingHistory.scheduleddeletiondate, SourcePackagePublishingHistory.section, SourcePackagePublishingHistory.sourcepackagerelease, SourcePackagePublishingHistory.status, SourcePackagePublishingHistory.supersededby, BinaryPackageBuild.distro_arch_series, BinaryPackageBuild.id, BinaryPackageBuild.package_build, BinaryPackageBuild.source_package_release, DistroArchSeries.architecturetag, DistroArchSeries.distroseries, DistroArchSeries.enabled, DistroArchSeries.id, DistroArchSeries.official, DistroArchSeries.owner, DistroArchSeries.package_count, DistroArchSeries.processorfamily, DistroArchSeries.supports_virtualized FROM BinaryPackageBuild, BinaryPackageName, BinaryPackagePublishingHistory, BinaryPackageRelease, BuildFarmJob, DistroArchSeries, PackageBuild, SourcePackagePublishingHistory WHERE SourcePackagePublishingHistory.sourcepackagerelease = BinaryPackageBuild.source_package_release AND BinaryPackageRelease.build = BinaryPackageBuild.id AND BinaryPackageRelease.binarypackagename = BinaryPackageName.id AND SourcePackagePublishingHistory.distroseries = DistroArchSeries.distroseries AND BinaryPackagePublishingHistory.distroarchseries = DistroArchSeries.id AND BinaryPackagePublishingHistory.binarypackagerelease = BinaryPackageRelease.id AND BinaryPackagePublishingHistory.pocket = SourcePackagePublishingHistory.pocket AND BinaryPackagePublishingHistory.archive = SourcePackagePublishingHistory.archive AND SourcePackagePublishingHistory.id IN (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) AND BinaryPackagePublishingHistory.datepublished IS NOT NULL AND BinaryPackageBuild.package_build = PackageBuild.id AND PackageBuild.build_farm_job = BuildFarmJob.id AND BuildFarmJob.status IN (%s) ORDER BY SourcePackagePublishingHistory.id, DistroArchSeries.architecturetag) OOPS-1788D223 Branch: launchpad-rev-11927 Revno: 11927 SQL time: 11263 ms Non-sql time: 5447 ms Total time: 16710 ms Statement Count: 345 https://launchpad.net/%7Exorg-edgers/+archive/ppa/+index Looks like Binary package scaling now. 1 146 2935 20 2915 SQL-launchpad-main-slave SELECT PackageBuild.archive, PackageBuild.build_farm_job, PackageBuild.dependencies, PackageBuild.id, PackageBuild.pocket, PackageBuild.upload_log FROM PackageBuild WHERE PackageBuild.id = %s LIMIT 1 2 146 1004 6 998 SQL-launchpad-main-slave SELECT BuildFarmJob.builder, BuildFarmJob.date_created, BuildFarmJob.date_finished, BuildFarmJob.date_first_dispatched, BuildFarmJob.date_started, BuildFarmJob.failure_count, BuildFarmJob.id, BuildFarmJob.job_type, BuildFarmJob.log, BuildFarmJob.processor, BuildFarmJob.status, BuildFarmJob.virtualized FROM BuildFarmJob WHERE BuildFarmJob.id = %s LIMIT 1 are the two highest frequency repeats. PLus there are many slightly different 400ms queries.
2010-12-03 11:27:49 Launchpad Janitor branch linked lp:~wgrant/launchpad/bug-675621-packages-binary-scaling
2010-12-03 11:46:09 William Grant soyuz: assignee William Grant (wgrant)
2010-12-03 11:46:14 William Grant soyuz: status Triaged In Progress
2010-12-09 03:15:50 Launchpad QA Bot tags dba ppa timeout dba ppa qa-needstesting timeout
2010-12-09 03:15:52 Launchpad QA Bot soyuz: status In Progress Fix Committed
2010-12-09 09:16:49 William Grant tags dba ppa qa-needstesting timeout dba ppa qa-ok timeout
2010-12-17 10:15:44 Robert Collins launchpad: status Fix Committed Fix Released
2011-01-11 16:35:53 Curtis Hovey launchpad: milestone 11.01