running the daily cron job is VERY slow

[Shawn Heisey]

I found that the daily cron job was taking many hours. Once it took 20 hours to complete!

In mysql, I added a new index on the `messages` table, on the from_domain column. Now the cronjob takes four minutes, every time it runs.

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: opendmarc 1.3.2-7ubuntu0.1
ProcVersionSignature: Ubuntu 5.15.0-1055.60~20.04.1-aws 5.15.136
Uname: Linux 5.15.0-1055-aws x86_64
ApportVersion: 2.20.11-0ubuntu27.27
Architecture: amd64
CasperMD5CheckResult: skip
Date: Sun Mar 17 12:42:19 2024
Ec2AMI: ami-063aa838bd7631e0b
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: us-west-1b
Ec2InstanceType: t3a.large
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
ProcEnviron:
 TERM=xterm
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.utf8
 SHELL=/bin/bash
SourcePackage: opendmarc
UpgradeStatus: Upgraded to focal on 2021-07-10 (981 days ago)
mtime.conffile..etc.default.opendmarc: 2022-08-05T08:39:10.606732
mtime.conffile..etc.opendmarc.conf: 2022-12-13T20:42:56.531125

[Shawn Heisey (elyograg)]

I added the new index on 2024-03-12. The cronjob kicks off at 01:00 and you can see that it greatly reduced the time. On 2024-03-09 you can see that the cronjob started at 01:00 completed at 21:00 ... this is the 20 hour run.