running the daily cron job is VERY slow
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
opendmarc (Ubuntu) |
New
|
Undecided
|
Unassigned |
Bug Description
I found that the daily cron job was taking many hours. Once it took 20 hours to complete!
In mysql, I added a new index on the `messages` table, on the from_domain column. Now the cronjob takes four minutes, every time it runs.
ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: opendmarc 1.3.2-7ubuntu0.1
ProcVersionSign
Uname: Linux 5.15.0-1055-aws x86_64
ApportVersion: 2.20.11-
Architecture: amd64
CasperMD5CheckR
Date: Sun Mar 17 12:42:19 2024
Ec2AMI: ami-063aa838bd7
Ec2AMIManifest: (unknown)
Ec2Availability
Ec2InstanceType: t3a.large
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
ProcEnviron:
TERM=xterm
PATH=(custom, no user)
XDG_RUNTIME_
LANG=en_US.utf8
SHELL=/bin/bash
SourcePackage: opendmarc
UpgradeStatus: Upgraded to focal on 2021-07-10 (981 days ago)
mtime.conffile.
mtime.conffile.
I added the new index on 2024-03-12. The cronjob kicks off at 01:00 and you can see that it greatly reduced the time. On 2024-03-09 you can see that the cronjob started at 01:00 completed at 21:00 ... this is the 20 hour run.