Follow up comments after trying to run 3 batches of records through it:
Configuration example suggestions:
* The example configuration file should be renamed to bib_magic_importer.conf.example.
* Delete the comment about installing the prerequisite modules.
* Provide default directories that match sample Evergreen layout: /openils/var/log/, etc.
* Boolean options should accept Boolean values: 0, 1, true, false, yes, no. They shouldn't need to be commented out to be set to false.
* Can we dispense with the need for the _{N} on the field edits?
The documentation should warn the user that a recursive descent is done through the incomingmarcfolder, so any subdirectories are scanned as well. This was not obvious to me, and I only found during my first test run.
It should not try to send email if no email addresses are configured. I commented out the erroremaillist, successemaillist, and alwaysemail options and got the following error at the end of the run:
Use of uninitialized value for string at /usr/share/perl5/Email/MIME/Enc[7/1838]
ine 67.
no recipients
Trace begun at /usr/local/share/perl/5.34.0/Email/Sender/Simple.pm line 116
Email::Sender::Simple::send_email('Email::Sender::Simple', 'Email::Abstract=ARRA
Y(0x565547895338)', 'HASH(0x565547ad1f48)') called at /usr/local/share/perl/5.34
.0/Email/Sender/Role/CommonSending.pm line 45
Email::Sender::Role::CommonSending::try {...} at /usr/share/perl5/Try/Tiny.pm line 102 eval {...} at /usr/share/perl5/Try/Tiny.pm line 93 Try::Tiny::try('CODE(0x56554788f7a8)', 'Try::Tiny::Catch=REF(0x565547896f80)') called at /usr/local/share/perl/5.34.0/Email/Sender/Role/CommonSending.pm line 58
Email::Sender::Role::CommonSending::send('Email::Sender::Simple', 'Email::MIME=HASH(0x565547af3330)') called at /usr/share/perl5/Sub/Exporter/Util.pm line 57
Sub::Exporter::Util::__ANON__('Email::MIME=HASH(0x565547af3330)') called at /ope nils/bin/bib_magic_importer line 4183
main::email_send('HASH(0x5655478bd150)', 'Evergreen Electronic Import Summary - custom_electronic Import Report Job # 3 WINDING UP', 'Hello,^J^JJust letting you know that I have begun processing the provided files:^JKanopy_MARC_Records__add itions__springfieldlibrary.mrc^M^J^JThis software is configured to perform deep search matches against the database. This is slow but thorough.^JDepending on th e number of records, it could be days before you receive the finished message. F YI.^JI\'ll send a follow-up email when I\'m done.^J^JYours Truly,^JThe friendly server^J') called at /openils/bin/bib_magic_importer line 1103 main::sendWelcomeMessage('ARRAY(0x5655472a5c70)') called at /openils/bin/bib_mag ic_importer line 252
I am testing this on a test environment that is not set up to send email.
I think the above may have blown up my attempts to process records because nothing seemed to happen after that and no records were loaded.
Looking at the data in bib_magic.import_status, the subfield 9 was successfully added, but the other changes that I requested to the 856 did not happen. Perhaps I misunderstood this part of the documentation?
Follow up comments after trying to run 3 batches of records through it:
Configuration example suggestions:
* The example configuration file should be renamed to bib_magic_ importer. conf.example.
* Delete the comment about installing the prerequisite modules.
* Provide default directories that match sample Evergreen layout: /openils/var/log/, etc.
* Boolean options should accept Boolean values: 0, 1, true, false, yes, no. They shouldn't need to be commented out to be set to false.
* Can we dispense with the need for the _{N} on the field edits?
The documentation should warn the user that a recursive descent is done through the incomingmarcfolder, so any subdirectories are scanned as well. This was not obvious to me, and I only found during my first test run.
It should not try to send email if no email addresses are configured. I commented out the erroremaillist, successemaillist, and alwaysemail options and got the following error at the end of the run:
Use of uninitialized value for string at /usr/share/ perl5/Email/ MIME/Enc[ 7/1838]
ine 67.
no recipients
Trace begun at /usr/local/ share/perl/ 5.34.0/ Email/Sender/ Simple. pm line 116 Sender: :Simple: :send_email( 'Email: :Sender: :Simple' , 'Email: :Abstract= ARRA d1f48)' ) called at /usr/local/ share/perl/ 5.34 Sender/ Role/CommonSend ing.pm line 45
Email::
Y(0x565547895338)', 'HASH(0x565547a
.0/Email/
Email:: Sender: :Role:: CommonSending: :try {...} at /usr/share/ perl5/Try/ Tiny.pm line 102 eval {...} at /usr/share/ perl5/Try/ Tiny.pm line 93 Try::Tiny: :try('CODE( 0x56554788f7a8) ', 'Try::Tiny: :Catch= REF(0x565547896 f80)') called at /usr/local/ share/perl/ 5.34.0/ Email/Sender/ Role/CommonSend ing.pm line 58
Email:: Sender: :Role:: CommonSending: :send(' Email:: Sender: :Simple' , 'Email: :MIME=HASH( 0x565547af3330) ') called at /usr/share/ perl5/Sub/ Exporter/ Util.pm line 57
Sub::Exporter: :Util:: __ANON_ _('Email: :MIME=HASH( 0x565547af3330) ') called at /ope nils/bin/ bib_magic_ importer line 4183
main::email_ send('HASH( 0x5655478bd150) ', 'Evergreen Electronic Import Summary - custom_electronic Import Report Job # 3 WINDING UP', 'Hello,^J^JJust letting you know that I have begun processing the provided files:^ JKanopy_ MARC_Records_ _add itions_ _springfieldlib rary.mrc^ M^J^JThis software is configured to perform deep search matches against the database. This is slow but thorough. ^JDepending on th e number of records, it could be days before you receive the finished message. F YI.^JI\'ll send a follow-up email when I\'m done.^J^JYours Truly,^JThe friendly server^J') called at /openils/ bin/bib_ magic_importer line 1103 main::sendWelco meMessage( 'ARRAY( 0x5655472a5c70) ') called at /openils/ bin/bib_ mag ic_importer line 252
I am testing this on a test environment that is not set up to send email.
I think the above may have blown up my attempts to process records because nothing seemed to happen after that and no records were loaded.
Looking at the data in bib_magic. import_ status, the subfield 9 was successfully added, but the other changes that I requested to the 856 did not happen. Perhaps I misunderstood this part of the documentation?