Authority Records with Long Subfields Fail to Load
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Evergreen |
Fix Released
|
Medium
|
Unassigned | ||
3.6 |
Fix Released
|
Medium
|
Unassigned |
Bug Description
Evergreen version: 3.2.10+
OpenSRF version: N/A
PostgreSQL version: 9.6
CWMARS recently received a batch update of bibliographic and authority records from a vendor. The following error was output while loading the authority records:
DBD::Pg::db do failed: ERROR: index row size 2984 exceeds maximum 2712 for index "authority_
HINT: Values larger than 1/3 of a buffer page cannot be indexed.
Consider a function index of an MD5 hash of the value, or use full text indexing.
CONTEXT: SQL statement "INSERT INTO authority.full_rec (record, tag, ind1, ind2, subfield, value)
SELECT record, tag, ind1, ind2, subfield, value FROM authority.
PL/pgSQL function authority.
SQL statement "SELECT authority.
PL/pgSQL function authority.
DBD::Pg::db do failed: ERROR: index row size 2984 exceeds maximum 2712 for index "authority_
HINT: Values larger than 1/3 of a buffer page cannot be indexed.
Consider a function index of an MD5 hash of the value, or use full text indexing.
CONTEXT: SQL statement "INSERT INTO authority.full_rec (record, tag, ind1, ind2, subfield, value)
SELECT record, tag, ind1, ind2, subfield, value FROM authority.
PL/pgSQL function authority.
SQL statement "SELECT authority.
PL/pgSQL function authority.
Issuing rollback() due to DESTROY without explicit disconnect() of DBD::Pg::db handle host=db1;
Investigation revealed that this error is caused by 1 authority record with a 670$b that is 5,090 characters long. This error causes the remaining 6,445 to also not load. They had to be loaded after the troublesome record was identified and removed from the input.
Looking in the database, I have determined that a potential fix is to change the authority_
I will add a branch with schema changes, db upgrade, and release notes shortly.
summary: |
- Aurhotiry Records with Long Subfields Fail to Load + Authority Records with Long Subfields Fail to Load |
Changed in evergreen: | |
milestone: | 3.7-rc → 3.7.1 |
Changed in evergreen: | |
milestone: | 3.7.1 → 3.7.2 |
tags: |
added: cat-authority removed: authority cataloging |
Changed in evergreen: | |
status: | Fix Committed → Fix Released |
Jason,
What authority record is this? Perhaps it needs to be turned into the authority police?