For investigative purposes, I'm bringing back James' original idea of removing naco_normalize (now spelled search_normalize) from the left side of the comparison.
In order to support this we need to apply all normalizers to the value column in the field entry tables. That's done in a straight-forward way be just pushing the data into the column at the appropriate time in the appropriate trigger. There is a small loss of accuracy, because some fields don't get that normalizations when being stored, but the user-supplied value will still be normalized. But, these are just for relevance adjustment and not matching, so it's not too bad IMO.
Next, we make QueryParser forget about applying search_normalize to the column (but still to the value).
Testing appreciated! (basically untested at this point)
You'll need to rewrite the the field entry tables. The following should be enough:
UPDATE metabib.author_field_entry SET id = id;
UPDATE metabib.title_field_entry SET id = id;
UPDATE metabib.subject_field_entry SET id = id;
UPDATE metabib.series_field_entry SET id = id;
UPDATE metabib.keyword_field_entry SET id = id;
UPDATE metabib.identifier_field_entry SET id = id;
For investigative purposes, I'm bringing back James' original idea of removing naco_normalize (now spelled search_normalize) from the left side of the comparison.
In order to support this we need to apply all normalizers to the value column in the field entry tables. That's done in a straight-forward way be just pushing the data into the column at the appropriate time in the appropriate trigger. There is a small loss of accuracy, because some fields don't get that normalizations when being stored, but the user-supplied value will still be normalized. But, these are just for relevance adjustment and not matching, so it's not too bad IMO.
Next, we make QueryParser forget about applying search_normalize to the column (but still to the value).
Testing appreciated! (basically untested at this point)
You'll need to rewrite the the field entry tables. The following should be enough:
UPDATE metabib. author_ field_entry SET id = id; title_field_ entry SET id = id; subject_ field_entry SET id = id; series_ field_entry SET id = id; keyword_ field_entry SET id = id; identifier_ field_entry SET id = id;
UPDATE metabib.
UPDATE metabib.
UPDATE metabib.
UPDATE metabib.
UPDATE metabib.
Here's the WIP branch: http:// git.evergreen- ils.org/ ?p=working/ Evergreen. git;a=shortlog; h=refs/ heads/user/ miker/reduce- normalization