FOTS: fn:matches failures (at least 109 failures)

Bug #1123161 reported by Sorin Marian Nasoi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Zorba
Fix Released
Critical
Paul J. Lucas

Bug Description

There are a series of test cases failing for the fn:matches:

- 105 in "fn-matches.re" test set
- 4 in "fn-matches" test set

The attached report was generated using:
./zorba -f -q ../../test/fots_driver/cli.xq -e mode:=run-test-sets -e testSetPrefixes:=fn-matches -e verbose:=true -o results_fn-matches.xml --indent --disable-http-resolution

"fn-matches.re" list of failing test cases:
"re00041,re00055,re00058,re00059,re00060,re00063,re00071,re00072,re00127a,re00129a,re00130a,re00288,re00370,re00480,re00498,re00501,re00506,re00589,re00590,re00613,re00680,re00693,re00694,re00695,re00696,re00697,re00698,re00702,re00703,re00704,re00705,re00706,re00707,re00708,re00709,re00710,re00711,re00712,re00713,re00717,re00718,re00719,re00720,re00721,re00722,re00723,re00730,re00732,re00736,re00739,re00740,re00744,re00745,re00746,re00749,re00750,re00754,re00763,re00767,re00768,re00769,re00770,re00771,re00779,re00780,re00795,re00804,re00805,re00806,re00814,re00867,re00868,re00869,re00870,re00871,re00872,re00873,re00874,re00875,re00876,re00881,re00882,re00890,re00891,re00905,re00912,re00913,re00914,re00919,re00939,re00940,re00941,re00957,re00970,re00977,re00978,re00982,re00983,re00984,re00987,re00988,re00989,re00994,re00998,re00999"

"fn-matches" list of failing test cases:
"caselessmatch10,caselessmatch11,cbcl-matches-038,cbcl-matches-039"

Tags: fots

Related branches

Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) wrote :
Revision history for this message
Paul J. Lucas (paul-lucas) wrote :

paulbook<1>$ zorba -f -q ../../test/fots_driver/cli.xq -e mode:=run-test-sets -e testSetPrefixes:=fn-matches -e verbose:=true -o results_fn-matches.xml --indent --disable-http-resolution
'testSetPrefixes' was set to: [1]: fn-matches
'testCasePrefixes' was set to: [1]:
'dependency' set to: [1]:
'verbose' set to: [1]: true
Cli command was set to: [1]: run-test-sets
Path to FOTS catalog.xml was set to: [1]: ../../build/test/fots/2011/QT3-test-suite/catalog.xml
Path to FOTSZorbaManifest set to : [1]: FOTSZorbaManifest.xml
Path to ExpectedFailures.xml set to: [1]:
</Users/pjl/src/flwor/zorba/repo/bug-1122396/zorba/test/fots_driver/fots-driver.xq>:418,5: user-defined error [err:FODC0002]:
Please make sure the passed 'fotsPath' points to the exact location of the FOTS catalog.xml:
file:///Users/pjl/src/flwor/zorba/repo/bug-1122396/zorba/build/test/fots/2011/QT3-test-suite/catalog.xml
 that the passed 'fotsZorbaManifestPath' points to a file in the same folder as cli.xq:
file:///Users/pjl/src/flwor/zorba/repo/bug-1122396/zorba/test/fots_driver/FOTSZorbaManifest.xml
 that the passed 'expectedFailuresPath' points to the ExpectedFailures.xml file:
; raised at /Users/pjl/src/flwor/zorba/repo/bug-1122396/zorba/src/runtime/errors_and_diagnostics/errors_and_diagnostics_impl.cpp:81

Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) wrote :

http://my.zorba-xquery.com/dokuwiki/doku.php?id=zorba_fots_testing

Beforehand please run:
make fots-import
make fots-activate-sets

Changed in zorba:
status: New → In Progress
Changed in zorba:
importance: Undecided → Critical
milestone: none → 2.9
Revision history for this message
Paul J. Lucas (paul-lucas) wrote :

Note that this is a place-holder "bug" comprised of many unrelated bugs. Instead of filing this "bug," many separate bugs should have been filed grouped only when failures are related. Admittedly, however, that would take a lot of effort as well as analyzing the tests to determine which are similar enough to be grouped.

I've managed to fix 100 of the 109 failures and opened separate bugs for the remainder (the ones that where it may be the case that the test is invalid or it's not clear what the bug is).

Changed in zorba:
status: In Progress → Fix Committed
Changed in zorba:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.