blocking inconsistent state (nfiles_manifest count mis-match)

[John Lekashman]

Stuck here.
Wrong count.
Somehow, looks like one file got transferred, the others didn't.
A count is misaligned.
And the system won't go past here.

lekash@ia360938:/1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938$ more ERROR
==== WIDE-20100917101648685-00078-00094-ia360938 ====
crawldata: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938
mode: single
  CONFIG: /home/lekash/scripts/draintasker/dev/dtmon1.cfg
  S3CFG: /home/lekash/.ias3cfg
  MANIFEST: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/MANIFEST
  OPEN: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/LAUNCH.open
  TASK: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/TASK
  SUCCESS: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/SUCCESS
  TOMBSTONE: /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/TOMBSTONE
parsing MANIFEST:
  /1/incoming/wide/WIDE-20100917101648685-00078-00094-ia360938/MANIFEST
  nfiles_manifest = 9
  nfiles_found = 10
ERROR: count mis-match: nfiles_manifest=9 vs nfiles_found=10
Aborting!

[John Lekashman (lekash)]

I have the same problem in several places by the way.

[siznax (siznax)]

right, discovered this independently (as mine blocked too). fix is to-be-checked-in.

[siznax (siznax)]

fixed with changeset
r37 | steve | 2010-10-28 00:45:05 UTC
* deprecated (non-functional) thumper mode,
* renamed s3-dtmon.sh to dtmon.sh (#661451),
* check gzip before upload (#661519),
* fixed variable test syntax error (#664027),
* removed crawljob "incoming" dependency (#664707),
* use collection 3/2/1 syntax in config (#664825),
* fixed blocking inconsistent state (#666607),
* check required description keywords (#667021),
* TODO file deleted in favor of Launchpad