CVS to Bazaar importer

bzr import cvsps hangs

Bug #275574 reported by David Reitter
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Bazaar
Invalid
Undecided
Unassigned
CVS to Bazaar importer
New
Undecided
Unassigned

Bug Description

cvsps-import seems to get stuck - after about 17 hours it still doesn't seem to be doing much, except eating substantial CPU cycles.
This is a small repository (aquamacs, server: cvs.aquamacs.org - it's public), from which I have deleted the only existing branch to make cvsps work at all.

bash-3.2$ bzr cvsps-import -v /Users/dr/cvs2 aquamacs /Users/dr/bzr.aquamacs Creating cvsps dump file: /Users/dr/bzr.aquamacs/staging/aquamacs.dump

branch #CVSPS_NO_BRANCH not found in global branch hash
branch #CVSPS_NO_BRANCH not found in global branch hash

^CProcessed 0 patches (0 new, 0 existing) on 0 branches (0 tags) in 63986.5s (0.00 patch/s)

The staging directory is empty...

bash-3.2$ du -h
  0B ./bzr/aquamacs/.bzr/branch-lock
  0B ./bzr/aquamacs/.bzr/repository/indices
  0B ./bzr/aquamacs/.bzr/repository/lock
  0B ./bzr/aquamacs/.bzr/repository/obsolete_packs
  0B ./bzr/aquamacs/.bzr/repository/packs
  0B ./bzr/aquamacs/.bzr/repository/upload
8.0K ./bzr/aquamacs/.bzr/repository
 16K ./bzr/aquamacs/.bzr
  0B ./bzr/aquamacs/branches
  0B ./bzr/aquamacs/tags
 16K ./bzr/aquamacs
 16K ./bzr
  0B ./staging
 20K .

bzr.log:

1.416 encoding stdout as sys.stdout encoding 'US-ASCII'
1.425 bzr arguments: [u'cvsps-import', u'-v', u'/Users/dr/cvs2', u'aquamacs', u'/Users/dr/bzr.aquamacs']
1.425 looking for plugins in /Users/dr/.bazaar/plugins
2.368 looking for plugins in /Library/Python/2.5/site-packages/bzrlib/plugins
2.369 Plugin name __init__ already loaded
2.369 Plugin name __init__ already loaded
2.498 encoding stdout as sys.stdout encoding 'US-ASCII'
3.014 Running command: ['cvsps', '--cvs-direct', '-A', '-u', '-q', '--root', u'/Users/dr/cvs2', u'aquamacs']
[80350] 2008-09-28 20:07:12.186 INFO: Processed 0 patches (0 new, 0 existing) on 0 branches (0 tags) in 63986.5s (0.00 patch/s)
63989.596 Traceback (most recent call last):
  File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 857, in run_bzr_catch_errors
    return run_bzr(argv)
  File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 797, in run_bzr
    ret = run(*run_argv)
  File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 499, in run_argv_aliases
    return self.run(**all_cmd_args)
  File "/Users/dr/.bazaar/plugins/cvsps_import/__init__.py", line 95, in run
    importer.process()
  File "/Users/dr/.bazaar/plugins/cvsps_import/cvsps/importer.py", line 1266, in process
    patchsets = self._parse_cvsps_dump(pb=pb)
  File "/Users/dr/.bazaar/plugins/cvsps_import/cvsps/importer.py", line 1193, in _parse_cvsps_dump
    cvsps_controller.create_cvsps_dump(cvsps_dump_path)
  File "/Users/dr/.bazaar/plugins/cvsps_import/cvsps/importer.py", line 1080, in create_cvsps_dump
    self._run_cvsps(cmd, out_file=cvsps_dump_file)
  File "/Users/dr/.bazaar/plugins/cvsps_import/cvsps/importer.py", line 1099, in _run_cvsps
    returncode = p.wait()
  File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/subprocess.py", line 1110, in wait
    pid, sts = os.waitpid(self.pid, 0)
KeyboardInterrupt

63989.597 return code 3

bash-3.2$ bzr --version
Bazaar (bzr) 1.7.1rc1
  Python interpreter: /System/Library/Frameworks/Python.framework/Versions/2.5/Resources/Python.app/Contents/MacOS/Python 2.5.1
  Python standard library: /System/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5
  bzrlib: /Library/Python/2.5/site-packages/bzrlib
  Bazaar configuration: /Users/dr/.bazaar
  Bazaar log file: /Users/dr/.bzr.log

Revision history for this message
Martin Pool (mbp) wrote :

Can you get any kind of trace from cvsps, or perhaps a traceback by attaching to it with gdb?

Changed in bzr:
status: New → Incomplete
Changed in bzr-cvsps-import:
status: New → Incomplete
Revision history for this message
David Reitter (david-reitter) wrote : Re: [Bug 275574] Re: bzr import cvsps hangs

On 6 Oct 2008, at 21:42, Martin Pool wrote:

> Can you get any kind of trace from cvsps, or perhaps a traceback by
> attaching to it with gdb?

Yes, sure.
But just running it stand-alone, without the '-q' reveals some
problem. It gets stuck here:

WARNING: Invalid PatchSet 909, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.1=after, build/setup-build.sh:1.1=before.
Treated as 'before'
WARNING: Invalid PatchSet 913, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.2=after, build/setup-build.sh:1.2=before.
Treated as 'before'
WARNING: Invalid PatchSet 937, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.3=after, build/setup-build.sh:1.3=before.
Treated as 'before'
WARNING: Invalid PatchSet 1010, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.4=after, build/setup-build.sh:1.4=before.
Treated as 'before'
WARNING: Invalid PatchSet 909, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.1=after, build/setup-build.sh:1.1=before.
Treated as 'before'
WARNING: Invalid PatchSet 913, Tag AQUAMACS_1_0B:
     build/setup-build.sh:1.2=after, build/setup-build.sh:1.2=before.
Treated as 'before'

I don't think you need the trace, and it's unspectacular anyways:

#6 0x00002034 in vdebug (dtype=32, fmt=0xe9f4 "WARNING: Invalid
PatchSet %d, Tag %s:\n %s:%s=after, %s:%s=before. Treated as
'before'", ap=0xbfffe5f8 "ò\003") at cbtcommon/debug.c:70
#7 0x00003883 in debug (dtype=32, fmt=0xe9f4 "WARNING: Invalid
PatchSet %d, Tag %s:\n %s:%s=after, %s:%s=before. Treated as
'before'") at debug.h:54
#8 0x00008019 in main (argc=8, argv=0xbfffeed8) at cvsps.c:2491

The above looks familiar. I've removed the tag and now cvsps crashes
elsewhere (but that is known bug).

Perhaps it would be a good idea to not run cvsps with '-q' from bzr
until it's less brittle and can process more real-life CVS
repositories. That gives a user like me the chance to work around
issues with tags and branches.

- David

Revision history for this message
Johan Walles (walles) wrote :

Seems to me David just forgot to change the status of this back from Incomplete.

What's the status of this?

Changed in bzr-cvsps-import:
status: Incomplete → New
Revision history for this message
David Reitter (david-reitter) wrote :
Download full text (4.4 KiB)

I'm not aware of progress with it, but I've also stopped following bzr
development since. The CVS repo should still be available, but
that'll go away sooner than later. My repository isn't particularly
big or complex.

- David

On May 28, 2009, at 1:51 AM, Johan Walles wrote:

> Seems to me David just forgot to change the status of this back from
> Incomplete.
>
> What's the status of this?
>
> ** Changed in: bzr-cvsps-import
> Status: Incomplete => New
>
> --
> bzr import cvsps hangs
> https://bugs.launchpad.net/bugs/275574
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in Bazaar Version Control System: Incomplete
> Status in CVS to Bazaar importer: New
>
> Bug description:
> cvsps-import seems to get stuck - after about 17 hours it still
> doesn't seem to be doing much, except eating substantial CPU cycles.
> This is a small repository (aquamacs, server: cvs.aquamacs.org -
> it's public), from which I have deleted the only existing branch to
> make cvsps work at all.
>
>
> bash-3.2$ bzr cvsps-import -v /Users/dr/cvs2 aquamacs /Users/dr/
> bzr
> .aquamacs
> Creating
> cvsps dump file: /Users/dr/bzr.aquamacs/staging/aquamacs.dump
>
> branch #CVSPS_NO_BRANCH not found in global branch hash
> branch #CVSPS_NO_BRANCH not found in global branch hash
>
>
> ^CProcessed 0 patches (0 new, 0 existing) on 0 branches (0 tags) in
> 63986.5s (0.00 patch/s)
>
>
> The staging directory is empty...
>
> bash-3.2$ du -h
> 0B ./bzr/aquamacs/.bzr/branch-lock
> 0B ./bzr/aquamacs/.bzr/repository/indices
> 0B ./bzr/aquamacs/.bzr/repository/lock
> 0B ./bzr/aquamacs/.bzr/repository/obsolete_packs
> 0B ./bzr/aquamacs/.bzr/repository/packs
> 0B ./bzr/aquamacs/.bzr/repository/upload
> 8.0K ./bzr/aquamacs/.bzr/repository
> 16K ./bzr/aquamacs/.bzr
> 0B ./bzr/aquamacs/branches
> 0B ./bzr/aquamacs/tags
> 16K ./bzr/aquamacs
> 16K ./bzr
> 0B ./staging
> 20K .
>
>
> bzr.log:
>
>
> 1.416 encoding stdout as sys.stdout encoding 'US-ASCII'
> 1.425 bzr arguments: [u'cvsps-import', u'-v', u'/Users/dr/cvs2',
> u'aquamacs', u'/Users/dr/bzr.aquamacs']
> 1.425 looking for plugins in /Users/dr/.bazaar/plugins
> 2.368 looking for plugins in /Library/Python/2.5/site-packages/
> bzrlib/plugins
> 2.369 Plugin name __init__ already loaded
> 2.369 Plugin name __init__ already loaded
> 2.498 encoding stdout as sys.stdout encoding 'US-ASCII'
> 3.014 Running command: ['cvsps', '--cvs-direct', '-A', '-u', '-q',
> '--root', u'/Users/dr/cvs2', u'aquamacs']
> [80350] 2008-09-28 20:07:12.186 INFO: Processed 0 patches (0 new, 0
> existing) on 0 branches (0 tags) in 63986.5s (0.00 patch/s)
> 63989.596 Traceback (most recent call last):
> File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line
> 857, in run_bzr_catch_errors
> return run_bzr(argv)
> File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line
> 797, in run_bzr
> ret = run(*run_argv)
> File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line
> 499, in run_argv_aliases
> re...

Read more...

Jelmer Vernooij (jelmer)
Changed in bzr:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.