Checkout of a large branch hangs due to NotImplemented get_password on SilentUIFactory

[Ken Tang]

Checkout of a large branch hangs due to error: Adding the key ... to an LRUSizeCache failed. value is too big to fit in a the cache.

I have a branch with many file changes, not necessarily a lot of revisions that hangs when attempting to check it out.
It generally hangs during "Build phase:Adding file contents .."
I've tried this several times and each time it hangs, and the Bazaar log gives the same kind of error messages.

Example1:
Fri 2010-03-05 16:25:09 -0500
0.406 bzr arguments: [u'co', u'-r', u'27', u'--lightweight', u'bzr+ssh://mypc/C:/BzrRepo/TestBranch', u'test1']
0.453 looking for plugins in C:/Documents and Settings/ken/Application Data/bazaar/2.0/plugins
0.453 looking for plugins in C:/Program Files/Bazaar2.0/Bazaar/plugins
0.859 encoding stdout as sys.stdout encoding 'cp437'
2.969 falling back to default implementation
2.969 failed to load system host keys: [Errno 2] No such file or directory: 'U:\\/.ssh/known_hosts'
[ 7212] 2010-03-05 16:25:12.943 INFO: Connected (version 2.0, client 6.1.4.83)
3.453 SSH authentication via id_rsa key failed.
4.000 encoding stdout as sys.stdout encoding 'cp437'
[ 7212] 2010-03-05 16:25:19.895 INFO: Authentication (password) successful!
[ 7212] 2010-03-05 16:25:19.911 INFO: Secsh channel 1 opened.
10.922 creating branch reference in file:///C:/bzrDev/test1/.bzr/
75.639 failed to load system host keys: [Errno 2] No such file or directory: 'U:\\/.ssh/known_hosts'
[10184] 2010-03-05 16:25:21.927 INFO: Connected (version 2.0, client 6.1.4.83)
76.123 SSH authentication via id_rsa key failed.
[10184] 2010-03-05 16:25:22.756 ERROR: Error processing remote request
Traceback (most recent call last):
  File "tbzrlib\pipe\server.pyo", line 132, in run_command_loop
  File "tbzrlib\dispatcher.pyo", line 200, in dispatch
  File "tbzrlib\dispatcher.pyo", line 42, in get_file_status
  File "tbzrlib\cache\wtcache.pyo", line 257, in get_status_for_path
  File "tbzrlib\cache\wtcache.pyo", line 180, in __create_cache_for_path
  File "bzrlib\workingtree.pyo", line 346, in open_containing
  File "bzrlib\bzrdir.pyo", line 1742, in open_workingtree
  File "bzrlib\workingtree.pyo", line 3019, in open
  File "bzrlib\workingtree_4.pyo", line 1489, in _open
  File "bzrlib\bzrdir.pyo", line 1725, in open_branch
  File "bzrlib\branch.pyo", line 2041, in open
  File "bzrlib\bzrdir.pyo", line 844, in open
  File "bzrlib\bzrdir.pyo", line 879, in open_from_transport
  File "bzrlib\bzrdir.pyo", line 2065, in open
  File "bzrlib\bzrdir.pyo", line 3294, in _open
  File "bzrlib\remote.pyo", line 114, in __init__
  File "bzrlib\remote.pyo", line 52, in _call
  File "bzrlib\smart\client.pyo", line 129, in call
  File "bzrlib\smart\client.pyo", line 142, in call_expecting_body
  File "bzrlib\smart\client.pyo", line 87, in _call_and_read_response
  File "bzrlib\smart\client.pyo", line 60, in _send_request
  File "bzrlib\smart\protocol.pyo", line 1238, in call
  File "bzrlib\smart\protocol.pyo", line 1107, in _write_end
  File "bzrlib\smart\protocol.pyo", line 1074, in flush
  File "bzrlib\smart\medium.pyo", line 390, in accept_bytes
  File "bzrlib\smart\medium.pyo", line 913, in _accept_bytes
  File "bzrlib\smart\medium.pyo", line 767, in _accept_bytes
  File "bzrlib\smart\medium.pyo", line 791, in _ensure_connection
  File "bzrlib\transport\ssh.pyo", line 333, in connect_ssh
  File "bzrlib\transport\ssh.pyo", line 321, in _connect
  File "bzrlib\transport\ssh.pyo", line 520, in _paramiko_auth
  File "bzrlib\config.pyo", line 1248, in get_password
  File "bzrlib\ui\__init__.pyo", line 126, in get_password
NotImplementedError: <bound method SilentUIFactory.get_password of <bzrlib.ui.SilentUIFactory object at 0x01189670>>
11.078 opening working tree 'C:/bzrDev/test1'
44.859 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x0150DBB0>, 6453685, 8559445) to an LRUSizeCache failed. value 64034471 is too big to fit in a the cache with size 41943040 52428800
[10184] 2010-03-05 16:27:46.190 ERROR: Error processing remote request
Traceback (most recent call last):
  File "tbzrlib\pipe\server.pyo", line 132, in run_command_loop
  File "tbzrlib\dispatcher.pyo", line 200, in dispatch
  File "tbzrlib\dispatcher.pyo", line 42, in get_file_status
  File "tbzrlib\cache\wtcache.pyo", line 224, in get_status_for_path
  File "tbzrlib\cache\wtcache.pyo", line 142, in is_path_allowed
TypeError: cannot concatenate 'str' and 'NoneType' objects
[10184] 2010-03-05 16:34:20.963 INFO: Disconnect (code 11): Login grace-time exceeded

Example 2:
Fri 2010-03-05 16:38:37 -0500
0.359 bzr arguments: [u'co', u'-r', u'27', u'--lightweight', u'bzr+ssh://mypc/C:/BzrRepo/TestBranch', u'Test2']
0.406 looking for plugins in C:/Documents and Settings/ken/Application Data/bazaar/2.0/plugins
0.406 looking for plugins in C:/Program Files/Bazaar2.0/Bazaar/plugins
0.734 encoding stdout as sys.stdout encoding 'cp437'
2.953 falling back to default implementation
2.953 failed to load system host keys: [Errno 2] No such file or directory: 'U:\\/.ssh/known_hosts'
[ 4684] 2010-03-05 16:38:40.786 INFO: Connected (version 2.0, client 6.1.4.83)
3.468 SSH authentication via id_rsa key failed.
3.906 encoding stdout as sys.stdout encoding 'cp437'
[ 4684] 2010-03-05 16:38:47.740 INFO: Authentication (password) successful!
[ 4684] 2010-03-05 16:38:47.770 INFO: Secsh channel 1 opened.
10.984 creating branch reference in file:///C:/bzrDev/Test2/.bzr/
11.234 opening working tree 'C:/bzrDev/Test2'
43.608 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x01512BB0>, 6453685, 8559445) to an LRUSizeCache failed. value 64034471 is too big to fit in a the cache with size 41943040 52428800

Version Info:
Bazaar (bzr) 2.0.0
  Python interpreter: C:\Program Files\Bazaar2.0\Bazaar\python25.dll 2.5.4
  Python standard library: C:\Program Files\Bazaar2.0\Bazaar\lib\library.zip
  Platform: Windows-XP-5.1.2600-SP3

[Martin Pool (mbp)]

I think the LRUCache thing may be a distraction, and the actual problem is

  File "bzrlib\ui\__init__.pyo", line 126, in get_password
NotImplementedError: <bound method SilentUIFactory.get_password of <bzrlib.ui.SilentUIFactory object at 0x01189670>>

in other words bzr needs to read a password and in the way tbzr's calling it, it can't.

What happens if you try to get a checkout by running bzr from a terminal window?

[Ken Tang (ktlb)]

In the 2 examples that I sent, I ran the checkout from a plain DOS command prompt window.
I will recheck. What is tbzr anyways?

[Martin Pool (mbp)]

On 9 March 2010 10:42, Ken Tang <email address hidden> wrote:
> In the 2 examples that I sent, I ran the checkout from a plain DOS command prompt window.
> I will recheck.  What is tbzr anyways?

tbzr is "Tortoise Bzr", the thing that makes bzr bits integrate into
Explorer windows.

I think there is an option to disable that: maybe you could try that.
It may not fix the problem but it will probably avoid complicating the
logs.

--
Martin <http://launchpad.net/~mbp/>

[Kuno Meyer (kuno-meyer)]

Similar issue here: pushing (and creating) a local branch a (Windows) network share.

Remarkably: Repeating the identical command a second time results in a "No new revision to push".

-------

Mi 2010-03-10 13:34:07 +0100
0.078 bazaar version: 2.1.0
0.078 bzr arguments: [u'push', u'--remember', u'\\\\ch01so01\\transfer\\kmeyer\\ch2bin']
0.094 looking for plugins in C:/Documents and Settings/mek/Application Data/bazaar/2.0/plugins
0.094 looking for plugins in C:/Program Files/Bazaar/plugins
0.172 encoding stdout as sys.stdout encoding 'cp850'
0.219 opening working tree 'D:/Projekte/Phonak2'
1.406 opening working tree 'D:/Projekte/Phonak2'
1.563 creating repository in file://ch01so01/transfer/kmeyer/ch2bin/.bzr/.
1.703 Using fetch logic to copy between CHKInventoryRepository('file:///D:/Projekte/Phonak2/.bzr/repository/')(<RepositoryFormat2a>) and CHKInventoryRepository('file://ch01so01/transfer/kmeyer/ch2bin/.bzr/repository/')(<RepositoryFormat2a>)
19.375 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x016939D0>, 116502630, 49633798) to an LRUSizeCache failed. value 163464679 is too big to fit in a the cache with size 41943040 52428800
42.500 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x016939D0>, 52331746, 22335917) to an LRUSizeCache failed. value 48816527 is too big to fit in a the cache with size 41943040 52428800
47.219 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x016939D0>, 166789123, 31038245) to an LRUSizeCache failed. value 63380231 is too big to fit in a the cache with size 41943040 52428800
59.969 creating branch <bzrlib.branch.BzrBranchFormat7 object at 0x00EAFEF0> in file://ch01so01/transfer/kmeyer/ch2bin/.bzr/
60.094 opening working tree 'D:/Projekte/Phonak2'
60.188 opening working tree '//ch01so01/transfer/kmeyer/ch2bin'
94.047 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at 0x0182D150>, 56219808, 49936485) to an LRUSizeCache failed. value 164315728 is too big to fit in a the cache with size 41943040 52428800
97.281 Traceback (most recent call last):
  File "bzrlib\commands.pyo", line 853, in exception_to_return_code
  File "bzrlib\commands.pyo", line 1055, in run_bzr
  File "bzrlib\commands.pyo", line 661, in run_argv_aliases
  File "bzrlib\commands.pyo", line 665, in run_direct
  File "bzrlib\cleanup.pyo", line 122, in run_simple
  File "bzrlib\cleanup.pyo", line 156, in _do_with_cleanups
  File "bzrlib\builtins.pyo", line 1146, in run
  File "bzrlib\push.pyo", line 92, in _show_push_branch
  File "bzrlib\branch.pyo", line 1295, in create_clone_on_transport
  File "bzrlib\bzrdir.pyo", line 287, in clone_on_transport
  File "bzrlib\decorators.pyo", line 140, in read_locked
  File "bzrlib\workingtree.pyo", line 579, in clone
  File "bzrlib\bzrdir.pyo", line 1616, in create_workingtree
  File "bzrlib\workingtree_4.pyo", line 1462, in initialize
  File "bzrlib\transform.pyo", line 2253, in build_tree
  File "bzrlib\transform.pyo", line 2346, in _build_tree
  File "bzrlib\transform.pyo", line 2417, in _create_files
  File "bzrlib\transform.pyo", line 1198, in create_file
IOError: [Errno 22] Invalid argument

97.281 Transferred: 0KiB (0.0K/s r:0K ...

[Martin Pool (mbp)]

Kuno, that looks like a totally different bug, please file it as
"IOError: invalid argument in create_file"

--
Martin <http://launchpad.net/~mbp/>