MYSQL/BZR P3: bzr doesn't explain it's doing a slow cross-format fetch
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Bazaar |
Fix Released
|
High
|
Martin Pool | ||
2.0 |
Fix Released
|
High
|
Martin Pool | ||
2.1 |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
This is a Sun/MySQL - Canonical escalation imported into Launchpad by the Canonical Support Team (internal case 6614 )
Original escalation: 2009-11-16 10:12 UTC
It takes more than 10 hours to branch mysql 5.0.
In this attempt it used > 4GB virtual memory, > 3 GB real memory, almost no CPU, almost no disk and almost no network.
Before this try, I tried to check out mysql 5.1 (but without the "time" command). I stopped the command after 8 hours (1.5G transfered, still streaming) when my machine was trashing furiously because of swapping.
This is a brand new MacBook Pro with 4GB memory, and it isn't able to cope with the memory requirements of a command line program that is supposed to download some bits.
steve:mysql austvik$ mkdir mysql
steve:mysql austvik$ cd mysql
steve:mysql austvik$ bzr init-repo .
Shared repository with trees (format: 2a)
Location:
shared repository: .
steve:mysql austvik$ time bzr branch lp:mysql-server/5.0 5.0
You have not informed bzr of your Launchpad ID, and you must do this to
write to Launchpad or access private data. See "bzr help launchpad-login".
bzr: ERROR: Connection error: while sending GET /~mysql/
real 632m55.352s
user 560m48.451s
sys 6m24.630s
steve:mysql austvik$ ls -al
total 0
drwxr-xr-x 4 austvik staff 136 Oct 19 19:49 .
drwxr-xr-x 3 austvik staff 102 Oct 19 09:58 ..
drwxr-xr-x 6 austvik staff 204 Oct 19 19:49 .bzr
drwxr-xr-x 3 austvik staff 102 Oct 19 19:49 5.0
steve:mysql austvik$ find 5.0/ | wc -l
5
steve:mysql austvik$ find .bzr | wc -l
13
steve:mysql austvik$ bzr --version
Bazaar (bzr) 2.0.1
Python interpreter: /usr/bin/python 2.6.1
Python standard library: /System/
Platform: Darwin-
bzrlib: /Library/
Bazaar configuration: /Users/
Bazaar log file: /Users/
Problems:
real 632m55.352s
How to fix:
I believe the enormous memory requirements slow things down a lot
I don't care about "bzr: ERROR: Connection error" in this bug report. It is probably a side effect of bazaar using so much memory that the whole computer becomes unresponsive over time.
Related branches
- Andrew Bennetts: Approve (uifactory)
- bzr-core: Pending requested
-
Diff: 340 lines (+128/-27)8 files modifiedNEWS (+6/-0)
bzrlib/repository.py (+12/-10)
bzrlib/smart/repository.py (+0/-7)
bzrlib/tests/blackbox/test_branch.py (+4/-0)
bzrlib/tests/test_ui.py (+29/-1)
bzrlib/ui/__init__.py (+56/-7)
bzrlib/ui/text.py (+14/-1)
bzrlib/upgrade.py (+7/-1)
summary: |
- bzr branch: unacceptable slow + MYSQL/BZR P3: bzr branch: unacceptable slow |
description: | updated |
visibility: | public → private |
summary: |
- MYSQL/BZR P3: cross format fetch is very slow + MYSQL/BZR P3: bzr doesn't explain it's doing a slow cross-format fetch |
tags: |
added: easy removed: branch |
Changed in bzr: | |
milestone: | none → 2.1.0 |
Changed in bzr: | |
assignee: | nobody → Martin Pool (mbp) |
status: | Confirmed → In Progress |
Changed in bzr: | |
importance: | Medium → High |
Changed in bzr: | |
status: | Confirmed → Fix Released |
Changed in bzr: | |
status: | Confirmed → In Progress |
Hi Jorgen,
Thanks for the bug report. I'm sorry it took so long. Looking at https:/ /code.launchpad .net/~mysql/ mysql-server/ mysql-5. 1, it looks like that branch is still in our 1.x format. I suspect the primary reason it took so long was because it was actually converting content to the new format on the fly, rather than just transferring it. I'll let one of the more network-savvy developers confirm that.
You may want to check with the MySql team as to when they plan to upgrade their branches to our new format before going much further. If it's a while away, you may need to change the format you're using locally instead of using the default 2.x one.