[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
FWIW, it's possible to work around this by using git-svn and then converting to bzr with fastimport or bzr-git. In my tests (Bug 243939, from 2008), I found that git-svn used at least an order of magnitude less RAM and ran in a fraction of the time as bzr- svn. However, the workaround won't allow you to 'bzr pull' and get updates from upstream svn, so it may or may not be appropriate. It's only really useful for one-time one-way conversions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
I'm happy to bump this to "Importance: high", but that won't actually change how quickly it's adressed. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
Unfortunately my spare time is limited and this is a non-trivial problem. I don't have time to look at it, but patches are more than welcome if anybody else is interested in hacking on this. ** Changed in: bzr-svn Status: Confirmed => Triaged ** Changed in: bzr-svn (Ubuntu) Status: Confirmed => Triaged ** Changed in: bzr-svn Milestone: 1.1.1 => None ** Changed in: bzr-svn Importance: Medium => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
Found a workaround: make an additional 20Gb swap space. Once main memory starts running out, it will use swap. This way I was able to at least finish my intended bzr branch. (Within a vbox session adding swap space is quite easy. Add an additional VDI and format as swap. FC 17 picked up on the extra swap without any additional configuration necessary). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
Re-questing re-triage. This bug is major. It took quite a while to locate this bug on Launchpad due to the non- descriptiveness of the issue: the only thing you get to see is "killed". As there are 14 people already listed here as affected, it is to be expected that the total number of users affected is large. I am getting this bug while trying to pull percona-server under FC17 running in vbox with 2Gb of memory assigned. When trying to up the memory assigned to the vm, the pull quickly consumed 4+Gb and eventually lead to host os/vbox OOM errors! PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 1576 - 20 0 4576m 4.2g 3872 S 14.6 74.6 2:29.86 bzr Could we have this looked at? bzr version: 2.5.0 uname: 3.4.6-2.fc17.x86_64 vbox: 4.1.18 r78361 (host OS: Win7 HP SP1) ** Changed in: bzr-svn Status: Triaged => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
I am trying to import a single project from an svn repository that has multiple projects. We have almost 40 revisions across all those projects. Even limiting the number of revisions pulled to 200 results in huge memory usage - in my case in excess of 10GB. The memory seems to go up when bzr-svn is looking for tags. I was surprised to see that even though I had told it to import the first 500 revisions when it came to looking for tags it searced all the svn revisions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories To manage notifications about this bug go to: https://bugs.launchpad.net/bzr-svn/+bug/191731/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
** Changed in: bzr-svn Milestone: 0.6.0 => 2.0.0 ** Changed in: bzr-svn Milestone: 2.0.0 => 1.1.0 ** Changed in: bzr-svn Milestone: 1.1.0 => 1.1.1 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
** Changed in: bzr-svn Assignee: Jelmer Vernooij (jelmer) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/191731 Title: Memory problems prevent branch of very large svn repositories -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
Jaco, this isn't really a workaround as it doesn't get you any of the history. ** Changed in: bzr-svn Assignee: (unassigned) => Jelmer Vernooij (jelmer) -- Memory problems prevent branch of very large svn repositories https://bugs.launchpad.net/bugs/191731 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
A workaround for this is to disable the svn plugin and then use Bazaar in conjunction with SVN. For windows XP run the following commands in a shell from the folder where you want the repository: 1. move "C:\Program Files\Bazaar\plugins\svn" "C:\Program Files\Bazaar\svnpluginbroken" 2. echo .svn/ >> .bzrignore 3. bzr init 4. bzr add 5. bzr commit -m Init Lastly tell SVN to ignore the .bzr folder if you want otherwise commit it back to SVN. -- Memory problems prevent branch of very large svn repositories https://bugs.launchpad.net/bugs/191731 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
This also affects repositories with single large revisions, as opposed to just repositories with lots of revisions. Case : Revision 3 of a repository contains the add of 7 folders, each containing three large CSV table files (respectively 2 files of ~ 60MB and one file of ~ 25MB). bzr consumes over 2.1GB of memory and slowly requests more data from server. Eventually, server truncates the connection as a timeout. (sorry, I can't give you access to the repository in question because it contains material that is not under an open license). -- Memory problems prevent branch of very large svn repositories https://bugs.launchpad.net/bugs/191731 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
** Changed in: bzr-svn Milestone: 0.4.13 => 0.6.0 -- Memory problems prevent branch of very large svn repositories https://bugs.launchpad.net/bugs/191731 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 191731] Re: Memory problems prevent branch of very large svn repositories
Importing OpenOffice.org now takes 3.3Gb of RAM, which could be less but is not unreasonable. ** Summary changed: - Memory problems prevent branch of large svn repositories + Memory problems prevent branch of very large svn repositories -- Memory problems prevent branch of very large svn repositories https://bugs.launchpad.net/bugs/191731 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
