Bug#712060: Assistant: uses lots of CPU

2013-06-23 Thread Felipe Sateler
On Thu, Jun 20, 2013 at 10:49 AM, Joey Hess jo...@debian.org wrote: Felipe Sateler wrote: I've been thinking, could git-annex nice and ionice itself? I'm mostly a dummy user here, git-annex autostarts on boot, so I can't start it niced myself. This would also help with large annexes on slow

Bug#712060: Assistant: uses lots of CPU

2013-06-23 Thread Joey Hess
Felipe Sateler wrote: According to the ionice man page, since linux 2.6.25 the Idle priority class can be assigned by non-root users. ionice -c 3 command seems to work as advertised. And indeed git-annex assistant --autostart uses this now (git version). -- see shy jo signature.asc

Bug#712060: Assistant: uses lots of CPU

2013-06-23 Thread Felipe Sateler
On Sun, Jun 23, 2013 at 1:20 PM, Joey Hess jo...@debian.org wrote: Felipe Sateler wrote: According to the ionice man page, since linux 2.6.25 the Idle priority class can be assigned by non-root users. ionice -c 3 command seems to work as advertised. And indeed git-annex assistant --autostart

Bug#712060: Assistant: uses lots of CPU

2013-06-20 Thread Felipe Sateler
Hi Joey On Sat, Jun 15, 2013 at 2:44 PM, Joey Hess jo...@debian.org wrote: Felipe Sateler wrote: My setup is as follows: I have my annex on my laptop, and on the usb drive I have 2 annexes: a full backup annex, and an archive annex (BTW, why don't full backup annexes count as archive

Bug#712060: Assistant: uses lots of CPU

2013-06-20 Thread Joey Hess
Felipe Sateler wrote: I've been thinking, could git-annex nice and ionice itself? I'm mostly a dummy user here, git-annex autostarts on boot, so I can't start it niced myself. This would also help with large annexes on slow drives. Can you get me the ionice command line which works without

Bug#712060: Assistant: uses lots of CPU

2013-06-15 Thread Joey Hess
Felipe Sateler wrote: My setup is as follows: I have my annex on my laptop, and on the usb drive I have 2 annexes: a full backup annex, and an archive annex (BTW, why don't full backup annexes count as archive annexes?). I have some files archived, so the archive annex is not empty. I've

Bug#712060: Assistant: uses lots of CPU

2013-06-14 Thread Joey Hess
Are you sure you're using direct mode? I see many indications your repository contains lots of symlinks, which would suggest it's in indirect mode. Do any of these files have the same contents? In particular, I suspect one of them, and probably all of them are empty. vboxshare/Web Platform

Bug#712060: Assistant: uses lots of CPU

2013-06-14 Thread Felipe Sateler
On Fri, Jun 14, 2013 at 11:19 AM, Joey Hess jo...@debian.org wrote: Are you sure you're using direct mode? I see many indications your repository contains lots of symlinks, which would suggest it's in indirect mode. Yes, it is in direct mode. But now I see there are a few directories that

Bug#712060: Assistant: uses lots of CPU

2013-06-13 Thread Felipe Sateler
On Wed, Jun 12, 2013 at 1:39 PM, Joey Hess jo...@debian.org wrote: Felipe Sateler wrote: I understand that. However, I do not know what git-annex is doing to detect changes so I certainly see much less than you ;) Would it be possible to do a less-strict version of the change detector? It's

Bug#712060: Assistant: uses lots of CPU

2013-06-13 Thread Joey Hess
Felipe Sateler wrote: OK, so not much can be done to reduce usage. However, I've noticed that several files are being transferred several times. My setup is as follows: I have my annex on my laptop, and on the usb drive I have 2 annexes: a full backup annex, and an archive annex (BTW, why

Bug#712060: Assistant: uses lots of CPU

2013-06-12 Thread Felipe Sateler
Package: git-annex Version: 4.20130601 Severity: normal I have a relatively large (26 Gb, 17k files) annex in direct mode, and have the assistant configured to autostart on boot. The startup scan takes about 2 minutes if no usb drive with annexes are attached, much longer if one is attached, at

Bug#712060: Assistant: uses lots of CPU

2013-06-12 Thread Joey Hess
Felipe Sateler wrote: I have a relatively large (26 Gb, 17k files) annex in direct mode, and have the assistant configured to autostart on boot. The startup scan takes about 2 minutes if no usb drive with annexes are attached, much longer if one is attached, at full CPU speed. This happens

Bug#712060: Assistant: uses lots of CPU

2013-06-12 Thread Felipe Sateler
On Wed, Jun 12, 2013 at 12:32 PM, Joey Hess jo...@debian.org wrote: Felipe Sateler wrote: I have a relatively large (26 Gb, 17k files) annex in direct mode, and have the assistant configured to autostart on boot. The startup scan takes about 2 minutes if no usb drive with annexes are

Bug#712060: Assistant: uses lots of CPU

2013-06-12 Thread Joey Hess
Felipe Sateler wrote: I understand that. However, I do not know what git-annex is doing to detect changes so I certainly see much less than you ;) Would it be possible to do a less-strict version of the change detector? It's statting files. So no, there's not much less it can do and still do