Re: squatter stops when it encounters a locked mailbox?

2011-07-01 Thread Michael D. Sofka
Clement Hermann (nodens) wrote:
 Le 21/06/2011 18:28, Michael D. Sofka a écrit :
 I run squatter in a perl program that forks three parallel squatter
 processes on individual user's mailboxes. If a mailbox is locked the
 particular squatter processing the mailbox quits, but the main program
 continues to fork new processes for the remaining mailboxes. The program
 checkpoints each user, shuts down at 6 A.M., and continues where it left
 off the following day.
 Looks nice.
 
 Maybe you could share this script ? I could use a squatter with some 
 parallelization and a way to stop it when the load is starting to grow 
 (like in the morning). I guess it could be modified to use other 
 parameters to know when to stop : number of logged-in users or imap/pop 
 processes, system load...
 
 Cheers,
 


I'm looking over the paperwork needed to share the program (welcome to
21st Century academia). If I get approval, I'll consider adding other
termination/pause options. Our 24 hour load-cycle is fairly predicable.
But I can see how logged-in users, and load average would be useful.

Mike
-- 
Michael D. Sofka   sof...@rpi.edu
CMT Sr. Systems Programmer,   Email, HPC, TeX, Epistemology
Rensselaer Polytechnic Institute, Troy, NY.  http://www.rpi.edu/~sofkam/

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: squatter stops when it encounters a locked mailbox?

2011-06-21 Thread Bron Gondwana
On Tue, Jun 21, 2011 at 02:16:07AM +0200, Per olof Ljungmark wrote:
 All,
 
 While migrating a few accounts from Exchange to Cyrus ( has nothing to 
 do with the below really) and staring at log files I noted the following
 
 squatter[70553]: error locking index user/xyz: Mailbox is locked by POP 
 server
 
 and squatter bails out without indexing the remaining mailboxes. Is this 
 expected behaviour in 2.3.16?

Sorry, POP locking in cyrus before 2.4.x is a bit of a mess.  Yeah, it's
expected for some value - the bailing out kind of sucks too, but I really
don't want to try and fix 2.3.x any more.

Bron ( particularly things like this that I changed the locking architecture
   specifically to avoid! )

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: squatter stops when it encounters a locked mailbox?

2011-06-21 Thread Per olof Ljungmark
On 06/21/11 08:23, Bron Gondwana wrote:
 On Tue, Jun 21, 2011 at 02:16:07AM +0200, Per olof Ljungmark wrote:
 All,

 While migrating a few accounts from Exchange to Cyrus ( has nothing to
 do with the below really) and staring at log files I noted the following

 squatter[70553]: error locking index user/xyz: Mailbox is locked by POP
 server

 and squatter bails out without indexing the remaining mailboxes. Is this
 expected behaviour in 2.3.16?

 Sorry, POP locking in cyrus before 2.4.x is a bit of a mess.  Yeah, it's
 expected for some value - the bailing out kind of sucks too, but I really
 don't want to try and fix 2.3.x any more.

 Bron ( particularly things like this that I changed the locking architecture
 specifically to avoid! )

OK, thanks, should have read more b4 posting I suppose. We have an 
upgrade plan in the works anyway and we would not want you to spend time 
on older stuff.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: squatter stops when it encounters a locked mailbox?

2011-06-21 Thread Michael D. Sofka
Per olof Ljungmark wrote:
 All,
 
 While migrating a few accounts from Exchange to Cyrus ( has nothing to 
 do with the below really) and staring at log files I noted the following
 
 squatter[70553]: error locking index user/xyz: Mailbox is locked by POP 
 server
 
 and squatter bails out without indexing the remaining mailboxes. Is this 
 expected behaviour in 2.3.16?

I run squatter in a perl program that forks three parallel squatter
processes on individual user's mailboxes. If a mailbox is locked the
particular squatter processing the mailbox quits, but the main program
continues to fork new processes for the remaining mailboxes. The program
checkpoints each user, shuts down at 6 A.M., and continues where it left
off the following day.

Mike

-- 
Michael D. Sofka   sof...@rpi.edu
CMT Sr. Systems Programmer,   Email, HPC, TeX, Epistemology
Rensselaer Polytechnic Institute, Troy, NY.  http://www.rpi.edu/~sofkam/

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: squatter stops when it encounters a locked mailbox?

2011-06-21 Thread Clement Hermann (nodens)
Le 21/06/2011 18:28, Michael D. Sofka a écrit :
 I run squatter in a perl program that forks three parallel squatter
 processes on individual user's mailboxes. If a mailbox is locked the
 particular squatter processing the mailbox quits, but the main program
 continues to fork new processes for the remaining mailboxes. The program
 checkpoints each user, shuts down at 6 A.M., and continues where it left
 off the following day.
Looks nice.

Maybe you could share this script ? I could use a squatter with some 
parallelization and a way to stop it when the load is starting to grow 
(like in the morning). I guess it could be modified to use other 
parameters to know when to stop : number of logged-in users or imap/pop 
processes, system load...

Cheers,

-- 
Clement Hermann (nodens)
- L'air pur ? c'est pas en RL, ça ? c'est pas hors charte ?
Jean in L'Histoire des Pingouins, http://tnemeth.free.fr/fmbl/linuxsf/

Vous trouverez ma clef publique sur le serveur public pgp.mit.edu.
Please find my public key on the public keyserver pgp.mit.edu.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


squatter stops when it encounters a locked mailbox?

2011-06-20 Thread Per olof Ljungmark
All,

While migrating a few accounts from Exchange to Cyrus ( has nothing to 
do with the below really) and staring at log files I noted the following

squatter[70553]: error locking index user/xyz: Mailbox is locked by POP 
server

and squatter bails out without indexing the remaining mailboxes. Is this 
expected behaviour in 2.3.16?

Thanks,


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/