System I/O error on reconstruct after nuking cyrus.* files
Hello all, Is this normal? I swear to have seen people suggesting trashing cyrus.* files and running reconstruct on the user, but I'm having no luck. In this case, that was not what was attempted, but the end result is the same. The cyrus.* files are gone. See for yourself... -rw--- 1 cyrus mail 5166 2007-10-02 10:21 194. -rw--- 1 cyrus mail 13470 2007-10-02 12:30 195. -rw--- 1 cyrus mail 115255 2007-10-02 17:25 196. -rw--- 1 cyrus mail 27511 2007-10-02 23:47 197. -rw--- 1 cyrus mail 36699 2007-10-03 00:37 198. -rw--- 1 cyrus mail 23593 2007-10-03 11:40 199. -rw--- 1 cyrus mail 5020 2007-10-03 14:45 200. -rw--- 1 cyrus mail 10601 2007-10-03 21:32 201. -rw--- 1 cyrus mail 30683 2007-10-04 00:50 202. -rw--- 1 cyrus mail 59606 2007-10-04 02:33 203. -rw--- 1 cyrus mail 75449 2007-10-04 07:55 204. -rw--- 1 cyrus mail 10210 2007-10-04 09:38 205. -rw--- 1 cyrus mail 267003 2007-10-04 10:12 206. -rw--- 1 cyrus mail 80387 2007-10-04 10:57 207. -rw--- 1 cyrus mail 41473 2007-10-04 12:14 208. drwx-- 2 cyrus mail 4096 2007-10-04 18:08 Drafts drwx-- 2 cyrus mail 4096 2007-10-04 18:25 Junkmail drwx-- 2 cyrus mail 4096 2007-10-04 18:08 remote_pinerc drwx-- 2 cyrus mail 4096 2007-10-04 18:08 Sent drwx-- 2 cyrus mail 4096 2007-10-04 18:26 Trash OK Runnin cyradm as the the cyrus user... (We're running unixhierarchysep: yes, BTW) localhost lam user/darel* user/darel: darel lrswipcda cyrus lrswipcda user/darel/Drafts: darel lrswipcda cyrus lrswipcda user/darel/Junkmail: darel lrswipcda cyrus lrswipcda user/darel/Sent: darel lrswipcda cyrus lrswipcda user/darel/Trash: darel lrswipcda cyrus lrswipcda user/darel/remote_pinerc: darel lrswipcda cyrus lrswipcda localhost reconstruct -r user/darel reconstruct: System I/O error I have tried about ever possible combination of things I can think of, to no effect. Somewhere I saw touching new files with the same names and permissions, but that just generates an Invalid Mailbox error. Also, if I move cache files from another directory in there and run reconstruct, everything works, but the existing messages in the directory can't be seen. Does anyone have any suggestions? Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Quick Utilities for getting into user mail file
Hello all, Having recently moved away from mbox format, I'm at a bit of a loss dealing with seemingly trivial issues... Using mbox, I could become root on the server, and run mail -u username to view the user's mail in a quick and dirty fashion. This is handy, for instance, when the user has 20,000 emails, and wants you to get rid of certain ones. Currently, I'm modifying a pinerc file and running PC-Pine to do this if necessary. Are there any other tools available for this kind of quick and dirty mailbox manipulation? Modifying config files on a per-user basis is kind of a pain, and running webmail can be slow with huge mailboxes. Also, a related question: If a user has (again) 20,000 emails, and tell you they want to get rid of messages 1 through 18,994, can I just delete those files in mail dir, or is that gonna mess cyrus indexing up? Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Relation of filesystem to Cyrus mailbox structure
Heya folks, Is there any documentation on how Cyrus mailboxes are structured, as relative to the file system? Man. That's a poorly worded question, but I can't seem to find the best way to say it... I'm used to dealing with mbox mailboxes until very recently. The one thing that mbox format has going for it is that it's really conrete, for lack of a better word. The file in /var/mail/username is the user's inbox; No internal database or whatever. Other folders work similarly. Where I've been stuck recently is trying to figure out things like how to manipulate mailboxes by using the file system. Maybe this isn't really practical using mdir. Here's the latest: I have a user that we migrated from mbox. She has her inbox folder, which migrated fine. Then she has a couple of other folder, which migrated fine. Then she has folders within folders, and those refuse to show up, and it won't let her subscribe to them. Here's how it they're in the filesystem: /var/mail/j/user/janedoe -- Inbox: Migrated fine /var/mail/j/user/janedoe/folder1 -- Also migrated fine /var/mail/j/user/janedoe/folder1/folderA -- I can't get to show I don't think the user really NEEDS the folder called folder1 above, but wants the folders inside of it. So I tried to move folderA back one level so that it was sitting inside the /var/mail/j/user/janedoe folder, but that doesn't work. I figured I had to run a reconstruct command, but no avail there either. I guess the fundamental question here are these: - If I make changes to the file system, how do I get these reflected in Cyrus mailbox views? - Is this even a good idea, or something to be avoided, and done another way? - Is there any documentation on how the Cyrus internal database on mailboxes, quotas, and subscriptions work? Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Relation of filesystem to Cyrus mailbox structure
I am currently pulling my hair out, trying to get this to work... Lemme show you a cyradm session, with some carriage returns thrown in for reading ease: Incidentally, we're running unixhierarchysep: yes. localhost ls -l /var/mail/c/user/calvizio -rw-r--r-- 1 cyrus mail 1911537 2007-09-07 02:43 1. -rw-r--r-- 1 cyrus mail 3717492 2007-09-07 02:43 2. -rw-r--r-- 1 cyrus mail6364 2007-09-07 02:43 3. -rw--- 1 cyrus mail 32252 2007-09-14 11:52 cyrus.cache -rw--- 1 cyrus mail 183 2007-09-14 12:32 cyrus.header -rw--- 1 cyrus mail1636 2007-09-14 11:52 cyrus.index localhost lam user/calvizio* user/calvizio: cyrus lrswipcda calvizio lrswipcda user/calvizio/INBOX: cyrus lrswipcda calvizio lrswipcda localhost cm user/calvizio/INBOX createmailbox: Mailbox already exists localhost sam user/calvizio cyrus all localhost sam user/calvizio/INBOX cyrus all setaclmailbox: cyrus: lrswipcda: System I/O error localhost reconstruct user/calvizio localhost reconstruct user/calvizio/INBOX reconstruct: System I/O error localhost cm user/calvizio/INBOX createmailbox: Mailbox already exists localhost dm user/calvizio/INBOX deletemailbox: System I/O error AGH I tried actually creating the dirs in the file system to match, and re-owning them to cyrus:mail, to no avail. Furthermore, ONE of the time I tried to create the mailbox, I typed cm INBOX instead of cm user/calvizio/INBOX by mistake, and now I have this wacko little mailbox called INBOX at the top of everything: localhost lm INBOX (\HasNoChildren) I can't seem to delete this little monster either Any ideas? Thanks, Rick Kunkel On Fri, 14 Sep 2007, Joseph Brennan wrote: --On Friday, September 14, 2007 8:27 -0700 Rick Kunkel [EMAIL PROTECTED] wrote: Where I've been stuck recently is trying to figure out things like how to manipulate mailboxes by using the file system. Maybe this isn't really practical using mdir. Here's the latest: I have a user that we migrated from mbox. She has her inbox folder, which migrated fine. Then she has a couple of other folder, which migrated fine. Then she has folders within folders, and those refuse to show up, and it won't let her subscribe to them. Here's how it they're in the filesystem: /var/mail/j/user/janedoe -- Inbox: Migrated fine /var/mail/j/user/janedoe/folder1 -- Also migrated fine /var/mail/j/user/janedoe/folder1/folderA -- I can't get to show I don't think the user really NEEDS the folder called folder1 above, but wants the folders inside of it. So I tried to move folderA back one level so that it was sitting inside the /var/mail/j/user/janedoe folder, but that doesn't work. I figured I had to run a reconstruct command, but no avail there either. I guess the fundamental question here are these: - If I make changes to the file system, how do I get these reflected in Cyrus mailbox views? It's less painful if you can use Cyrus to do this stuff. I know :-) The main reason you might have to do this would be restoring entire mailboxes off backups. Given /var/mail/j/user/janedoe/folder1/folderA , Cyrus might have three mailboxes named user.janedoe, user.janedoe.folder, and user.janedoe.folder.folderA, but not necessarily. cyradm will show you what folders exist, in Cyrus's view, and it lets you create, delete, and rename mailboxes to make the Cyrus view be what you want it to be. Cyrus will move the files around in the filesystem accordingly. To do batch work a perl script can use Cyrus::IMAP::Admin to do what cyradm would do. When we migrated from mbox, we created Cyrus mailboxes for the directories too. For ~janedoe/mail/foo/bar (mbox file) we created both user.janedoe.foo and user.janedoe.foo.bar, even though the user had never stored mail in foo (since it was a directory). This seemed simpler than having to explain later that foo could be part of a mailbox name but not exist as a mailbox! Joseph Brennan Lead Email Systems Engineer Columbia University Information Technology Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus lagging accepting IMAP connections
Hello all, I'm new to Cyrus. Historically, I've used Qpopper, Sendmail, and UW IMAP. We recently switched to Cyrus for IMAP. It came highly recommended... We've got this on a darned burly machine, running some very recent version of Debian, with a fast CPU, 4GB RAM, and fast SAS drives. When testing the thing, before it went into production, everything worked awesomely. However, having loaded it with 2300 users, it's suddenly acting erratically. (Incidentally, of the 2300 users, almost all are POP users, which seems to be working fine. A few hundred -- at most -- are IMAP, and they are split between squirrelmail users and a handful that use standard MUAs.) The server acts as if it's low on resources or something, or has hit some kind of connection limit. It's speedy as heck WHEN it does it what's it's supposed to, but that initial connection is sketchy. For the first 30 seconds after you restart it, it's generally good, but it goes downhill from there. Testing with telnet exhibits this behavior. Here's a sample session... # telnet mail 143 Trying xxx.xxx.xxx.xxx... Connected to mail. Escape character is '^]'. And then it just kinda sits. Sometimes, after 30 seconds or so * OK mail Cyrus IMAP4 v2.2.13-Debian-2.2.13-10 server ready We're currently using the following line in cyrus.conf for imapd: imapcmd=imapd listen=imap prefork=1 We've messed with tons of different settings here, to little avail. There don't seem to be any salient log entries. Anyone have any ideas? Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus lagging accepting IMAP connections
Hm! I did some additional reading after receiving this, and it seems that pursuing the random number generator path is the way to go... A coupla quick questions (that I think are likely going to be answered with it depends answers): 1. Is nuking /dev/random in the way described going to have adverse affects on other elements/services? 2. If, andter going this, I want to restore /dev/random to what it was beforehand, how would I go about doing that? 3. We used aptitude (in all its inflexibility) to install sasl. Does anyone know if there is an easy way to change this compile-time flag, but still use aptitude to install SASL? (Probably off-topic for this list, I admit.) Thanks! Rick Kunkel On Tue, 11 Sep 2007, Scott M. Likens wrote: Rick, This problem is related to Debian using /dev/random instead of /dev/urandom. Short term solution would be to rm /dev/random mknod /dev/random c 1 9 The other solution for you would be to recompile the sources and change the configure to use urandom instead of random... You can search the archives and search for urandom on how to do that. Scott Rick Kunkel wrote: Hello all, I'm new to Cyrus. Historically, I've used Qpopper, Sendmail, and UW IMAP. We recently switched to Cyrus for IMAP. It came highly recommended... We've got this on a darned burly machine, running some very recent version of Debian, with a fast CPU, 4GB RAM, and fast SAS drives. When testing the thing, before it went into production, everything worked awesomely. However, having loaded it with 2300 users, it's suddenly acting erratically. (Incidentally, of the 2300 users, almost all are POP users, which seems to be working fine. A few hundred -- at most -- are IMAP, and they are split between squirrelmail users and a handful that use standard MUAs.) The server acts as if it's low on resources or something, or has hit some kind of connection limit. It's speedy as heck WHEN it does it what's it's supposed to, but that initial connection is sketchy. For the first 30 seconds after you restart it, it's generally good, but it goes downhill from there. Testing with telnet exhibits this behavior. Here's a sample session... # telnet mail 143 Trying xxx.xxx.xxx.xxx... Connected to mail. Escape character is '^]'. And then it just kinda sits. Sometimes, after 30 seconds or so * OK mail Cyrus IMAP4 v2.2.13-Debian-2.2.13-10 server ready We're currently using the following line in cyrus.conf for imapd: imap cmd=imapd listen=imap prefork=1 We've messed with tons of different settings here, to little avail. There don't seem to be any salient log entries. Anyone have any ideas? Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html !DSPAM:46e6fb8c80805986443841! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
User Bulletin implementable with Cyrus
Hello all, I'm interested in sending bulletins to all email user. We're running Cyrus for POP and IMAP, and Postfix for SMTP. I'm not sure which of these pieces of software would be responsible, but I figured I'd ask here to see if this is do-able in Cyrus. It might seem bonkers that I would assume that the POP or IMAP server would do this, but I'm new to Cyrus (and Postfix), and we were previously running Qualcomm's Qpopper for POP, and that *DID* have a user bulletin feature. Obviously, I could write a script that would do this, but I figured it'd be much more elegant and portable if I could do it with the software right out of the box. I poked around FAQs and Google, but didn't see much. Like I said, I figured I'd ask here though. I'm fully capable of RTFM, so if you just want to point me in the right direction, that'd be OK too. Thanks, Rick Kunkel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
