Re: Archiving emails with Cyrus
On Nov 24, 2008, at 10:36 AM, John Madden wrote: > On Monday 24 November 2008 08:56:35 am Alexandros Gougousoudis wrote: >> There must be a process in cyrus, which copies these emails into a >> (zip)-file and/or into a database, to have them somehow accessable. >> Cyrus must do this with the administrator account, because the imap >> credentials of all the users are of course not known to us. Or we >> install an "archive"-useraccount which has access to all mailboxes. > > Here's an idea I've been toying with for an upcoming implementation... > > Let's say you create everyone's Inbox/Drafts/etc mailboxes on your > reasonably > fast (expensive/small?) storage with a relatively low mailbox > quota. You > then create user.username.archive on a separate Cyrus partition, > perhaps > residing on SATA with a relatively high mailbox quota. Inform your > users > that to store mail and keep their Inbox available they should move > it there. > You can then use Cyrus' built-in search mechanisms (squat) and have > to change > very little. I've been toying with the idea of replacing the cyrus routine(s?) that open/read the MESSAGE#. spool files with something that also understands gzipped data. That way I can selectively gzip messages based on some algorithm involving message size and lack of activity. I haven't yet had the chance to do the analysis on the spool to see what sort of space gains I could expect. Nik Conwell Systems Programming Boston University Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Archiving emails with Cyrus
On Monday 24 November 2008 08:56:35 am Alexandros Gougousoudis wrote: > There must be a process in cyrus, which copies these emails into a > (zip)-file and/or into a database, to have them somehow accessable. > Cyrus must do this with the administrator account, because the imap > credentials of all the users are of course not known to us. Or we > install an "archive"-useraccount which has access to all mailboxes. Here's an idea I've been toying with for an upcoming implementation... Let's say you create everyone's Inbox/Drafts/etc mailboxes on your reasonably fast (expensive/small?) storage with a relatively low mailbox quota. You then create user.username.archive on a separate Cyrus partition, perhaps residing on SATA with a relatively high mailbox quota. Inform your users that to store mail and keep their Inbox available they should move it there. You can then use Cyrus' built-in search mechanisms (squat) and have to change very little. John -- John Madden Sr. UNIX Systems Engineer Ivy Tech Community College of Indiana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Archiving emails with Cyrus
> Adam Tauno Williams schrieb: > > Are you looking to archive message for data-retention or because you > > need to recover capacity? > I'll need both, sooner or later. For the moment it'll be enough to gain > some more capacity. Thanks for your answer. > >> Thunderbird offers the possibility to mark a mail with an editable > >> Keyword (right mouseclick) even as a bulk operation on all selected emails. > > Does that actually get saved to the server? Or just in TB's cache? > Good question. I played around a bit, and looked in the cyrus mail > spool, but it seems these marks are not transferred back to the server. What I expected, > > plication to do some management of Cyrus. Currently it profiles a > > mailstore and creates a graph relating age of messages to storage > > space consumed. > I could do that with php, but if the users can't mark their messages to > be archived, than it'll not be flexible enough. I can do that, just by > date, but that's not what I want. It's a bummer that basically no clients support annotation. Probably setting up an archive folder is the only workable solution. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Archiving emails with Cyrus
Hi Adam, Adam Tauno Williams schrieb: > Are you looking to archive message for data-retention or because you > need to recover capacity? > > I'll need both, sooner or later. For the moment it'll be enough to gain some more capacity. Thanks for your answer. >> Thunderbird offers the possibility to mark a mail with an editable >> Keyword (right mouseclick) even as a bulk operation on all selected emails. >> > Does that actually get saved to the server? Or just in TB's cache? > > Good question. I played around a bit, and looked in the cyrus mail spool, but it seems these marks are not transferred back to the server. > plication to do some management of Cyrus. Currently it profiles a > mailstore and creates a graph relating age of messages to storage > space consumed. > I could do that with php, but if the users can't mark their messages to be archived, than it'll not be flexible enough. I can do that, just by date, but that's not what I want. cu Alex Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Archiving emails with Cyrus
> we use Cyrus 2.2 on a Debian Etch Linux with Sasl and Thunderbird as a > IMAP mailclient for our users. The problem is, that the mailboxes become > very big, so I look for an automatic archiving software, which takes the > mails out of the mailbox into a file and a searchable database. Are you looking to archive message for data-retention or because you need to recover capacity? > Thunderbird offers the possibility to mark a mail with an editable > keyword (right mouseclick) even as a bulk operation on all selected emails. Does that actually get saved to the server? Or just in TB's cache? > So my plan is, that the user marks all mails which can be archived with > that keyword (lets say "archive"), or move them to a subfolder "archive". > There must be a process in cyrus, which copies these emails into a > (zip)-file and/or into a database, to have them somehow accessable. > Cyrus must do this with the administrator account, It should be trivial to write an IMAP tool that will archive messages. I'm curious because I am currently working on a .NET/Gtk# application to do some management of Cyrus. Currently it profiles a mailstore and creates a graph relating age of messages to storage space consumed. > because the imap > credentials of all the users are of course not known to us. Or we > install an "archive"-useraccount which has access to all mailboxes. Recommend the second, I try never to connect to the box as the cyrus account. Just grant appropriate access to the appropriate resources. > Does something like this exist? Where to look for? Not to my knowledge. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Archiving emails with Cyrus
Hi, we use Cyrus 2.2 on a Debian Etch Linux with Sasl and Thunderbird as a IMAP mailclient for our users. The problem is, that the mailboxes become very big, so I look for an automatic archiving software, which takes the mails out of the mailbox into a file and a searchable database. Thunderbird offers the possibility to mark a mail with an editable keyword (right mouseclick) even as a bulk operation on all selected emails. So my plan is, that the user marks all mails which can be archived with that keyword (lets say "archive"), or move them to a subfolder "archive". There must be a process in cyrus, which copies these emails into a (zip)-file and/or into a database, to have them somehow accessable. Cyrus must do this with the administrator account, because the imap credentials of all the users are of course not known to us. Or we install an "archive"-useraccount which has access to all mailboxes. Does something like this exist? Where to look for? Maybe Opensource? Please give a hint Thanks Alex Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
