Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-28 Thread Adam Tauno Williams
On Tue, 2006-11-28 at 08:01 -0600, Gary Mills wrote: > On Tue, Nov 28, 2006 at 11:54:55AM +0300, Igor Zhbanov wrote: > > I need to build mail system without using uncommon hardware such as > > shared storage connected via SCSI or fiber channel. I need > > "software-only" solution. Can you recommend

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-28 Thread Gary Mills
On Tue, Nov 28, 2006 at 11:54:55AM +0300, Igor Zhbanov wrote: > I need to build mail system without using uncommon hardware such as > shared storage connected via SCSI or fiber channel. I need > "software-only" solution. Can you recommend me what kind of clustered > filesystem and/or network block

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-28 Thread Simon Matter
> 2006/11/27, Janne Peltonen <[EMAIL PROTECTED]>: >> On Sat, Nov 25, 2006 at 11:56:20PM +0300, Igor Zhbanov wrote: >> > So, what is the best way to build load-balancing Cyrus IMAP cluster? >> > Nginx, perdition, Cyrus IMAP Aggregator, Cyrus IMAP murder, Cyrus IMAP >> > replication? >> >> You forgot

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-28 Thread Igor Zhbanov
2006/11/27, Janne Peltonen <[EMAIL PROTECTED]>: On Sat, Nov 25, 2006 at 11:56:20PM +0300, Igor Zhbanov wrote: > So, what is the best way to build load-balancing Cyrus IMAP cluster? > Nginx, perdition, Cyrus IMAP Aggregator, Cyrus IMAP murder, Cyrus IMAP > replication? You forgot the simplest one

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-27 Thread Chaskiel M Grundman
--On Friday, November 24, 2006 08:08:05 AM +0100 Simon Matter <[EMAIL PROTECTED]> wrote: What is really different between using berkeley or skiplist DB for the cluster? I'm also running without BDB but I want to understand how berkeley databases are different to skiplist databases in a cluster

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-27 Thread Janne Peltonen
On Sat, Nov 25, 2006 at 11:56:20PM +0300, Igor Zhbanov wrote: > So, what is the best way to build load-balancing Cyrus IMAP cluster? > Nginx, perdition, Cyrus IMAP Aggregator, Cyrus IMAP murder, Cyrus IMAP > replication? You forgot the simplest one: Cyrus IMAP on a cluster with no replication, no

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-26 Thread Attila Nagy
On 2006. 11. 16. 22:46, Bron Gondwana wrote: Seriously, see the other response, DbMail might be what you want - personally I'd put blobs in the filesystem (actually, my SHA1 based VFS system, but that's a different story) and metadata in mysql... if I was writing my perfect IMAP solution, which I

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-25 Thread Igor Zhbanov
So, what is the best way to build load-balancing Cyrus IMAP cluster? Nginx, perdition, Cyrus IMAP Aggregator, Cyrus IMAP murder, Cyrus IMAP replication? And can you tell me what problems to high-availability can happen when using Cyrus IMAP replication? In what situations it is unreliable? And is

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-23 Thread Simon Matter
>> 2) Several people on this list have confirmed that they are running >> cyrus-imapd clusters on shared storage (SAN) which works fine with a >> cluster filesystem. That tells me that shared access to cyrus >> databases >> works fine as long as the filesystem used provides proper >> locking, which

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-23 Thread Sarah Walters
All, > -Original Message- > From: Janne Peltonen [mailto:[EMAIL PROTECTED] > On Thu, Nov 23, 2006 at 08:42:16AM +0100, Simon Matter wrote: > [...] > > 2) Several people on this list have confirmed that they are running > > cyrus-imapd clusters on shared storage (SAN) which works fine wit

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-23 Thread Sarah Walters
> -Original Message- > From: Simon Matter [mailto:[EMAIL PROTECTED] > Hi Sarah, > > I'm really confused now. > > 1) You are talking about NAS as a possible solution and I > don't know how > that should work if NFS doesn't work. Until now I thought a > NAS device is > an embedded fil

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-23 Thread Amos
On 11/23/06, Janne Peltonen <[EMAIL PROTECTED]> wrote: You're completely correct, this is the kind of system I'm building and others have had in production use (see the thread on clusters, GFS and HA, for instance - begins at http://www.mail-archive.com/info-cyrus@lists.andrew.cmu.edu/msg30675.ht

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-23 Thread Janne Peltonen
Hi all, just to comment on one isolated point: On Thu, Nov 23, 2006 at 08:42:16AM +0100, Simon Matter wrote: [...] > 2) Several people on this list have confirmed that they are running > cyrus-imapd clusters on shared storage (SAN) which works fine with a > cluster filesystem. That tells me that

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Simon Matter
> Marcelo et al, > >> -Original Message- >> From: [EMAIL PROTECTED] >> [mailto:[EMAIL PROTECTED] On Behalf Of >> Marcelo Maraboli >> >> thanks for the input, I know wishing 100% is only available >> with a gogle size amount of money ;), but I am looking >> for a CYRUS IMAP server soluti

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Amos
On 11/22/06, Sarah Walters <[EMAIL PROTECTED]> wrote: takes us right back to the "MySQL" angle on this conversation! While I wouldn't want to see the actual mail stored in MySQL, you could make an argument for storing the mailboxes database in that way. I seem to recall that's what they do with

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Sarah Walters
Wesley et al, > -Original Message- > From: Wesley Craig [mailto:[EMAIL PROTECTED] > Sent: Thursday, 23 November 2006 1:17 PM > To: Sarah Walters > Cc: info-cyrus@lists.andrew.cmu.edu > Subject: Re: Cyrus IMAP and MySQL mailboxes (Building > load-balancing cluster

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Wesley Craig
On 22 Nov 2006, at 19:10, Sarah Walters wrote: Only a single machine can have write privileges to the mailboxes database at a time. Actually, only a single process can be writing to a mailboxes database at a time. Then, assuming the database is closed between changes (can a developer ple

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Marcelo Maraboli
Dear Sarah thank you for your thorough answer ! maybe we can wait and see if Cyrus 2.3.7 and mupdate can do the job along with FreeBSD+PEN+VRRPD...i´ll test it. best regards, Sarah Walters wrote: Marcelo et al, -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-22 Thread Sarah Walters
Marcelo et al, > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Marcelo Maraboli > > thanks for the input, I know wishing 100% is only available > with a gogle size amount of money ;), but I am looking > for a CYRUS IMAP server solution simi

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancingcluster)]

2006-11-17 Thread stevel
ber 2006 10:32 AM > > To: info-cyrus@lists.andrew.cmu.edu > > Subject: Re: Cyrus IMAP and MySQL mailboxes (Building > > load-balancing cluster) > > > > 2006/11/17, Sarah Walters <[EMAIL PROTECTED]>: > > > > > > The main problem is to build a sha

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Andrew Morgan
On Fri, 17 Nov 2006, Igor Zhbanov wrote: 2006/11/17, Adam Tauno Williams <[EMAIL PROTECTED]>: > Yes, I know how failover cluster works. But what if one server > (active) can't process such a load? Suppose, we plan to have 100 000 > users working actively with mail. I understand that it is possi

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Igor Zhbanov
2006/11/17, Adam Tauno Williams <[EMAIL PROTECTED]>: > Yes, I know how failover cluster works. But what if one server > (active) can't process such a load? Suppose, we plan to have 100 000 > users working actively with mail. I understand that it is possible to > use one monstrous server to take a

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Rudy Gevaert
Bron Gondwana wrote: If your mail system is so small you can afford to put all your users email in memory, then good for you. Otherwise, mysql replication won't buy you much more than Cyrus replication with a few good monitoring scripts (and yes, we have failed real cyrus replications off faile

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Adam Tauno Williams
> Yes, I know how failover cluster works. But what if one server > (active) can't process such a load? Suppose, we plan to have 100 000 > users working actively with mail. I understand that it is possible to > use one monstrous server to take all of the load, but I am interested > in load-balancing

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Igor Zhbanov
2006/11/17, Bron Gondwana <[EMAIL PROTECTED]>: On Fri, Nov 17, 2006 at 11:54:39AM +1000, Sarah Walters wrote: > Why don't you look at throwing two beefy boxes at this problem in a > hot-spare > configuration? Have a single large box managing the mail and a heartbeat > so > that if one goes down t

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Bron Gondwana
On Fri, Nov 17, 2006 at 03:31:52AM +0300, Igor Zhbanov wrote: > Yes, I need the cluster exactly. Have I lots of domains, I could store > mailboxes of each domain on separate server. But I have only one big > domain. So, I need to spread mailboxes on one domain across several > servers. And than I n

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Bron Gondwana
On Fri, Nov 17, 2006 at 11:54:39AM +1000, Sarah Walters wrote: > Why don't you look at throwing two beefy boxes at this problem in a > hot-spare > configuration? Have a single large box managing the mail and a heartbeat > so > that if one goes down the other immediately takes over its IP and just >

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Igor Zhbanov
2006/11/17, Sarah Walters <[EMAIL PROTECTED]>: > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Igor Zhbanov > Sent: Friday, 17 November 2006 10:32 AM > To: info-cyrus@lists.andrew.cmu.edu > Subject: Re: Cyrus IMAP an

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Simon Matter
> 2006/11/17, Sarah Walters <[EMAIL PROTECTED]>: >> > > > The main problem is to build a shared storage that can >> > survive server >> > > > crashes, where mail will be stored. >> > > >> > > Use a SAN. >> > First of all, such SAN must be very reliable itself. Second, it must >> > support some kind

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Sarah Walters
> -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Igor Zhbanov > Sent: Friday, 17 November 2006 10:32 AM > To: info-cyrus@lists.andrew.cmu.edu > Subject: Re: Cyrus IMAP and MySQL mailboxes (Building > load-balancing

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Igor Zhbanov
2006/11/17, Sarah Walters <[EMAIL PROTECTED]>: > > > The main problem is to build a shared storage that can > survive server > > > crashes, where mail will be stored. > > > > Use a SAN. > First of all, such SAN must be very reliable itself. Second, it must > support some kind of global locking me

RE: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Sarah Walters
> > > The main problem is to build a shared storage that can > survive server > > > crashes, where mail will be stored. > > > > Use a SAN. > First of all, such SAN must be very reliable itself. Second, it must > support some kind of global locking mechanism, so several nodes can > use lock to prot

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Igor Zhbanov
2006/11/16, [EMAIL PROTECTED] <[EMAIL PROTECTED]>: > The short question is: can Cyrus IMAP take mail from MySQL tables? I'm not aware of any such backend; and I think it would be a crazy method to store mail and performance would suck. You may *THINK* MySQL is fast, it isn't - certainly not c

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Bron Gondwana
On Thu, Nov 16, 2006 at 07:24:32PM +0300, Igor Zhbanov wrote: > The main problem is to build a shared storage that can survive server > crashes, where mail will be stored. I have found that MySQL-cluster is > reliable and fast. My god. You are aware that MySQL-cluster only supports in-memory dat

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread adam
The short question is: can Cyrus IMAP take mail from MySQL tables? I'm not aware of any such backend; and I think it would be a crazy method to store mail and performance would suck. You may *THINK* MySQL is fast, it isn't - certainly not compared to a filesystem [doubly so when dealli

Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Igor Zhbanov
Hello! The short question is: can Cyrus IMAP take mail from MySQL tables? And where can I read about how to setup it? The long story is now. I need to setup load-balancing mail system. I culdn't find open-source mail systems that have genuine cluster support, so I have decided to build cluster o

Re: imap and mysql

2005-05-18 Thread websrvr
On May 18, 2005, at 04:17 PM, Jules Agee wrote: websrvr wrote: I'm very new to the list so I have no idea what has been previously discussed, I did try to examine the list archives but was unsuccessful in finding anything that was helpful. Does anyone on this list with Mac OSX knowledge/experi

Re: imap and mysql

2005-05-18 Thread Jules Agee
websrvr wrote: > I'm very new to the list so I have no idea what has been previously > discussed, I did try to examine the list archives but was unsuccessful > in finding anything that was helpful. > > Does anyone on this list with Mac OSX knowledge/experience know how to > get imap to authent

imap and mysql

2005-05-17 Thread websrvr
I'm very new to the list so I have no idea what has been previously discussed, I did try to examine the list archives but was unsuccessful in finding anything that was helpful. Does anyone on this list with Mac OSX knowledge/experience know how to get imap to authenticate users who are cont