Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread andris . reinman 
It’s not exactly NFS, we’re experimenting with a custom built mail server that 
uses clustered (sharded+replicated) MongoDB for mail store. Emails are stored 
in a custom MongoDB optmized format which allows for example to deduplicate and 
decode attachments to save storage space.

In the end we want to migrate ~30TB of messages from our existing Courier based 
system to this new one we’re building but for now the largest test system 
deployed handles around 800GB, so it’s not too well tested yet to be suitable 
for actual large scale production, hopefully we get there in a year or so. For 
smaller installs it should be in a good enough state already.

You can find the sources here: https://github.com/nodemailer/wildduck

Best regards,
Andris Reinman

> On 28 Sep 2017, at 01:33, Rolf E. Sonneveld  
> wrote:
> 
> Hi,
> 
> is there anyone working in a larger/'more demanding' environment, using NFS 
> for his/her message store, where there is a business requirement of High 
> Availability? If so, what commercial or open source storage solution is used? 
> I have a similar requirement for a project and am looking for 
> suggestions/options for what storage to use.
> 
> Regards,
> /rolf
> 
> ___
> mailop mailing list
> mailop@mailop.org
> https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

[mailop] URL flagged in Outlook365's ATP

2017-09-27 Thread Carissa Phillips 
Hi Michael,

I work for Campaign Monitor, an ESP. One of our domains used in tracking
URLs is flagged by ATP. Could you please check on cmail19.com, please? I'm
happy to send more info offline.

Thank you!
--

Carissa Phillips
Deliverability Support Lead
campaignmonitor.com
___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread Kurt Jaeger 
Hi!

> is there anyone working in a larger/'more demanding' environment, using 
> NFS for his/her message store, where there is a business requirement of 
> High Availability? If so, what commercial or open source storage 
> solution is used? I have a similar requirement for a project and am 
> looking for suggestions/options for what storage to use.

Ask the dovecot folks, their open-source imap server
has a professional service team:

https://www.open-xchange.com/portfolio/dovecot-pro/

Open-xchange recently pooled dovecot, powerdns and open-xchange
in one company.

-- 
p...@opsec.eu+49 171 3101372 3 years to go !

___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread Noel Butler 
On 28/09/2017 08:33, Rolf E. Sonneveld wrote:

> Hi,
> 
> is there anyone working in a larger/'more demanding' environment, using NFS 
> for his/her message store, where there is a business requirement of High 
> Availability? If so, what commercial or open source storage solution is used? 
> I have a similar requirement for a project and am looking for 
> suggestions/options for what storage to use.
> 
> Regards,
> /rolf

Most SP's have a need to HA, to avoid their support desks being flooded,
which doesnt look good, 

NetApp and EMC have excellent options for backends, we use NFS as its
perfect, so long as using maildir and not mbox, we found NFS far more
overall reliable than a clustered filesystem in a uptime critical and
busy environment, and its a cinch to add/remove servers 

multiple front ends, using, eg: postfix and dovecot, with mysql/mariadb
replicated on each server using a hardware load balancer, since we NFS
mount mail dir we use dovecots -lda and not lmtp, and do not use its
"director" service, which forces users to a specific machine. 

With dovecot you can make filesystem efficient structure if you have a
lot of users, the one we use is  

(I'll cheat - copy and paste) this format, which gives
jsm...@example.com   /vmail/example.com/j/s/m/jsmith 

mail_location = maildir:/var/vmail/%Ld/%1Ln/%1.1Ln/%2.1Ln/%Ln/Maildir  

on smtp/pop3 servers also add to above :INDEX=MEMORY   - but dont ever
use that on imap 

I'd suggest keeping outbound mail servers separate to inbound, and as
last bit of advice, given this is HA - 

FFS, do NOT use virtual machines :) 

-- 
Kind Regards, 

Noel Butler 

This Email, including any attachments, may contain legally 
privileged
information, therefore remains confidential and subject to copyright
protected under international law. You may not disseminate, discuss, or
reveal, any part, to anyone, without the authors express written
authority to do so. If you are not the intended recipient, please notify
the sender then delete all copies of this message including attachments,
immediately. Confidentiality, copyright, and legal privilege are not
waived or lost by reason of the mistaken delivery of this message. Only
PDF [1] and ODF [2] documents accepted, please do not send proprietary
formatted documents 

 

Links:
--
[1] http://www.adobe.com/
[2] http://en.wikipedia.org/wiki/OpenDocument___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread W Kern 



On 9/27/2017 5:14 PM, st...@greengecko.co.nz wrote:

In this situation NFS is more of a delivery method than anything to do with 
high availability, as it has no requirement to do any more than share a single 
copy of the data.

Maybe a clustered file system - glusterfs for example - is what you're looking 
for.




We are huge GlusterFS fans. It is easy to setup, trivial to admin and 
very reliable if you don't get too fancy. Biggest issue is 'growing' it 
as you have to be precise in how you add additional bricks.


However, historically the small-file performance on Gluster has not been 
very good, though they are working on it.


Thus a Maildir based system would not (yet) be a good fit on Gluster, 
especially with lots of customers who leave tens of thousands of 
individual messages in a particular Folder.


Other OpenSource 'white box' HA options are

1) Ceph
2) MooseFS/LizardFS
3) A big NFS server with DRBD as a failover.

Each of those would have its challenges as you get into the millions of 
busy accounts stage, but there are work arounds for each.


William Kern

___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread steve 
In this situation NFS is more of a delivery method than anything to do with 
high availability, as it has no requirement to do any more than share a single 
copy of the data.

Maybe a clustered file system - glusterfs for example - is what you're looking 
for.

Steve

September 28, 2017 11:39 AM, "Rolf E. Sonneveld"  
wrote:

> Hi,
> 
> is there anyone working in a larger/'more demanding' environment, using NFS 
> for his/her message
> store, where there is a business requirement of High Availability? If so, 
> what commercial or open
> source storage solution is used? I have a similar requirement for a project 
> and am looking for
> suggestions/options for what storage to use.
> 
> Regards,
> /rolf
> 
> ___
> mailop mailing list
> mailop@mailop.org
> https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

Re: [mailop] Message Store on NFS in a high available setup

2017-09-27 Thread Luis E. Muñoz via mailop 



On 27 Sep 2017, at 15:33, Rolf E. Sonneveld wrote:
is there anyone working in a larger/'more demanding' environment, 
using NFS for his/her message store, where there is a business 
requirement of High Availability? If so, what commercial or open 
source storage solution is used? I have a similar requirement for a 
project and am looking for suggestions/options for what storage to 
use.


My last large deployment used NetApp NFS storage together with a custom 
mailbox format based on Maildir++. Nowadays with NFSv4 and Maildir++ you 
should be fine. My setup handled ~7 million accounts.


Ping me if you want further info.

Best regards

-lem
___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop

[mailop] Message Store on NFS in a high available setup

2017-09-27 Thread Rolf E. Sonneveld 

Hi,

is there anyone working in a larger/'more demanding' environment, using 
NFS for his/her message store, where there is a business requirement of 
High Availability? If so, what commercial or open source storage 
solution is used? I have a similar requirement for a project and am 
looking for suggestions/options for what storage to use.


Regards,
/rolf

___
mailop mailing list
mailop@mailop.org
https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop