Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Emmanuel Noobadmin
On 4/12/12, Stan Hoeppner  wrote:
> On 4/11/2012 11:50 AM, Ed W wrote:
>> One of the snags of md RAID1 vs RAID6 is the lack of checksumming in the
>> event of bad blocks.  (I'm not sure what actually happens when md
>> scrubbing finds a bad sector with raid1..?).  For low performance
>> requirements I have become paranoid and been using RAID6 vs RAID10,
>> filesystems with sector checksums seem attractive...
>
> Except we're using hardware RAID1 here and mdraid linear.  Thus the
> controller takes care of sector integrity.  RAID6 yields nothing over
> RAID10, except lower performance, and more usable space if more than 4
> drives are used.

How would the control ensure sector integrity unless it is writing
additional checksum information to disk? I thought only a few
filesystems like ZFS does the sector checksum to detect if any data
corruption occurred. I suppose the controller could throw an error if
the two drives returned data that didn't agree with each other but it
wouldn't know which is the accurate copy but that wouldn't protect the
integrity of the data, at least not directly without additional human
intervention I would think.


Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Stan Hoeppner
On 4/11/2012 11:50 AM, Ed W wrote:
> Re XFS.  Have you been watching BTRFS recently?
> 
> I will concede that despite the authors considering it production ready
> I won't be using it for my servers just yet.  However, it's benchmarking
> on single disk benchmarks fairly similarly to XFS and in certain cases
> (multi-threaded performance) can be somewhat better.  I haven't yet seen
> any benchmarks on larger disk arrays yet, eg 6+ disks, so no idea how it
> scales up.  Basically what I have seen seems "competitive"

Links?

> I don't have such hardware spare to benchmark, but I would be interested
> to hear from someone who benchmarks your RAID1+linear+XFS suggestion,
> especially if they have compared a cutting edge btrfs kernel on the same
> array?

http://btrfs.boxacle.net/repository/raid/history/History_Mail_server_simulation._num_threads=128.html

This is with an 8 wide LVM stripe over 8 17 drive hardware RAID0 arrays.
 If the disks had been setup as a concat of 68 RAID1 pairs, XFS would
have turned in numbers significantly higher, anywhere from a 100%
increase to 500%.  It's hard to say because the Boxacle folks didn't
show the XFG AG config they used.  The concat+RAID1 setup can decrease
disk seeks by many orders of magnitude vs striping.  Everyone knows as
seeks go down IOPS go up.  Even with this very suboptimal disk setup,
XFS still trounces everything but JFS which is a close 2nd.  BTRFS is
way down in the pack.  It would be nice to see these folks update these
results with a 3.2.6 kernel, as both BTRFS and XFS have improved
significantly since 2.6.35.  EXT4 and JFS have seen little performance
work since.  In fact JFS has seen no commits but bug fixes and changes
to allow compiling with recent kernels.

> One of the snags of md RAID1 vs RAID6 is the lack of checksumming in the
> event of bad blocks.  (I'm not sure what actually happens when md
> scrubbing finds a bad sector with raid1..?).  For low performance
> requirements I have become paranoid and been using RAID6 vs RAID10,
> filesystems with sector checksums seem attractive...

Except we're using hardware RAID1 here and mdraid linear.  Thus the
controller takes care of sector integrity.  RAID6 yields nothing over
RAID10, except lower performance, and more usable space if more than 4
drives are used.

-- 
Stan


Re: [Dovecot] ldap idle connection timeout in DoveCot 1.0.13?

2012-04-11 Thread Aliet Santiesteban Sifontes
I had this problem running Dovecot 2.x where LDAP servers are located on
another firewall zone, we use Juniper SSG550. The problem was that the
firewall was dropping the ldap idle connections so client authentication
was failing in dovecot for a while and after a time it reconnects,
Dovecot/Openldap-Server never knows that the firewall has dropped the
connection because this is the default, the firewall doesn't send TCP
-Reset to the client and the server, in Juniper/Netscreen you can do a
workaround to speed up the process by configuring the zone to send reset
back to the client and the server. Check you have on the firewall:

set flow tcp-mss
unset flow no-tcp-seq-check
set flow tcp-syn-check
unset flow tcp-syn-bit-check
set flow reverse-route clear-text prefer
set flow reverse-route tunnel always

Edit your zone and enable "If TCP non SYN, send RESET back" checkbox:

This fixed the delay for us, it would be a nice feature at dovecot side...
best regards



El 11 de abril de 2012 11:36, Timo Sirainen  escribió:

> On 11.4.2012, at 17.49, Zhou, Yan wrote:
>
> > We are using DoveCot 1.0.13, it connects to LDAP server for
> authentication. It seems that DoveCot keeps the idle LDAP connection open.
>
> Yes.
>
> > Our firewall is terminating these connections after some time of idle
> activity (2 hours), then, we run into authentication problem. If we restart
> either LDAP or DoveCot, then it is fine.
> >
> > Can we set some kind of LDAP idle connection timeout in DoveCot?
>  /etc/dovecot-ldap.conf.  I do not see any configuration available for
> 1.0.13.
>
> No. But if you upgrade to a newer Dovecot (v2.x probably) this is solved
> by automatic transparent reconnection.
>
>


Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Stan Hoeppner
On 4/10/2012 5:22 AM, Adrian Minta wrote:
> On 04/10/12 08:00, Stan Hoeppner wrote:
>> Interestingly, I designed a COTS server back in January to handle at
>> least 5k concurrent IMAP users, using best of breed components. If you
>> or someone there has the necessary hardware skills, you could assemble
>> this system and simply use it for NFS instead of Dovecot. The parts
>> list:
>> secure.newegg.com/WishList/PublicWishDetail.aspx?WishListNumber=17069985 
> 
> Don't forget the Battery Backup Unit for RAID card  !!!

Heh, thanks for the reminder Adrian. :)

I got to your email a little late--already corrected the omission.  Yes,
battery or flash backup for the RAID cache is always a necessity when
doing write-back caching.

-- 
Stan




Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Charles Marcus

On 2012-04-11 4:48 PM, Adrian Minta  wrote:

On 04/11/12 19:50, Ed W wrote:

One of the snags of md RAID1 vs RAID6 is the lack of checksumming in
the event of bad blocks. (I'm not sure what actually happens when md
scrubbing finds a bad sector with raid1..?). For low performance
requirements I have become paranoid and been using RAID6 vs RAID10,
filesystems with sector checksums seem attractive...



RAID6 is very slow for write operations. That's why is the worst choice
for maildir.


He did say '"For *low* *performance* requirements..." ... ;)

--

Best regards,

Charles


Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Adrian Minta

On 04/11/12 19:50, Ed W wrote:

...
One of the snags of md RAID1 vs RAID6 is the lack of checksumming in 
the event of bad blocks.  (I'm not sure what actually happens when md 
scrubbing finds a bad sector with raid1..?).  For low performance 
requirements I have become paranoid and been using RAID6 vs RAID10, 
filesystems with sector checksums seem attractive...


RAID6 is very slow for write operations. That's why is the worst choice 
for maildir.





Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Ed W

Re XFS.  Have you been watching BTRFS recently?

I will concede that despite the authors considering it production ready 
I won't be using it for my servers just yet.  However, it's benchmarking 
on single disk benchmarks fairly similarly to XFS and in certain cases 
(multi-threaded performance) can be somewhat better.  I haven't yet seen 
any benchmarks on larger disk arrays yet, eg 6+ disks, so no idea how it 
scales up.  Basically what I have seen seems "competitive"


I don't have such hardware spare to benchmark, but I would be interested 
to hear from someone who benchmarks your RAID1+linear+XFS suggestion, 
especially if they have compared a cutting edge btrfs kernel on the same 
array?


One of the snags of md RAID1 vs RAID6 is the lack of checksumming in the 
event of bad blocks.  (I'm not sure what actually happens when md 
scrubbing finds a bad sector with raid1..?).  For low performance 
requirements I have become paranoid and been using RAID6 vs RAID10, 
filesystems with sector checksums seem attractive...


Regards

Ed W


Re: [Dovecot] Problems with Apple Mail and attachments

2012-04-11 Thread Thierry de Montaudry
On 11 Apr 2012, at 16:13, Helga Mayer wrote:

> Hello,
> 
> has anyone experiences with the Apple mail client, to be precise : Mail 5.2?
> When I copy a message with an attachment from the inbox to a different folder 
> using 'move' or 'copy' , Apple Mail does not properly display the attachment 
> in the new folder.
> 
> When I copy the same message using 'archive' the attachment shows up properly.
> There is no difference on the server side. We are using maildirs. The raw
> messages in the various folders are identical.
> Deleting plist on the Mac didn't help.
> After removing and recreation of the account (client side) the attachments 
> are displayed correctly again.
> 
> Is this an apple problem or has it got anything to do with 
> dovecot.index.cache ?
> 
> Kind Regards
> Helga Mayer
> 
> 

Hi Helga,

I'm using Apple Mail 5.2 with a dovecot server (2.0.13, with maildir), and 
recently had no trouble like that, even though working with a mailbox that has 
about 1 emails, a lot of folders, and moving mails around all the time.
I've seen a similar problem a while ago (1 year maybe more), but used the 
mailbox Rebuild option on the client, which fixed it without having to delete 
and recreate the account. Your problem might just be a local index corruption, 
which can happen when loosing your Internet connection.

Regards,

Thierry

Re: [Dovecot] Problems with Apple Mail and attachments

2012-04-11 Thread Timo Sirainen
On 11.4.2012, at 17.13, Helga Mayer wrote:

> has anyone experiences with the Apple mail client, to be precise : Mail 5.2?
> When I copy a message with an attachment from the inbox to a different folder 
> using 'move' or 'copy' , Apple Mail does not properly display the attachment 
> in the new folder.
..
> Is this an apple problem or has it got anything to do with 
> dovecot.index.cache ?

Highly unlikely to be a Dovecot problem. Of course, you can verify if it's a 
caching problem by disabling indexes and seeing if you can reproduce the 
problem:

mail_location = maildir:~/Maildir:INDEX=MEMORY




Re: [Dovecot] ldap idle connection timeout in DoveCot 1.0.13?

2012-04-11 Thread Timo Sirainen
On 11.4.2012, at 17.49, Zhou, Yan wrote:

> We are using DoveCot 1.0.13, it connects to LDAP server for authentication. 
> It seems that DoveCot keeps the idle LDAP connection open.

Yes.

> Our firewall is terminating these connections after some time of idle 
> activity (2 hours), then, we run into authentication problem. If we restart 
> either LDAP or DoveCot, then it is fine.
> 
> Can we set some kind of LDAP idle connection timeout in DoveCot?  
> /etc/dovecot-ldap.conf.  I do not see any configuration available for 1.0.13.

No. But if you upgrade to a newer Dovecot (v2.x probably) this is solved by 
automatic transparent reconnection.



Re: [Dovecot] lazy_expunge questions

2012-04-11 Thread Timo Sirainen
On 11.4.2012, at 18.34, James Devine wrote:

> It looks like 3 namespace support in the lazy expunge plugin was removed in
> 2.1+ ?

Yeah, so it seems. Updated the wiki2.



Re: [Dovecot] lazy_expunge questions

2012-04-11 Thread James Devine
On Wed, Apr 11, 2012 at 12:01 AM, Timo Sirainen  wrote:

> On 10.4.2012, at 23.19, James Devine wrote:
>
> > I'm messing around with lazy expunge and I just had a couple of
> questions.
> >
> > If I delete messages or folders with messages, I see them being moved to
> > the expunge namespace, but if I delete an empty folder, all traces of it
> > seem to disappear.  Is there a way to move empty folders to the expunge
> > namespace also?
>
> If you give 3 namespaces to lazyexpunge, it uses another way of moving
> stuff, and that includes also moving empty folders. But with 1 namespace it
> doesn't currently move it. Perhaps it should.
>
> > My second question is in regards to restoring folders.  If I try to
> execute
> > the imap command 'RENAME EXPUNGED/TEST INBOX/TEST' I get 'NO [CANNOT]
> Can't
> > rename mailboxes to/from expunge namespace'.  Just wondering if this is
> > possible or do I need to recreate the folder and then move messages into
> it.
>
> You need to recreate + move. Renaming across namespaces is a little tricky.
>
>
It looks like 3 namespace support in the lazy expunge plugin was removed in
2.1+ ?


[Dovecot] ldap idle connection timeout in DoveCot 1.0.13?

2012-04-11 Thread Zhou, Yan
Hi there,

We are using DoveCot 1.0.13, it connects to LDAP server for authentication. It 
seems that DoveCot keeps the idle LDAP connection open.

Our firewall is terminating these connections after some time of idle activity 
(2 hours), then, we run into authentication problem. If we restart either LDAP 
or DoveCot, then it is fine.

Can we set some kind of LDAP idle connection timeout in DoveCot?  
/etc/dovecot-ldap.conf.  I do not see any configuration available for 1.0.13.

Another alternative is to set idle connection timeout in LDAP, but we prefer 
doing that in DoveCot.

Thanks,
Yan





Confidentiality Notice: The information contained in this electronic 
transmission is confidential and may be legally privileged. It is intended only 
for the addressee(s) named above. If you are not an intended recipient, be 
aware that any disclosure, copying, distribution or use of the information 
contained in this transmission is prohibited and may be unlawful. If you have 
received this transmission in error, please notify us by telephone (513) 
229-5500 or by email (postmas...@medplus.com). After replying, please erase it 
from your computer system.


[Dovecot] Problems with Apple Mail and attachments

2012-04-11 Thread Helga Mayer

Hello,

has anyone experiences with the Apple mail client, to be precise : Mail 5.2?
When I copy a message with an attachment from the inbox to a different  
folder using 'move' or 'copy' , Apple Mail does not properly display  
the attachment in the new folder.


When I copy the same message using 'archive' the attachment shows up properly.
There is no difference on the server side. We are using maildirs. The raw
messages in the various folders are identical.
Deleting plist on the Mac didn't help.
After removing and recreation of the account (client side) the  
attachments are displayed correctly again.


Is this an apple problem or has it got anything to do with  
dovecot.index.cache ?


Kind Regards
Helga Mayer




Re: [Dovecot] Bug tracker

2012-04-11 Thread interfaSys sàrl
I second that. New version 3.2 supports sub-projects, editions and
components and is user-friendly.

Cheers,

Olivier

> On Wed, Apr 11, 2012 at 09:26:20AM +0300, Timo Sirainen wrote:
>
> So, any suggestions for what software could do these things? I think
> Request
> Tracker has those features, but it's not really the nicest/prettiest
> thing.
>
> May be worth to take a look at http://www.thebuggenie.com/.
>
> Thomas
>



Re: [Dovecot] Bug tracker

2012-04-11 Thread Charles Marcus

On 2012-04-11 2:26 AM, Timo Sirainen  wrote:

Notifications about new bugs won't go to the mailing list (most
likely it was created due to a recent mailing list post).


I actually would like to see these, and I imagine I'm not alone...

If you'd prefer they don't go to the users list, maybe create a new 
'notifications' (or maybe even a -dev) list that anyone could subscribe 
to to see these?



So, any suggestions for what software could do these things? I think
Request Tracker has those features, but it's not really the
nicest/prettiest thing.


+1 to Redmine. I only used it for a short time, but I liked it, and the 
fact that you can integrate it with git or mercurial is a big plus. Yes, 
it is a full blown bug tracker, but if, in the future, you add more 
developers (maybe you get some angel funding), you already have a full 
blown bug tracker in place, including the extras it comes with.


--

Best regards,

Charles


Re: [Dovecot] Proxy and SSO (single sign-on)

2012-04-11 Thread Miguel Tormo
El Miércoles, 4 de Abril de 2012 13:47:47 Miguel Tormo escribió:
> El Miércoles, 4 de Abril de 2012 13:21:33 Timo Sirainen escribió:
> > On 4.4.2012, at 14.18, Miguel Tormo wrote:
> > 
> > > I have a running setup with a dovecot imap4/pop3 proxy to a few dovecot 
> > > backend servers which actually store the mailboxes. This is running 
> > > smoothly and allows me to transparently distribute mailboxes.
> > > I'm using some "extrafield" configured in the LDAP passdb.
> > > 
> > > However, now I would like to use GSSAPI (preferred) and NTLM for single 
> > > sign-on. Both are pretty straightforward to configure in a single 
> > > instance environment, but I don't know if they would work with proxy. For 
> > > example, with GSSAPI there are two cases:
> > >  1) Just use gssapi mechanism, without PAM. Then, it a user presents a 
> > > ticket the passdb ldap is not used, so the extrafields are never read.
> > 
> > The patch in http://dovecot.org/list/dovecot/2012-March/064331.html makes 
> > this work I think. I still haven't managed to look into it much though.
> > 
> > 
> 
> It definitely is worth a look. I wonder if it would make ldap extrafields 
> lookups work with gssapi auth, I will try it and post the results.

Well just in case someone is interested: I applied Sam Morris' patch and got 
this working. Very nice indeed. To keep in mind:
 - It's necessary to set a master password for the backend server so the proxy 
instance can impersonate any user when connecting to the backend instance. I 
needed to do this to make GSSAPI with proxy work (thus the proxy instance is 
who actually does the authentication), however NTLM worked without a masster 
password, it seems this authenticatiom mechanism can be forwarded as is.
 - In the LDAP configuration, "auth bind" must be set to "no". Obviously, when 
using sso you don't provide a password, so there is no way it can bind to the 
LDAP server with your credentials.

There is still a problem that might be more related to the MUA, but still if 
anyone has a suggestion I would appreciate it.
The problem is the following: if you are a roaming user (ie: with a laptop)  
when you are outside the LAN you cannot get a kerberos ticket thus the GSSAPI 
auth fails. Then you have to change your account configuration and select a 
password-based authentication mechanism. This is not very convenient. However, 
this is different if compared with kerberos authentication with a web browser: 
if you have a valid ticket, access is granted; if not, the browser prompts for 
user/password and then you are granted access if the supplied credentials are 
valid.

Do you have any idea if something like this is possible to accomplish with IMAP?


Thank you and regards,


Re: [Dovecot] Bug tracker

2012-04-11 Thread Warren Baker
On Wed, Apr 11, 2012 at 10:05 AM, Antoine Nguyen  wrote:
> Le 11 avril 2012 09:23, Timo Sirainen  a écrit :
>> > I would have the option of adding a comment that doesn't go to the
>> mailing list
>>
>> But I'm beginning to think that no BTS supports that in the way I want.
>> And it's not a huge problem for me really, just means that this mailing
>> list may get a bit more pointless notifications than necessary.
>>
>> Although I'm also not seeing much documentation about email notifications
>> in general. Can it be configured to send comment updates, but no other
>> updates? I guess this could also be kludged by dropping unwanted emails in
>> MTA.
>>
>>
> AFAIK, yes. You can choose on which kind of event Redmine sends a
> notification. The documentation is not the best I've seen but the
> administration panel is pretty simple to understand.
>

There is a default notification option which is set to 'Only for
things I watch or I'm involved in' - which in your case Timo you would
receive everything since you would be the project owner.

There are also global settings that you can configure which provide
the ability to send notifications for certain events only:

- Issue added
- Issue updated
- Note added
- Status updated
- Priority updated
- News added
- Comment added to a news
- Document added
- File added
- Message added
- Wiki page added
- Wiki page updated

I think there is also a plugin to disable email notifications entirely
for a user.

-- 
.warren


Re: [Dovecot] Bug tracker

2012-04-11 Thread Antoine Nguyen
Le 11 avril 2012 09:23, Timo Sirainen  a écrit :

> On 11.4.2012, at 9.49, Antoine Nguyen wrote:
>
> > Maybe Redmine ? (http://www.redmine.org/
>
> I don't think it either supports:
>
> > I would have the option of adding a comment that doesn't go to the
> mailing list
>
> But I'm beginning to think that no BTS supports that in the way I want.
> And it's not a huge problem for me really, just means that this mailing
> list may get a bit more pointless notifications than necessary.
>
> Although I'm also not seeing much documentation about email notifications
> in general. Can it be configured to send comment updates, but no other
> updates? I guess this could also be kludged by dropping unwanted emails in
> MTA.
>
>
AFAIK, yes. You can choose on which kind of event Redmine sends a
notification. The documentation is not the best I've seen but the
administration panel is pretty simple to understand.

Antoine


Re: [Dovecot] Bug tracker

2012-04-11 Thread Lee Standen
We use JIRA internally and it's probably the best bug tracker I've ever
seen.

The permissions system is very flexible, and to the best of my knowledge it
should support everything you've described in your original post.


On Wed, Apr 11, 2012 at 3:25 PM, Jan-Frode Myklebust wrote:

> On Wed, Apr 11, 2012 at 09:49:18AM +0300, Timo Sirainen wrote:
> > >
> > > I didn't see open source as a requirement, so then I would give a plug
> > > for Jira, which is the nicest/prettiest thing :-)
> >
> > I don't think it supports one of my requirements:
> >
> > > I would have the option of adding a comment that doesn't go to the
> mailing list
> >
> > Unless that's been added in a newer version.
> >
>
> There is an option for restricting who can view your comment, plus
> "Email notifications will only be sent to people who have permission to
> view the relevant issue"
>
>
> http://confluence.atlassian.com/display/JIRA/Creating+a+Notification+Scheme
>
> so I would expect it to be possible to define that the mailinglist is
> not member of a group-b, while everyone else is, and restrict the comment
> to that group.
>
> But best would probably be to discuss it with atlassion support...
>
>
>  -jf
>


Re: [Dovecot] Bug tracker

2012-04-11 Thread Jan-Frode Myklebust
On Wed, Apr 11, 2012 at 09:49:18AM +0300, Timo Sirainen wrote:
> > 
> > I didn't see open source as a requirement, so then I would give a plug
> > for Jira, which is the nicest/prettiest thing :-)
> 
> I don't think it supports one of my requirements:
> 
> > I would have the option of adding a comment that doesn't go to the mailing 
> > list
> 
> Unless that's been added in a newer version.
> 

There is an option for restricting who can view your comment, plus
"Email notifications will only be sent to people who have permission to
view the relevant issue"


http://confluence.atlassian.com/display/JIRA/Creating+a+Notification+Scheme

so I would expect it to be possible to define that the mailinglist is
not member of a group-b, while everyone else is, and restrict the comment to 
that group.

But best would probably be to discuss it with atlassion support...


  -jf


Re: [Dovecot] Bug tracker

2012-04-11 Thread Timo Sirainen
On 11.4.2012, at 9.49, Antoine Nguyen wrote:

> Maybe Redmine ? (http://www.redmine.org/

I don't think it either supports:

> I would have the option of adding a comment that doesn't go to the mailing 
> list

But I'm beginning to think that no BTS supports that in the way I want. And 
it's not a huge problem for me really, just means that this mailing list may 
get a bit more pointless notifications than necessary.

Although I'm also not seeing much documentation about email notifications in 
general. Can it be configured to send comment updates, but no other updates? I 
guess this could also be kludged by dropping unwanted emails in MTA.



Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-11 Thread Stan Hoeppner
On 4/10/2012 1:09 AM, Emmanuel Noobadmin wrote:
> On 4/10/12, Stan Hoeppner  wrote:

>> SuperMicro H8SGL G34 mobo w/dual Intel GbE, 2GHz 8-core Opteron
>> 32GB Kingston REG ECC DDR3, LSI 9280-4i4e, Intel 24 port SAS expander
>> 20 x 1TB WD RE4 Enterprise 7.2K SATA2 drives
>> NORCO RPC-4220 4U 20 Hot-Swap Bays, SuperMicro 865W PSU
>> All other required parts are in the Wish List.  I've not written
>> assembly instructions.  I figure anyone who would build this knows what
>> s/he is doing.
>>
>> Price today:  $5,376.62
> 
> This price looks like something I might be able to push through

It's pretty phenomenally low considering what all you get, especially 20
enterprise class drives.

> although I'll probably have to go SATA instead of SAS due to cost of
> keeping spares.

The 10K drives I mentioned are SATA not SAS.  WD's 7.2k RE and 10k
Raptor series drives are both SATA but have RAID specific firmware,
better reliability, longer warranties, etc.  The RAID specific firmware
is why both are tested and certified by LSI with their RAID cards.

>> Configuring all 20 drives as a RAID10 LUN in the MegaRAID HBA would give
>> you a 10TB net Linux device and 10 stripe spindles of IOPS and
>> bandwidth.  Using RAID6 would yield 18TB net and 18 spindles of read
>> throughput, however parallel write throughput will be at least 3-6x
>> slower than RAID10, which is why nobody uses RAID6 for transactional
>> workloads.
> 
> Not likely to go with RAID 5 or 6 due to concerns about the
> uncorrectable read errors risks on rebuild with large arrays. Is the

Not to mention rebuild times for large width RAID5/6.

> MegaRAID being used as the actual RAID controller or just as a HBA?

It's a top shelf RAID controller, 512MB cache, up to 240 drives, SSD
support, the works.  It's an LSI "Feature Line" card:
http://www.lsi.com/products/storagecomponents/Pages/6GBSATA_SASRAIDCards.aspx

The specs:
http://www.lsi.com/products/storagecomponents/Pages/MegaRAIDSAS9280-4i4e.aspx

You'll need the cache battery module for safe write caching, which I
forgot in the wish list (now added), $160:
http://www.newegg.com/Product/Product.aspx?Item=N82E16816118163&Tpk=LSIiBBU08

With your workload and RAID10 you should run with all 512MB configured
as write cache.  Linux caches all reads so using any controller cache
for reads is a waste.  Using all 512MB for write cache will increase
random write IOPS.

Note the 9280 allows up to 64 LUNs, so you can do tiered storage within
this 20 bay chassis.   For spares management you'd probably not want to
bother with two different sized drives.

I didn't mention the 300GB 10K Raptors previously due to their limited
capacity.  Note they're only $15 more apiece than the 1TB RE4 drives in
the original parts list.  For a total of $300 more you get the same 40%
increase in IOPs of the 600GB model, but you'll only have 3TB net space
after RAID10.  If 3TB is sufficient space for your needs, that extra 40%
IOPS makes this config a no brainer.  The decreased latency of the 10K
drives will give a nice boost to VM read performance, especially when
using NFS.  Write performance probably won't be much different due to
the generous 512MB write cache on the controller.  I also forgot to
mention that with BBWC enabled you can turn off XFS barriers, which will
dramatically speed up Exim queues and Dovecot writes, all writes actually.

Again, you probably don't want the spares management overhead of two
different disk types on the shelf, but you could stick these 10K 300s in
the first 16 slots, and put the 2TB RE4 drive in the last 4 slots,
RAID10 on the 10K drives, RAID5 on the 2TB drives.  This yields an 8
spindle high IOPS RAID10 of 2.4TB and a lower performance RAID5 of 6TB
for near line storage such as your Dovecot alt storage, VM templates,
etc, 8.4TB net, 1.6TB less than the original 10TB setup.  Total
additional cost is $920 for this setup.  You'd have two XFS filesystems
(with quite different mkfs parameters).

> I have been avoiding hardware RAID because of a really bad experience
> with RAID 5 on an obsolete controller that eventually died without
> replacement and couldn't be recovered. Since then, it's always been
> RAID 1 and, after I discovered mdraid, using them as purely HBA with
> mdraid for the flexibility of being able to just pull the drives into
> a new system if necessary without having to worry about the
> controller.

Assuming you have the right connector configuration for your
drive/enclosure on the replacement card, you can usually swap out one
LSI RAID card with any other LSI RAID card in the same, or newer,
generation.  It'll read the configuration metadata from the disks and be
up an running in minutes.  This feature has been around all the way back
to the AMI/Mylex cards of the late 1990s.  LSI acquired both companies,
who were #1 and #2 in RAID, which is why LSI is so successful today.
Back in those days LSI simply supplied the ASICs to AMI and Mylex.  I
have an AMI MegaRAID 428, top of the line

Re: [Dovecot] Bug tracker

2012-04-11 Thread Warren Baker
On Wed, Apr 11, 2012 at 9:10 AM, Patrick Ben Koetter  
wrote:
> * Antoine Nguyen :
>>
>> It's more than just a bug tracker but I think it answers your needs.
>
> +1
>
> We moved from trac to redmine about a year ago and still are very happy about
> it. Our non-technical customers can deal with it well. Redmine allows to hide
> projects and it knows the concept of sub-projects. It's versatile in terms of
> repositories (mercurial supported) and ticket handling is fine too.
>
> Sometimes I miss a more comfortable wiki editor, but that's a minor tradeoff.


+2 - we have been using it for another open source project for a
number of years and it works well.
We have it hooked up into github and it works without a glitch.


thx

-- 
.warren


Re: [Dovecot] Bug tracker

2012-04-11 Thread Patrick Ben Koetter
* Antoine Nguyen :
> > I started thinking that perhaps I should move my TODO list to a bug
> > tracker. But because of reasons I've explained a few times before, I don't
> > want a full blown public bug tracking system. The requirements for it are:
> >
> >  * I am the only person who can add new bugs. Everyone else reports
> > bugs/requests to this mailing list as before. (Well, I guess Stephan could
> > use this as well if he wants to.)
> >
> >  * Everyone can comment existing bugs.
> >
> >  * Dovecot mailing list integration: Commenting a bug sends a mail to the
> > mailing list. Replies to those comments go back to bug tracker (probably
> > based on some [#1234] tag in subject). I would have the option of adding a
> > comment that doesn't go to the mailing list (= adding some internal comment
> > that nobody else cares about). Notifications about new bugs won't go to the
> > mailing list (most likely it was created due to a recent mailing list post).
> >
> > So the main difference to how things work now is that people would be able
> > to easily browse existing bugs and add comments to them. I would add bugs
> > there only when I'm not planning on fixing them within a few days. I
> > wouldn't add each and every feature request there, only the things that I'm
> > actually interested in developing. So the idea would be to actually get the
> > bug tracker emptied at some point, not to be a graveyard of unimportant
> > feature requests that about 1-2 people in the world would want.
> >
> > So, any suggestions for what software could do these things? I think
> > Request Tracker has those features, but it's not really the
> > nicest/prettiest thing.
> >
> >
> Maybe Redmine ? (http://www.redmine.org/
> 
> It's more than just a bug tracker but I think it answers your needs.

+1

We moved from trac to redmine about a year ago and still are very happy about
it. Our non-technical customers can deal with it well. Redmine allows to hide
projects and it knows the concept of sub-projects. It's versatile in terms of
repositories (mercurial supported) and ticket handling is fine too.

Sometimes I miss a more comfortable wiki editor, but that's a minor tradeoff.

p@rick

-- 
state of mind ()
Digitale Kommunikation

http://www.state-of-mind.de

Franziskanerstraße 15  Telefon +49 89 3090 4664
81669 München  Telefax +49 89 3090 4666

Amtsgericht MünchenPartnerschaftsregister PR 563