Re: [spamdyke-users] Reducing hard disk usage

2013-10-31 Thread Gary Gendel

Well sort of...

With ZFS this happens automatically because the file information is 
cached in the ARC RAM unless forced out.  I'm currently running a 91% 
cache hit rate on this server which runs file, web, streaming, and mail 
services.  It's running OpenIndiana (hipster) and has 4G RAM with 4 TB 
mirrored disk space (half full).


On 10/31/2013 11:44 AM, BC wrote:


Does anyone use some sort of RAMdisk or memory disk to hold the graylist?

I just did a 'du' on my graylist and it takes up 85mb of space.

I'm trying to reduce the amount of hard drive accesses going on.



___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-10-31 Thread Lutz Petersen


> Does anyone use some sort of RAMdisk or memory disk to hold the greylist

We don't greylist. But all external (receiving only) Frontend Servers Mailers
are running in Ramdisks. This gives extremely good results espacially when
receiving extreme high amounts of incoming Mails..

If rebooting one of these Servers there are init Scripts that copy 1:1 all
Files, empty Queues and so on from a Master at a Harddisk to the Ramdisk.


Lutz Petersen


___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-11-01 Thread BC

  
  

You actually answered another question I had as well.  I noticed in
my latest server-build, that the 'top' command shows an additional
line that I'd not seen on the previous server:

 Mem: 36M Active, 29M Inact, 206M Wired, 5647M Free
 ARC: 59M Total, 12M MFU, 45M MRU, 32K Anon, 587K Header, 1766K
Other
 Swap: 2048M Total, 2048M Free

That must be the ARC to which you make reference, yes?

but despite having 6GB RAM here, I'm hearing the hard drive doing a
lot of logging, and the boot drive is booted into zfs.  So it
doesn't seem that much is being retained in the ARC RAM.  Is there a
specific way that you turn that function 'on'?


On 11/1/2013 11:00 AM,
  spamdyke-users-requ...@spamdyke.org wrote:


  With ZFS this happens automatically because the file information is 
cached in the ARC RAM unless forced out.  I'm currently running a 91% 
cache hit rate on this server which runs file, web, streaming, and mail 
services.  It's running OpenIndiana (hipster) and has 4G RAM with 4 TB 
mirrored disk space (half full).


  

___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-11-01 Thread BC

  
  


You are doing what I want to do.  Which RAMdisk program are you
running?  Do you have a script that flushes the RAMdisk contents to
disk periodically, so the info on the hard disk doesn't get too
stale between reboots?

Could you share your init Script(s) with me?

Thank you.


On 11/1/2013 11:00 AM,
  spamdyke-users-requ...@spamdyke.org wrote:


  We don't greylist. But all external (receiving only) Frontend Servers Mailers
are running in Ramdisks. This gives extremely good results espacially when
receiving extreme high amounts of incoming Mails..

If rebooting one of these Servers there are init Scripts that copy 1:1 all
Files, empty Queues and so on from a Master at a Harddisk to the Ramdisk.


  

___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-11-01 Thread BC

  
  

The other question I forgot to ask...

With zfs and 4G RAM running, the prefetch is automatically
disabled.  Did you make the loader.conf change to enable prefetch
caching anyway?

Thanks.

On 11/1/2013 11:00 AM,
  spamdyke-users-requ...@spamdyke.org wrote:


  With ZFS this happens automatically because the file information is 
cached in the ARC RAM unless forced out.  I'm currently running a 91% 
cache hit rate on this server which runs file, web, streaming, and mail 
services.  It's running OpenIndiana (hipster) and has 4G RAM with 4 TB 
mirrored disk space (half full).


  

___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-11-01 Thread Gary Gendel
Prefetch is evil and is disabled by default in illumos based 
distributions (in newer versions it is enabled for scrubs since these 
are sequential in nature and can get a performance boost).  I'm talking 
about the Adaptive Replacement Cache (ARC).  This uses various metrics 
such as lru to determine what to keep in RAM. As long as there is enough 
RAM, it will keep things cached forever.


On 11/01/2013 03:02 PM, BC wrote:


The other question I forgot to ask...

With zfs and 4G RAM running, the prefetch is automatically disabled.  
Did you make the loader.conf change to enable prefetch caching anyway?


Thanks.

On 11/1/2013 11:00 AM, spamdyke-users-requ...@spamdyke.org wrote:

With ZFS this happens automatically because the file information is
cached in the ARC RAM unless forced out.  I'm currently running a 91%
cache hit rate on this server which runs file, web, streaming, and mail
services.  It's running OpenIndiana (hipster) and has 4G RAM with 4 TB
mirrored disk space (half full).




___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users


Re: [spamdyke-users] Reducing hard disk usage

2013-11-01 Thread BC

  
  

I can see I have some
reading to do.  Thanks.

  
On 11/1/2013 1:32 PM, Gary Gendel
  wrote:


  
  Prefetch is evil and is disabled by
default in illumos based distributions (in newer versions it is
enabled for scrubs since these are sequential in nature and can
get a performance boost).  I'm talking about the Adaptive
Replacement Cache (ARC).  This uses various metrics such as lru
to determine what to keep in RAM. As long as there is enough
RAM, it will keep things cached forever.

On 11/01/2013 03:02 PM, BC wrote:
  
  


The other question I forgot to ask...

With zfs and 4G RAM running, the prefetch is automatically
disabled.  Did you make the loader.conf change to enable
prefetch caching anyway?

Thanks.

On 11/1/2013 11:00 AM, spamdyke-users-requ...@spamdyke.org
  wrote:


  With ZFS this happens automatically because the file information is 
cached in the ARC RAM unless forced out.  I'm currently running a 91% 
cache hit rate on this server which runs file, web, streaming, and mail 
services.  It's running OpenIndiana (hipster) and has 4G RAM with 4 TB 
mirrored disk space (half full).

  


  

___
spamdyke-users mailing list
spamdyke-users@spamdyke.org
http://www.spamdyke.org/mailman/listinfo/spamdyke-users