Re: [Declude.JunkMail] Declude/Sniffer Issues

Mon, 19 Feb 2007 14:20:24 -0800 

Chris,
There are desktop heap issues when you start to reach around 50 non-service processes on a Windows box. Windows just doesn't enable such things, and there isn't a whole lot of tweaking that you can do to increase this. I run at 50 threads and I occasionally get heap errors. This of course depends on how many processes that Declude is launching and how long they take. Note that each thread in Declude will only be launching one external app at a time, but when these apps are slower, you can have a good number of them running concurrently. 


If you want to run a gateway for this type of volume, use something like 
Alligate or IMgate.  You can run these stand-alone on a much less 
capable box and handle many more connections.


Matt



Chris Patterson wrote:



This really is a front end gateway to a front end also running 
declude.  Even thought the thread count sounds high even at 500 
threads being used in Task Manager, we never hit 100% CPU.



 

2 -- dual-core opterons.  3 -- 15K SCSI's in Raid 5, 3 gigs Ram on a 
DL385.



 

When this happens all 500 threads are being used and the CPU is doing 
nothing, like 2%.



 

Get a new sniffer update, clean up the directory and it will not give 
a problem for days and days.



 


------------------------------------------------------------------------


*From:* [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] *On Behalf Of 
*Matt

*Sent:* Monday, February 19, 2007 4:08 PM
*To:* declude.junkmail@declude.com
*Subject:* Re: [Declude.JunkMail] Declude/Sniffer Issues


 


Chris,


Reduce your threads setting to a more reasonable number and you should 
be fine.  A number around 50 should suffice, but you can set it, 
restart Declude and then see if you are redlining.  Once you get to 
redlining when there is a backup, that is pretty much where threads 
should be set.  By going to 500 you are definitely overdoing it and 
causing other issues.


Matt



Chris Patterson wrote:

Threads = 500


 

3 days (approx): 1420731           [Spam: 1392289            Virus: 
114]        Relay High: 0



 

 

 


------------------------------------------------------------------------


*From:* [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> 
[mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>] *On Behalf 
Of *Darrell ([EMAIL PROTECTED] 
<mailto:[EMAIL PROTECTED]>)

*Sent:* Monday, February 19, 2007 2:53 PM
*To:* declude.junkmail@declude.com <mailto:declude.junkmail@declude.com>
*Subject:* Re: [Declude.JunkMail] Declude/Sniffer Issues


 

What is your mail volume and how many threads do you have declude 
configured for?



Darrell

------------------------------------------------------------------------

Check out http://www.invariantsystems.com for utilities for Declude 
And Imail.  IMail/Declude Overflow Queue Monitoring, SURBL/URI 
integration, MRTG Integration, and Log Parsers.


    ----- Original Message -----

    *From:* Chris Patterson <mailto:[EMAIL PROTECTED]>

    *To:* declude.junkmail@declude.com
    <mailto:declude.junkmail@declude.com>

    *Sent:* Monday, February 19, 2007 2:20 PM

    *Subject:* RE: [Declude.JunkMail] Declude/Sniffer Issues


     


    When this issue happens which seems more frequent, I do clear out
    the thousands of left behind files.  I am more trying to find a
    way to prevent it or reason that is happening.


     


    And yes, Sniffer does have a hard time operating when it hoses up
    that bad.


     


    ------------------------------------------------------------------------

    *From:* [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
    [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>] *On
    Behalf Of *Darrell ([EMAIL PROTECTED]
    <mailto:[EMAIL PROTECTED]>)
    *Sent:* Monday, February 19, 2007 1:40 PM
    *To:* declude.junkmail@declude.com
    <mailto:declude.junkmail@declude.com>
    *Subject:* Re: [Declude.JunkMail] Declude/Sniffer Issues


     


    Chris,


     


    I am gathering that you are running Sniffer in persistant mode?  I
    would stop your declude and Sniffer services.  Than go into the
    sniffer directory and remove all of the *.fin, *.svr files.  I am
    not sure what the .xxx files are.  I have yet to see those.  Than
    I would check your Sniffer log for any errors.  After making sure
    there are no errors I would restart the Sniffer persistant service
    and Declude and see if the issue is resolved.  It's possible
    Sniffer could be stepping on itself trying to weed through all

    those files. 

     


    Darrell

    ------------------------------------------------------------------------
    Check out http://www.invariantsystems.com for utilities for
    Declude And Imail.  IMail/Declude Overflow Queue Monitoring,
    SURBL/URI integration, MRTG Integration, and Log Parsers.

        ----- Original Message -----

        *From:* Chris Patterson <mailto:[EMAIL PROTECTED]>

        *To:* declude.junkmail@declude.com
        <mailto:declude.junkmail@declude.com>

        *Sent:* Monday, February 19, 2007 1:03 PM

        *Subject:* RE: [Declude.JunkMail] Declude/Sniffer Issues


         


        I get this in logs:


         


        02/19/2007 05:16:12.213 23859386 ERROR: External program
        SNIFFER didn't finish quick enough; terminating.

        02/19/2007 05:16:12.213 23859386 Couldn't get external program
        exit code


         


        At this point I see thousands of .xxx and .fin files built up
        in the sniffer directory.  Usually forcing a sniffer update
        (normally done every hour automatically).


         

         

         


        ------------------------------------------------------------------------

        *From:* [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
        [mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>] *On
        Behalf Of *Darrell ([EMAIL PROTECTED]
        <mailto:[EMAIL PROTECTED]>)
        *Sent:* Monday, February 19, 2007 9:32 AM
        *To:* declude.junkmail@declude.com
        <mailto:declude.junkmail@declude.com>
        *Subject:* Re: [Declude.JunkMail] Declude/Sniffer Issues


         


        What are you seeing the logs that indicates this?  Declude
        will terminate long running external processes and log that it
        terminated it.   Are you seeing those entries?  Also, during
        these times when you look at task manager do you see a bunch
        of idle sniffer processes?


         


        Typically from my experience when you see all the threads
        being used with very little to no CPU usage it tends to be a
        DNS issue (i.e slow or not responding DNS server).


         


        Darrell

        ------------------------------------------------------------------------
        Check out http://www.invariantsystems.com for utilities for
        Declude And Imail.  IMail/Declude Overflow Queue Monitoring,
        SURBL/URI integration, MRTG Integration, and Log Parsers.

            ----- Original Message -----

            *From:* Chris Patterson <mailto:[EMAIL PROTECTED]>

            *To:* declude.junkmail@declude.com
            <mailto:declude.junkmail@declude.com>

            *Sent:* Monday, February 19, 2007 8:47 AM

            *Subject:* [Declude.JunkMail] Declude/Sniffer Issues


             


            I am running 2 versions of Smartermail & Declude both
            running Sniffer and InvURIBL.  One is
            Smartermail4/Declude4.3.3 Other is Smartermail2/Declude3.


             


            These servers can run perfectly for weeks but for the past
            few weeks we have been sporadically seeing Declude back up
            files in the Proc directory.


             


            At this time all Declude threads are being used with no
            processing power being used.  It appears Sniffer is not
            finishing and hogging up all the threads after reviewing
            the logs.


             


            Anyone else experiencing this?


             


            Thanks,


             


            Chris Patterson, CCNA
            Network Engineer/Support Manager
            Rapid Systems


             



            ---
            This E-mail came from the Declude.JunkMail mailing list. To
            unsubscribe, just send an E-mail to [EMAIL PROTECTED]
            <mailto:[EMAIL PROTECTED]>, and
            type "unsubscribe Declude.JunkMail". The archives can be found
            at http://www.mail-archive.com.


        ---
        This E-mail came from the Declude.JunkMail mailing list. To
        unsubscribe, just send an E-mail to [EMAIL PROTECTED]
        <mailto:[EMAIL PROTECTED]>, and
        type "unsubscribe Declude.JunkMail". The archives can be found
        at http://www.mail-archive.com.
        ---
        This E-mail came from the Declude.JunkMail mailing list. To
        unsubscribe, just send an E-mail to [EMAIL PROTECTED]
        <mailto:[EMAIL PROTECTED]>, and
        type "unsubscribe Declude.JunkMail". The archives can be found
        at http://www.mail-archive.com.


    ---
    This E-mail came from the Declude.JunkMail mailing list. To
    unsubscribe, just send an E-mail to [EMAIL PROTECTED]
    <mailto:[EMAIL PROTECTED]>, and
    type "unsubscribe Declude.JunkMail". The archives can be found
    at http://www.mail-archive.com.
    ---
    This E-mail came from the Declude.JunkMail mailing list. To
    unsubscribe, just send an E-mail to [EMAIL PROTECTED]
    <mailto:[EMAIL PROTECTED]>, and
    type "unsubscribe Declude.JunkMail". The archives can be found
    at http://www.mail-archive.com.


---
This E-mail came from the Declude.JunkMail mailing list. To

unsubscribe, just send an E-mail to [EMAIL PROTECTED] 
<mailto:[EMAIL PROTECTED]>, and

type "unsubscribe Declude.JunkMail". The archives can be found
at http://www.mail-archive.com.
---
This E-mail came from the Declude.JunkMail mailing list. To

unsubscribe, just send an E-mail to [EMAIL PROTECTED] 
<mailto:[EMAIL PROTECTED]>, and

type "unsubscribe Declude.JunkMail". The archives can be found
at http://www.mail-archive.com.


---
This E-mail came from the Declude.JunkMail mailing list. To
unsubscribe, just send an E-mail to [EMAIL PROTECTED], and
type "unsubscribe Declude.JunkMail". The archives can be found
at http://www.mail-archive.com.
---
This E-mail came from the Declude.JunkMail mailing list. To
unsubscribe, just send an E-mail to [EMAIL PROTECTED], and
type "unsubscribe Declude.JunkMail". The archives can be found

at http://www.mail-archive.com. 



---
This E-mail came from the Declude.JunkMail mailing list.  To
unsubscribe, just send an E-mail to [EMAIL PROTECTED], and
type "unsubscribe Declude.JunkMail".  The archives can be found
at http://www.mail-archive.com.






















					Reply via email to