Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

Rajesh,

It has something to do with #!/bin/bash or #!/bin/sh.

At top of script, when I use #!/bin/sh I get the same error you do, but 
when I use #!/bin/bash script works fine.



Eric


On 9/1/2017 11:07 PM, Rajesh M wrote:

eric

1) is their any resolution for this issue ?

2) if i run the script it throws error as such
.
/limits.sh: line 23: `return-limits': not a valid identifier

#!/bin/bash
if [ "$#" -ne "1" ]; then
echo ""
echo -e "\033[01;32mLimit checker\033[00m"
echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
echo ""
exit 0
fi

return-limits(){
for process in $@; do
   process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`

   if [ -z $@ ]; then
  echo "[no $process running]"
   else
  for pid in $process_pids; do
 echo "[$process #$pid -- limits]"
 cat /proc/$pid/limits
   done
   fi
done
}
return-limits $1

rajesh



- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 17:28:40 -0600
Subject:

I sent myself a large file so that I could examine simscan with the
below script (limits.sh). Here's the output:

[root@pet105 simscan-1.4.0]# ./limits simscan
[simscan #31535 -- limits]
Limit                     Soft Limit           
Hard Limit           Units
Max cpu time              unlimited unlimited           
 seconds
Max file size             unlimited unlimited            
bytes
Max data size             unlimited unlimited            
bytes
Max stack size 10485760 unlimited            bytes
Max core file size        0 unlimited            bytes
Max resident set          unlimited unlimited            
bytes
Max processes 1024 31121                processes
Max open files            1024 4096                 
files
Max locked memory         65536 65536                
bytes
Max address space         unlimited unlimited            
bytes
Max file locks            unlimited unlimited            
locks
Max pending signals       31121 31121                
signals
Max msgqueue size         819200 819200               
bytes
Max nice priority         0                    0
Max realtime priority     0                    0
Max realtime timeout      unlimited unlimited            us

Notice the 'Max processes' and 'Max stack size', this could very well be
the issue for our simscan failures.

Eric

On 9/1/2017 5:20 PM, Eric Broch wrote:

This looks like a decent script:


#!/bin/bash
if [ "$#" -ne "1" ]; then
echo ""
echo -e "\033[01;32mLimit checker\033[00m"
echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
echo ""
exit 0
fi

return-limits(){
for process in $@; do
      process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`

if [ -z $@ ]; then
echo "[no $process running]"
else
for pid in $process_pids; do
echo "[$process #$pid -- limits]"
            cat /proc/$pid/limits
      done
      fi
   done
}

return-limits $1


Example:
# ./limits.sh tcpserver
or
# ./limits.sh simscan

Eric


On 9/1/2017 2:51 PM, Rajesh M wrote:

eric

how do i check the number of user processes being consumed and by which user

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To:qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 14:25:36 -0600
Subject:

Number of user processes.


On 9/1/2017 1:57 PM, Rajesh M wrote:

eric

what is RLIMIT ? is it related to memory ?

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To:qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:25:49 -0600
Subject:

Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
  /* Set ulimits to prevent hangs if it forks too many processes */
  getrlimit(RLIMIT_NPROC, );
  limits.rlim_cur = 1024;
  setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be
forking issues with qmail-queue, ripmime, and others. This is in place
to prevent hangs...could be a good thing.


On 9/1/2017 1:04 PM, Remo Mattei wrote:

interesting...

mine was an easy fix by changing the owner and permissions so
underline has some other triggering to the kernel and how it reads
those layers.

On 9/1/17 11:18 AM, Eric Broch wrote:

1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either
of the following reasons:

a) [EAGAIN]
   The 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
eric

1) is their any resolution for this issue ?

2) if i run the script it throws error as such
.
/limits.sh: line 23: `return-limits': not a valid identifier

#!/bin/bash
if [ "$#" -ne "1" ]; then
   echo ""
   echo -e "\033[01;32mLimit checker\033[00m"
   echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
   echo ""
   exit 0
fi

return-limits(){
   for process in $@; do
  process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`

  if [ -z $@ ]; then
 echo "[no $process running]"
  else
 for pid in $process_pids; do
echo "[$process #$pid -- limits]"
cat /proc/$pid/limits
  done
  fi
   done
}
return-limits $1

rajesh



- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 17:28:40 -0600
Subject:

I sent myself a large file so that I could examine simscan with the
below script (limits.sh). Here's the output:

[root@pet105 simscan-1.4.0]# ./limits simscan
[simscan #31535 -- limits]
Limit                     Soft Limit           
Hard Limit           Units
Max cpu time              unlimited unlimited           
 seconds
Max file size             unlimited unlimited            
bytes
Max data size             unlimited unlimited            
bytes
Max stack size 10485760 unlimited            bytes
Max core file size        0 unlimited            bytes
Max resident set          unlimited unlimited            
bytes
Max processes 1024 31121                processes
Max open files            1024 4096                 
files
Max locked memory         65536 65536                
bytes
Max address space         unlimited unlimited            
bytes
Max file locks            unlimited unlimited            
locks
Max pending signals       31121 31121                
signals
Max msgqueue size         819200 819200               
bytes
Max nice priority         0                    0
Max realtime priority     0                    0
Max realtime timeout      unlimited unlimited            us

Notice the 'Max processes' and 'Max stack size', this could very well be
the issue for our simscan failures.

Eric

On 9/1/2017 5:20 PM, Eric Broch wrote:
>
> This looks like a decent script:
>
> 
> #!/bin/bash
> if [ "$#" -ne "1" ]; then
> echo ""
> echo -e "\033[01;32mLimit checker\033[00m"
> echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
> echo ""
> exit 0
> fi
>
> return-limits(){
> for process in $@; do
>       process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`
>
> if [ -z $@ ]; then
> echo "[no $process running]"
> else
> for pid in $process_pids; do
> echo "[$process #$pid -- limits]"
>             cat /proc/$pid/limits
>       done
>       fi
>    done
> }
>
> return-limits $1
> 
>
> Example:
> # ./limits.sh tcpserver
> or
> # ./limits.sh simscan
>
> Eric
>
>
> On 9/1/2017 2:51 PM, Rajesh M wrote:
>> eric
>>
>> how do i check the number of user processes being consumed and by which user
>>
>> rajesh
>>
>> - Original Message -
>> From: Eric Broch [mailto:ebr...@whitehorsetc.com]
>> To:qmailtoaster-list@qmailtoaster.com
>> Sent: Fri, 1 Sep 2017 14:25:36 -0600
>> Subject:
>>
>> Number of user processes.
>>
>>
>> On 9/1/2017 1:57 PM, Rajesh M wrote:
>>> eric
>>>
>>> what is RLIMIT ? is it related to memory ?
>>>
>>> rajesh
>>>
>>> - Original Message -
>>> From: Eric Broch [mailto:ebr...@whitehorsetc.com]
>>> To:qmailtoaster-list@qmailtoaster.com
>>> Sent: Fri, 1 Sep 2017 13:25:49 -0600
>>> Subject:
>>>
>>> Here's a section of code in simscan.c that controls the number of processes.
>>>
>>> #ifdef HAS_ULIMIT_NPROC
>>>  /* Set ulimits to prevent hangs if it forks too many processes 
>>> */
>>>  getrlimit(RLIMIT_NPROC, );
>>>  limits.rlim_cur = 1024;
>>>  setrlimit(RLIMIT_NPROC, );
>>> #endif
>>>
>>> The RLIMIT is set to 1024.
>>>
>>> I think this may be the issue and would explain why there would be
>>> forking issues with qmail-queue, ripmime, and others. This is in place
>>> to prevent hangs...could be a good thing.
>>>
>>>
>>> On 9/1/2017 1:04 PM, Remo Mattei wrote:
 interesting...

 mine was an easy fix by changing the owner and permissions so
 underline has some other triggering to the kernel and how it reads
 those layers.

 On 9/1/17 11:18 AM, Eric Broch wrote:
> 1)  Problem forking
>
> vfork() is used to execute qmail-queue
>
> The error 'simscan: error forking qmail-queue' will happen for either
> of the 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Jeff Koch

Hi Rajesh:

Intel(R) Xeon(R) CPU E3-1230 V2

ASUS P8B-M,  16GB RAM



On 9/1/2017 3:53 PM, Rajesh M wrote:

jeff

could you please let me know the cpu details of your machine

is it a dell machine or some other with  intel E5 processor ?

rajesh


- Original Message -
From: Jeff Koch [mailto:jeffk...@intersessions.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:39:37 -0400
Subject:

Eric / Remo / Rajesh - we reported this same problem a number of months
ago and thought we had fixed it. But alas, it's still with us. The good
news is that we haven't had any customer complaints. I'll be very
interested if it can be resolved.

Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:

I'm not sure what's going on here. Is this a relatively new phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it only
happens at peak hours?

I think I'll appy Johannes Weberhofer's patch and put it out there for
you...and cross or fingers.


On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
@400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
@400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
exit error code: 71
@400059a9032f3aaca334 04248613.308469.5216: OK
@400059a9032f3aacddcc simscan: clamdscan:
@400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9




@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch
I sent myself a large file so that I could examine simscan with the 
below script (limits.sh). Here's the output:


[root@pet105 simscan-1.4.0]# ./limits simscan
[simscan #31535 -- limits]
Limit Soft Limit   Hard Limit   Units
Max cpu time  unlimited unlimited    seconds
Max file size unlimited unlimited    bytes
Max data size unlimited unlimited    bytes
Max stack size 10485760 unlimited    bytes
Max core file size    0 unlimited    bytes
Max resident set  unlimited unlimited    bytes
Max processes 1024 31121    processes
Max open files    1024 4096 files
Max locked memory 65536 65536    bytes
Max address space unlimited unlimited    bytes
Max file locks    unlimited unlimited    locks
Max pending signals   31121 31121    signals
Max msgqueue size 819200 819200   bytes
Max nice priority 0    0
Max realtime priority 0    0
Max realtime timeout  unlimited unlimited    us

Notice the 'Max processes' and 'Max stack size', this could very well be 
the issue for our simscan failures.


Eric

On 9/1/2017 5:20 PM, Eric Broch wrote:


This looks like a decent script:


#!/bin/bash
if [ "$#" -ne "1" ]; then
echo ""
echo -e "\033[01;32mLimit checker\033[00m"
echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
echo ""
exit 0
fi

return-limits(){
for process in $@; do
      process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`

if [ -z $@ ]; then
echo "[no $process running]"
else
for pid in $process_pids; do
echo "[$process #$pid -- limits]"
            cat /proc/$pid/limits
      done
      fi
   done
}

return-limits $1


Example:
# ./limits.sh tcpserver
or
# ./limits.sh simscan

Eric


On 9/1/2017 2:51 PM, Rajesh M wrote:

eric

how do i check the number of user processes being consumed and by which user

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To:qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 14:25:36 -0600
Subject:

Number of user processes.


On 9/1/2017 1:57 PM, Rajesh M wrote:

eric

what is RLIMIT ? is it related to memory ?

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To:qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:25:49 -0600
Subject:

Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
     /* Set ulimits to prevent hangs if it forks too many processes */
     getrlimit(RLIMIT_NPROC, );
     limits.rlim_cur = 1024;
     setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be
forking issues with qmail-queue, ripmime, and others. This is in place
to prevent hangs...could be a good thing.


On 9/1/2017 1:04 PM, Remo Mattei wrote:

interesting...

mine was an easy fix by changing the owner and permissions so
underline has some other triggering to the kernel and how it reads
those layers.

On 9/1/17 11:18 AM, Eric Broch wrote:

1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either
of the following reasons:

a) [EAGAIN]
  The system-wide limit on the total number of processes under
  execution would be exceeded, or the system-imposed limit on the
  total number of processes under execution by a single user would
  be exceeded.
b) [ENOMEM]
  There is insufficient swap space for the new process.


On 9/1/2017 11:53 AM, Eric Broch wrote:

Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:

Eric / Remo / Rajesh - we reported this same problem a number of
months ago and thought we had fixed it. But alas, it's still with
us. The good news is that we haven't had any customer complaints.
I'll be very interested if it can be resolved.

Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:

I'm not sure what's going on here. Is this a relatively new
phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it
only happens at peak hours?

I think I'll appy Johannes Weberhofer's patch and put it out there
for you...and cross or fingers.


On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

This looks like a decent script:


#!/bin/bash
if [ "$#" -ne "1" ]; then
echo ""
echo -e "\033[01;32mLimit checker\033[00m"
echo -e "\033[01;37mUsage:\033[01;33m $0 process_name\033[00m"
echo ""
exit 0
fi

return-limits(){
for process in $@; do
      process_pids=`ps -C $process -o pid --no-headers | cut -d " " -f 2`

if [ -z $@ ]; then
echo "[no $process running]"
else
for pid in $process_pids; do
echo "[$process #$pid -- limits]"
            cat /proc/$pid/limits
      done
      fi
   done
}

return-limits $1


Example:
# ./limits.sh tcpserver
or
# ./limits.sh simscan

Eric


On 9/1/2017 2:51 PM, Rajesh M wrote:

eric

how do i check the number of user processes being consumed and by which user

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 14:25:36 -0600
Subject:

Number of user processes.


On 9/1/2017 1:57 PM, Rajesh M wrote:

eric

what is RLIMIT ? is it related to memory ?

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:25:49 -0600
Subject:

Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
     /* Set ulimits to prevent hangs if it forks too many processes */
     getrlimit(RLIMIT_NPROC, );
     limits.rlim_cur = 1024;
     setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be
forking issues with qmail-queue, ripmime, and others. This is in place
to prevent hangs...could be a good thing.


On 9/1/2017 1:04 PM, Remo Mattei wrote:

interesting...

mine was an easy fix by changing the owner and permissions so
underline has some other triggering to the kernel and how it reads
those layers.

On 9/1/17 11:18 AM, Eric Broch wrote:

1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either
of the following reasons:

a) [EAGAIN]
  The system-wide limit on the total number of processes under
  execution would be exceeded, or the system-imposed limit on the
  total number of processes under execution by a single user would
  be exceeded.
b) [ENOMEM]
  There is insufficient swap space for the new process.


On 9/1/2017 11:53 AM, Eric Broch wrote:

Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:

Eric / Remo / Rajesh - we reported this same problem a number of
months ago and thought we had fixed it. But alas, it's still with
us. The good news is that we haven't had any customer complaints.
I'll be very interested if it can be resolved.

Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:

I'm not sure what's going on here. Is this a relatively new
phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it
only happens at peak hours?

I think I'll appy Johannes Weberhofer's patch and put it out there
for you...and cross or fingers.


On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
eric

how do i check the number of user processes being consumed and by which user

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 14:25:36 -0600
Subject:

Number of user processes.


On 9/1/2017 1:57 PM, Rajesh M wrote:
> eric
>
> what is RLIMIT ? is it related to memory ?
>
> rajesh
>
> - Original Message -
> From: Eric Broch [mailto:ebr...@whitehorsetc.com]
> To: qmailtoaster-list@qmailtoaster.com
> Sent: Fri, 1 Sep 2017 13:25:49 -0600
> Subject:
>
> Here's a section of code in simscan.c that controls the number of processes.
>
> #ifdef HAS_ULIMIT_NPROC
>     /* Set ulimits to prevent hangs if it forks too many processes */
>     getrlimit(RLIMIT_NPROC, );
>     limits.rlim_cur = 1024;
>     setrlimit(RLIMIT_NPROC, );
> #endif
>
> The RLIMIT is set to 1024.
>
> I think this may be the issue and would explain why there would be
> forking issues with qmail-queue, ripmime, and others. This is in place
> to prevent hangs...could be a good thing.
>
>
> On 9/1/2017 1:04 PM, Remo Mattei wrote:
>> interesting...
>>
>> mine was an easy fix by changing the owner and permissions so
>> underline has some other triggering to the kernel and how it reads
>> those layers.
>>
>> On 9/1/17 11:18 AM, Eric Broch wrote:
>>> 1)  Problem forking
>>>
>>> vfork() is used to execute qmail-queue
>>>
>>> The error 'simscan: error forking qmail-queue' will happen for either
>>> of the following reasons:
>>>
>>> a) [EAGAIN]
>>>  The system-wide limit on the total number of processes under
>>>  execution would be exceeded, or the system-imposed limit on the
>>>  total number of processes under execution by a single user would
>>>  be exceeded.
>>> b) [ENOMEM]
>>>  There is insufficient swap space for the new process.
>>>
>>>
>>> On 9/1/2017 11:53 AM, Eric Broch wrote:
 Are there any errors in /var/log/messages that correspond?


 On 9/1/2017 11:39 AM, Jeff Koch wrote:
> Eric / Remo / Rajesh - we reported this same problem a number of
> months ago and thought we had fixed it. But alas, it's still with
> us. The good news is that we haven't had any customer complaints.
> I'll be very interested if it can be resolved.
>
> Jeff Koch
>
>
> On 9/1/2017 12:01 PM, Eric Broch wrote:
>> I'm not sure what's going on here. Is this a relatively new
>> phenomenon?
>>
>> I wonder if it's a memory, or even a disk speed, issue since it
>> only happens at peak hours?
>>
>> I think I'll appy Johannes Weberhofer's patch and put it out there
>> for you...and cross or fingers.
>>
>>
>> On 9/1/2017 6:28 AM, Rajesh M wrote:
>>> remo / eric
>>>
>>> i have still not being able to resolve the qq soft reject error.
>>>
>>> these are my findings
>>>
>>> 1) the errors i see are "error forking qmail-queue" and "ripmime error" 
>>> which causes the qq soft reject.
>>>
>>> 2) the max concurrent connections in the logs is around 35.
>>>
>>> 3)  These errors come up during peak working hours when the server is 
>>> under a  load of 4 - 8, and they increase the load even more to over 
>>> 10-15.
>>>
>>> 4) i came across this link (not sure if this is related)
>>> https://github.com/qmail/simscan/blob/master/simscan.c
>>>
>>> 5) i can share with you my live smtp logs with simscan debug.
>>>
>>> have extracted some lines below
>>>
>>>
>>> Error forking qmail-queue
>>>
>>> @400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
>>> @400059a8fa7b13162584 simscan: cdb looking up version spam
>>> @400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 
>>> clamav: 0.98.6/m: spam: 3.3.2
>>> @400059a8fa7b13166fbc simscan: found 3.3.2
>>> @400059a8fa7b13168efc simscan:[10757]:CLEAN 
>>> (5.00/30.00):9.7712s:-Possible Spam- RE_ REQUIRE BOOKING // 1X20  //
>>> ICD TKD TO 
>>> BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
>>> @400059a8fa7b1316cd7c simscan: done, execing qmail-queue
>>> @400059a8fa7b1316fc5c simscan: error forking qmail-queue
>>> @400059a8fa7b13199854 simscan: exit error code: 71
>>> @400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server 
>>> temporarily rejected message (#4.3.0)): MAILFROM:
>>> RCPTTO:rathe...@y.net
>>>
>>>
>>> Error in ripmime
>>>
>>> @400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
>>> @400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
>>> @400059a8fa98045a4fac simscan: pelookup: local part is 
>>> shailesh_k_bom
>>> @400059a8fa98045a4fac simscan: lpart: local part is **
>>> @400059a8fa98045a5394 simscan: cdb looking 
>>> upshailesh_k_...@aissamaritime.in

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

Number of user processes.


On 9/1/2017 1:57 PM, Rajesh M wrote:

eric

what is RLIMIT ? is it related to memory ?

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:25:49 -0600
Subject:

Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
    /* Set ulimits to prevent hangs if it forks too many processes */
    getrlimit(RLIMIT_NPROC, );
    limits.rlim_cur = 1024;
    setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be
forking issues with qmail-queue, ripmime, and others. This is in place
to prevent hangs...could be a good thing.


On 9/1/2017 1:04 PM, Remo Mattei wrote:

interesting...

mine was an easy fix by changing the owner and permissions so
underline has some other triggering to the kernel and how it reads
those layers.

On 9/1/17 11:18 AM, Eric Broch wrote:

1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either
of the following reasons:

a) [EAGAIN]
 The system-wide limit on the total number of processes under
 execution would be exceeded, or the system-imposed limit on the
 total number of processes under execution by a single user would
 be exceeded.
b) [ENOMEM]
 There is insufficient swap space for the new process.


On 9/1/2017 11:53 AM, Eric Broch wrote:

Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:

Eric / Remo / Rajesh - we reported this same problem a number of
months ago and thought we had fixed it. But alas, it's still with
us. The good news is that we haven't had any customer complaints.
I'll be very interested if it can be resolved.

Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:

I'm not sure what's going on here. Is this a relatively new
phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it
only happens at peak hours?

I think I'll appy Johannes Weberhofer's patch and put it out there
for you...and cross or fingers.


On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
eric

what is RLIMIT ? is it related to memory ?

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:25:49 -0600
Subject:

Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
   /* Set ulimits to prevent hangs if it forks too many processes */
   getrlimit(RLIMIT_NPROC, );
   limits.rlim_cur = 1024;
   setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be
forking issues with qmail-queue, ripmime, and others. This is in place
to prevent hangs...could be a good thing.


On 9/1/2017 1:04 PM, Remo Mattei wrote:
> interesting...
>
> mine was an easy fix by changing the owner and permissions so
> underline has some other triggering to the kernel and how it reads
> those layers.
>
> On 9/1/17 11:18 AM, Eric Broch wrote:
>>
>> 1)  Problem forking
>>
>> vfork() is used to execute qmail-queue
>>
>> The error 'simscan: error forking qmail-queue' will happen for either
>> of the following reasons:
>>
>> a) [EAGAIN]
>> The system-wide limit on the total number of processes under
>> execution would be exceeded, or the system-imposed limit on the
>> total number of processes under execution by a single user would
>> be exceeded.
>> b) [ENOMEM]
>> There is insufficient swap space for the new process.
>>
>>
>> On 9/1/2017 11:53 AM, Eric Broch wrote:
>>>
>>> Are there any errors in /var/log/messages that correspond?
>>>
>>>
>>> On 9/1/2017 11:39 AM, Jeff Koch wrote:

 Eric / Remo / Rajesh - we reported this same problem a number of
 months ago and thought we had fixed it. But alas, it's still with
 us. The good news is that we haven't had any customer complaints.
 I'll be very interested if it can be resolved.

 Jeff Koch


 On 9/1/2017 12:01 PM, Eric Broch wrote:
>
> I'm not sure what's going on here. Is this a relatively new
> phenomenon?
>
> I wonder if it's a memory, or even a disk speed, issue since it
> only happens at peak hours?
>
> I think I'll appy Johannes Weberhofer's patch and put it out there
> for you...and cross or fingers.
>
>
> On 9/1/2017 6:28 AM, Rajesh M wrote:
>> remo / eric
>>
>> i have still not being able to resolve the qq soft reject error.
>>
>> these are my findings
>>
>> 1) the errors i see are "error forking qmail-queue" and "ripmime error" 
>> which causes the qq soft reject.
>>
>> 2) the max concurrent connections in the logs is around 35.
>>
>> 3)  These errors come up during peak working hours when the server is 
>> under a  load of 4 - 8, and they increase the load even more to over 
>> 10-15.
>>
>> 4) i came across this link (not sure if this is related)
>> https://github.com/qmail/simscan/blob/master/simscan.c
>>
>> 5) i can share with you my live smtp logs with simscan debug.
>>
>> have extracted some lines below
>>
>>
>> Error forking qmail-queue
>>
>> @400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
>> @400059a8fa7b13162584 simscan: cdb looking up version spam
>> @400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 
>> clamav: 0.98.6/m: spam: 3.3.2
>> @400059a8fa7b13166fbc simscan: found 3.3.2
>> @400059a8fa7b13168efc simscan:[10757]:CLEAN 
>> (5.00/30.00):9.7712s:-Possible Spam- RE_ REQUIRE BOOKING // 1X20  //
>> ICD TKD TO 
>> BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
>> @400059a8fa7b1316cd7c simscan: done, execing qmail-queue
>> @400059a8fa7b1316fc5c simscan: error forking qmail-queue
>> @400059a8fa7b13199854 simscan: exit error code: 71
>> @400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server 
>> temporarily rejected message (#4.3.0)): MAILFROM:
>> RCPTTO:rathe...@y.net
>>
>>
>> Error in ripmime
>>
>> @400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
>> @400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
>> @400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
>> @400059a8fa98045a4fac simscan: lpart: local part is **
>> @400059a8fa98045a5394 simscan: cdb looking 
>> upshailesh_k_...@aissamaritime.in
>> @400059a8fa98045a5394 simscan: ripmime error
>> @400059a8fa98045a6334 simscan: exit error code: 71
>> @400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server 
>> temporarily rejected message (#4.3.0)):
>> MAILFROM:  RCPTTO:shailesh_k_...@yy.in
>>
>>
>> Wierd error logs
>>
>> @400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
>> ---
>> @400059a9032f3aa7b964 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
jeff

could you please let me know the cpu details of your machine

is it a dell machine or some other with  intel E5 processor ?

rajesh


- Original Message -
From: Jeff Koch [mailto:jeffk...@intersessions.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 13:39:37 -0400
Subject:

Eric / Remo / Rajesh - we reported this same problem a number of months
ago and thought we had fixed it. But alas, it's still with us. The good
news is that we haven't had any customer complaints. I'll be very
interested if it can be resolved.

Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:
>
> I'm not sure what's going on here. Is this a relatively new phenomenon?
>
> I wonder if it's a memory, or even a disk speed, issue since it only
> happens at peak hours?
>
> I think I'll appy Johannes Weberhofer's patch and put it out there for
> you...and cross or fingers.
>
>
> On 9/1/2017 6:28 AM, Rajesh M wrote:
>> remo / eric
>>
>> i have still not being able to resolve the qq soft reject error.
>>
>> these are my findings
>>
>> 1) the errors i see are "error forking qmail-queue" and "ripmime error" 
>> which causes the qq soft reject.
>>
>> 2) the max concurrent connections in the logs is around 35.
>>
>> 3)  These errors come up during peak working hours when the server is under 
>> a  load of 4 - 8, and they increase the load even more to over 10-15.
>>
>> 4) i came across this link (not sure if this is related)
>> https://github.com/qmail/simscan/blob/master/simscan.c
>>
>> 5) i can share with you my live smtp logs with simscan debug.
>>
>> have extracted some lines below
>>
>>
>> Error forking qmail-queue
>>
>> @400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
>> @400059a8fa7b13162584 simscan: cdb looking up version spam
>> @400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
>> 0.98.6/m: spam: 3.3.2
>> @400059a8fa7b13166fbc simscan: found 3.3.2
>> @400059a8fa7b13168efc simscan:[10757]:CLEAN 
>> (5.00/30.00):9.7712s:-Possible Spam- RE_ REQUIRE BOOKING // 1X20  //
>> ICD TKD TO 
>> BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
>> @400059a8fa7b1316cd7c simscan: done, execing qmail-queue
>> @400059a8fa7b1316fc5c simscan: error forking qmail-queue
>> @400059a8fa7b13199854 simscan: exit error code: 71
>> @400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server 
>> temporarily rejected message (#4.3.0)): MAILFROM:
>> RCPTTO:rathe...@y.net
>>
>>
>> Error in ripmime
>>
>> @400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
>> @400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
>> @400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
>> @400059a8fa98045a4fac simscan: lpart: local part is **
>> @400059a8fa98045a5394 simscan: cdb looking 
>> upshailesh_k_...@aissamaritime.in
>> @400059a8fa98045a5394 simscan: ripmime error
>> @400059a8fa98045a6334 simscan: exit error code: 71
>> @400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server 
>> temporarily rejected message (#4.3.0)):
>> MAILFROM:  RCPTTO:shailesh_k_...@yy.in
>>
>>
>> Wierd error logs
>>
>> @400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
>> ---
>> @400059a9032f3aa7b964 simscan: clamdscan: 
>> /var/qmail/simscan/1504248613.321653.5221: OK
>> @400059a9032f3aa86d14 simscan: clamdscan:
>> @400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
>> version clamav
>> @400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe 
>> d- -fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
>> @400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
>> @400059a9032f3aa8c6ec -l-e-s-:- -0
>> @400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
>> @400059a9032f3aa8f1e4
>> @400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
>> iTliemes::  00
>> @400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
>> e0simscan: calling spamc
>> @400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
>> clamdscan:
>> @400059a9032f3aa999dc  spamcm
>> @400059a9032f3aa999dc 0 s)
>> @400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an 
>> error ret: -1
>> @400059a9032f3aa9e02c 504248613.307311.5215: OK
>> @400059a9032f337c simscan: clamdscan:
>> @400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
>> ---
>> @400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
>> @400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
>> @400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
>> exit error code: 71
>> @400059a9032f3aaca334 04248613.308469.5216: OK
>> @400059a9032f3aacddcc simscan: clamdscan:
>> @400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
>> ---
>> 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch


Here's a section of code in simscan.c that controls the number of processes.

#ifdef HAS_ULIMIT_NPROC
  /* Set ulimits to prevent hangs if it forks too many processes */
  getrlimit(RLIMIT_NPROC, );
  limits.rlim_cur = 1024;
  setrlimit(RLIMIT_NPROC, );
#endif

The RLIMIT is set to 1024.

I think this may be the issue and would explain why there would be 
forking issues with qmail-queue, ripmime, and others. This is in place 
to prevent hangs...could be a good thing.



On 9/1/2017 1:04 PM, Remo Mattei wrote:

interesting...

mine was an easy fix by changing the owner and permissions so 
underline has some other triggering to the kernel and how it reads 
those layers.


On 9/1/17 11:18 AM, Eric Broch wrote:


1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either 
of the following reasons:


a) [EAGAIN]
The system-wide limit on the total number of processes under
execution would be exceeded, or the system-imposed limit on the
total number of processes under execution by a single user would
be exceeded. 
b) [ENOMEM]
There is insufficient swap space for the new process. 



On 9/1/2017 11:53 AM, Eric Broch wrote:


Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:


Eric / Remo / Rajesh - we reported this same problem a number of 
months ago and thought we had fixed it. But alas, it's still with 
us. The good news is that we haven't had any customer complaints. 
I'll be very interested if it can be resolved.


Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:


I'm not sure what's going on here. Is this a relatively new 
phenomenon?


I wonder if it's a memory, or even a disk speed, issue since it 
only happens at peak hours?


I think I'll appy Johannes Weberhofer's patch and put it out there 
for you...and cross or fingers.



On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

2) Problem forking (ripmime)

vfork is also used to execute ripmime

The error 'simscan: ripmime error' will happen for the same reasons as 
mentioned in the previous email (a and b below):


a) [EAGAIN]
   The system-wide limit on the total number of processes under
   execution would be exceeded, or the system-imposed limit on the
   total number of processes under execution by a single user would be
   exceeded. 
b) [ENOMEM]
   There is insufficient swap space for the new process. 


Eric



On 9/1/2017 12:18 PM, Eric Broch wrote:


1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either 
of the following reasons:


a) [EAGAIN]
The system-wide limit on the total number of processes under
execution would be exceeded, or the system-imposed limit on the
total number of processes under execution by a single user would
be exceeded. 
b) [ENOMEM]
There is insufficient swap space for the new process. 



On 9/1/2017 11:53 AM, Eric Broch wrote:


Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:


Eric / Remo / Rajesh - we reported this same problem a number of 
months ago and thought we had fixed it. But alas, it's still with 
us. The good news is that we haven't had any customer complaints. 
I'll be very interested if it can be resolved.


Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:


I'm not sure what's going on here. Is this a relatively new 
phenomenon?


I wonder if it's a memory, or even a disk speed, issue since it 
only happens at peak hours?


I think I'll appy Johannes Weberhofer's patch and put it out there 
for you...and cross or fingers.



On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

1)  Problem forking

vfork() is used to execute qmail-queue

The error 'simscan: error forking qmail-queue' will happen for either of 
the following reasons:


a) [EAGAIN]
   The system-wide limit on the total number of processes under
   execution would be exceeded, or the system-imposed limit on the
   total number of processes under execution by a single user would be
   exceeded. 
b) [ENOMEM]
   There is insufficient swap space for the new process. 



On 9/1/2017 11:53 AM, Eric Broch wrote:


Are there any errors in /var/log/messages that correspond?


On 9/1/2017 11:39 AM, Jeff Koch wrote:


Eric / Remo / Rajesh - we reported this same problem a number of 
months ago and thought we had fixed it. But alas, it's still with us. 
The good news is that we haven't had any customer complaints. I'll be 
very interested if it can be resolved.


Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:


I'm not sure what's going on here. Is this a relatively new phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it only 
happens at peak hours?


I think I'll appy Johannes Weberhofer's patch and put it out there 
for you...and cross or fingers.



On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
@400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
@400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
exit error code: 71
@400059a9032f3aaca334 04248613.308469.5216: OK
@400059a9032f3aacddcc simscan: clamdscan:
@400059a9032f3aace984 simscan: clamdscan: --- SCAN 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Jeff Koch
Eric / Remo / Rajesh - we reported this same problem a number of months 
ago and thought we had fixed it. But alas, it's still with us. The good 
news is that we haven't had any customer complaints. I'll be very 
interested if it can be resolved.


Jeff Koch


On 9/1/2017 12:01 PM, Eric Broch wrote:


I'm not sure what's going on here. Is this a relatively new phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it only 
happens at peak hours?


I think I'll appy Johannes Weberhofer's patch and put it out there for 
you...and cross or fingers.



On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
@400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
@400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
exit error code: 71
@400059a9032f3aaca334 04248613.308469.5216: OK
@400059a9032f3aacddcc simscan: clamdscan:
@400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9




@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
eric

the machine i have is a dell,  hex core with hyperthreading, 16 gb ram -- 
hardly 4 gb being used, 600 gb 15krpm drive, 2 drives of 2000 gb each 
separately handling data.

rajesh


- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Fri, 1 Sep 2017 10:01:01 -0600
Subject:

I'm not sure what's going on here. Is this a relatively new phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it only
happens at peak hours?

I think I'll appy Johannes Weberhofer's patch and put it out there for
you...and cross or fingers.


On 9/1/2017 6:28 AM, Rajesh M wrote:
> remo / eric
>
> i have still not being able to resolve the qq soft reject error.
>
> these are my findings
>
> 1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
> causes the qq soft reject.
>
> 2) the max concurrent connections in the logs is around 35.
>
> 3)  These errors come up during peak working hours when the server is under a 
>  load of 4 - 8, and they increase the load even more to over 10-15.
>
> 4) i came across this link (not sure if this is related)
> https://github.com/qmail/simscan/blob/master/simscan.c
>
> 5) i can share with you my live smtp logs with simscan debug.
>
> have extracted some lines below
>
>
> Error forking qmail-queue
>
> @400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
> @400059a8fa7b13162584 simscan: cdb looking up version spam
> @400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
> 0.98.6/m: spam: 3.3.2
> @400059a8fa7b13166fbc simscan: found 3.3.2
> @400059a8fa7b13168efc simscan:[10757]:CLEAN 
> (5.00/30.00):9.7712s:-Possible Spam- RE_ REQUIRE BOOKING // 1X20  //
> ICD TKD TO 
> BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
> @400059a8fa7b1316cd7c simscan: done, execing qmail-queue
> @400059a8fa7b1316fc5c simscan: error forking qmail-queue
> @400059a8fa7b13199854 simscan: exit error code: 71
> @400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server 
> temporarily rejected message (#4.3.0)): MAILFROM:
> RCPTTO:rathe...@y.net
>
>
> Error in ripmime
>
> @400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
> @400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
> @400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
> @400059a8fa98045a4fac simscan: lpart: local part is **
> @400059a8fa98045a5394 simscan: cdb looking 
> upshailesh_k_...@aissamaritime.in
> @400059a8fa98045a5394 simscan: ripmime error
> @400059a8fa98045a6334 simscan: exit error code: 71
> @400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server 
> temporarily rejected message (#4.3.0)):
> MAILFROM:  RCPTTO:shailesh_k_...@yy.in
>
>
> Wierd error logs
>
> @400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
> ---
> @400059a9032f3aa7b964 simscan: clamdscan: 
> /var/qmail/simscan/1504248613.321653.5221: OK
> @400059a9032f3aa86d14 simscan: clamdscan:
> @400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
> version clamav
> @400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
> -fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
> @400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
> @400059a9032f3aa8c6ec -l-e-s-:- -0
> @400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
> @400059a9032f3aa8f1e4
> @400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
> iTliemes::  00
> @400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
> e0simscan: calling spamc
> @400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
> clamdscan:
> @400059a9032f3aa999dc  spamcm
> @400059a9032f3aa999dc 0 s)
> @400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an 
> error ret: -1
> @400059a9032f3aa9e02c 504248613.307311.5215: OK
> @400059a9032f337c simscan: clamdscan:
> @400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
> ---
> @400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
> @400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
> @400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
> exit error code: 71
> @400059a9032f3aaca334 04248613.308469.5216: OK
> @400059a9032f3aacddcc simscan: clamdscan:
> @400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
> ---
> @400059a9
>
>
> 
>
> @400059a9032f3aa86d14 simscan: clamdscan:
> @400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
> version clamav
> @400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
> -fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
> @400059a9032f3aa8c304 -isimscan: found 

Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Eric Broch

I'm not sure what's going on here. Is this a relatively new phenomenon?

I wonder if it's a memory, or even a disk speed, issue since it only 
happens at peak hours?


I think I'll appy Johannes Weberhofer's patch and put it out there for 
you...and cross or fingers.



On 9/1/2017 6:28 AM, Rajesh M wrote:

remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO 
BANDARABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking upshailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM:  RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
@400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
@400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
exit error code: 71
@400059a9032f3aaca334 04248613.308469.5216: OK
@400059a9032f3aacddcc simscan: clamdscan:
@400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9




@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 

Re: [qmailtoaster] using dovecot seive

2017-09-01 Thread Rajesh M
eric,

i followed the instructions you gave below and it worked perfectly.

the syntax error was in my dovecot.sieve file

once i used your setting the logs gave me the error, which i could fix and get 
it working.

dovecot created the following

[root@ns1 rajesh]# ls -la
total 24
drwx-- 4 vpopmail vchkpw 4096 Sep  1 21:01 .
drwx-- 5 vpopmail vchkpw 4096 Aug 30 23:37 ..
-rw--- 1 vpopmail vchkpw  265 Sep  1 21:01 .dovecot.lda-dupes --- created 
by dovecot
lrwxrwxrwx 1 vpopmail vchkpw   20 Aug 31 21:45 .dovecot.sieve -> 
.sieve/dovecot.sieve
drwx-- 8 vpopmail vchkpw 4096 Sep  1 20:55 Maildir
-rw--- 1 vpopmail vchkpw   74 Aug 31 23:21 .qmail
drwx-- 2 vpopmail vchkpw 4096 Sep  1 21:01 .sieve

[root@ns1 .sieve]# ls -la
total 20
drwx-- 2 vpopmail vchkpw 4096 Sep  1 21:01 .
drwx-- 4 vpopmail vchkpw 4096 Sep  1 21:01 ..
-rw--- 1 vpopmail vchkpw  261 Sep  1 21:00 dovecot.sieve
-rw--- 1 vpopmail vchkpw  203 Sep  1 20:55 dovecot.sieve.log --- created by 
dovecot
-rw--- 1 vpopmail vchkpw  273 Sep  1 21:01 dovecot.svbin --- created by 
dovecot -- compiled version of dovecot.sieve


btw it gave me a message as such in the /var/log/dovecot-lda/dovecot-lda.log

nothing in the /var/log/dovecot-lda/dovecot-lda-errors.log

Sep 01 20:55:29 lda(raj...@aaaonlinux.com): Info: sieve: Failed to compile 
script `/home/vpopmail/domains/x.com/rajesh/.sieve/dovecot.sieve'
(view user logfile 
`/home/vpopmail/domains/x.com/rajesh/.sieve/dovecot.sieve.log' for more 
information)

i have placed all the configurations in dovecot.conf file (am not using any of 
the files in conf.d) arranged sequentially as per the conf.d numbering


regds
rajesh


- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Thu, 31 Aug 2017 19:35:30 -0600
Subject:

Hi Rajesh,

I'm not sure if you've gotten this working yet. I tried some
experimentation and I got this working on my host albeit that roundcube
created my files and directories under the user.

Notice especially the 'tmp' directory under ~/.sieve, you may need
it...not sure. Anyway here's everything I did.

# ls -la /home/vpopmail/domains/mydomain.com/user/
total 24
drwx--  4 vpopmail vchkpw 4096 Aug 31 19:11 .
drwx--  5 vpopmail vchkpw 4096 Aug 31 19:06 ..
-rw---  1 vpopmail vchkpw  300 Aug 31 19:11 .dovecot.lda-dupes
lrwxrwxrwx  1 vpopmail vchkpw   22 Aug 31 07:16 .dovecot.sieve ->
.sieve/roundcube.sieve
-rw---  1 vpopmail vchkpw  278 Aug 31 19:09 .dovecot.svbin
drwx-- 14 vpopmail vchkpw 4096 Aug 31 19:13 Maildir
drwx--  3 vpopmail vchkpw 4096 Aug 31 19:08 .sieve

--

# ls -la /home/vpopmail/domains/mydomain.com/user/.sieve
total 16
drwx-- 3 vpopmail vchkpw 4096 Aug 31 19:08 .
drwx-- 4 vpopmail vchkpw 4096 Aug 31 19:11 ..
-rw--- 1 vpopmail vchkpw  120 Aug 31 19:08 roundcube.sieve
drwx-- 2 vpopmail vchkpw 4096 Aug 31 19:08 tmp

--

# cat /home/vpopmail/domains/mydomain.com/user/.dovecot.sieve
# rule:[ToUserOtherDomain]
if header :contains "from" "u...@mydomain2.com"
{
         redirect "u...@myotherdomain.com";
}

--

It all came out in the log file /var/log/dovecot-lda/lda.log correctly

--

Dovecot settings: /etc/dovecot/local.conf :

protocol lda {
   mail_debug=yes
   mail_plugins = $mail_plugins sieve
   deliver_log_format = From:<%f>-<%e> :: Subject:<%s> :: Status:<%$> ::
MsgID:<%m> :: Size<%p> :: vSize<%w>
   log_path = /var/log/dovecot-lda/lda-err.log
   info_log_path = /var/log/dovecot-lda/lda.log
   #postmaster_address = postmaster@
}
plugin {
       sieve = ~/.dovecot.sieve
       sieve_dir = ~/.sieve
}

--

Dovecot settings: /etc/dovecot/toaster.conf

protocols = imap pop3 sieve

service managesieve-login {
    inet_listener sieve {
    port = 4190
    }
}

--

# ls -ld /var/log/dov*lda*
drwxrwx--- 2 vpopmail vchkpw 4096 Nov 10  2016 /var/log/dovecot-lda

--

# ls -l /var/log/dov*lda*
total 136
-rw--- 1 vpopmail vchkpw    418 Nov 12  2016 lda-err.log
-rw--- 1 vpopmail vchkpw 129882 Aug 31 19:12 lda.log

--

# cat /home/vpopmail/domains/mydomain.com/.qmail-default

|/var/qmail/bin/preline -f /usr/libexec/dovecot/deliver -d $EXT@$USER -o
postmaster_address=postmas...@mydomain.com



Re: [qmailtoaster] WARNING: rpm package colision

2017-09-01 Thread Havrla

OK, for spacewalk :

https://www.redhat.com/archives/spacewalk-list/2015-February/msg00089.html

2) Filter the conflicting packages out of the base/other channels. This works 
well. The filter is used when the repository is sync'ed from it's external 
sources. So, if the conflicting packages are already in Spacewalk, you'll need 
to add the filter and
then remove the packages from spacewalk. The filters option is on the 
Repository Details page under Manage Software Repositories.

Havrla

Dne 1.9.2017 v 15:40 Eric Broch napsal(a):

Hi, Havrla,

Shouldn't priority solve it?

[qmt-current]
# Qmailtoaster current repository
name=QMT Current Repository
mirrorlist=file:///etc/yum.repos.d/qmt-current-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/current 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/current/$basearch/ 


enabled=1
gpgcheck=0
priority=7
[qmt-testing]
# Qmailtoaster testing repository
name=QMT Testing Repository
mirrorlist=file:///etc/yum.repos.d/qmt-testing-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/testing 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/testing/$basearch/ 


enabled=0
gpgcheck=0
priority=7
[qmt-devel]
# Qmailtoaster development repository
name=QMT Development Repository
mirrorlist=file:///etc/yum.repos.d/qmt-devel-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/devel 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/devel/$basearch/ 


enabled=0
gpgcheck=0
priority=7

Eric


On 9/1/2017 7:12 AM, Havrla wrote:

Helooo

Warning:

clamav-0.99.2-4.qt.el7.x86_64!=clamav-0.99.2-8.el7

if "update to  clamav-0.99.2-8.el7/`yum update`"  then 
"qmailtoaster   qq soft reject ".


Havrla

Example  try update server:


[root@tonda ~]# rpm -qa | grep clam
clamav-0.99.2-4.qt.el7.x86_64
[root@tonda ~]# yum update --exclude=nagi*
Loaded plugins: changelog, fastestmirror, priorities, rhnplugin, 
versionlock

This system is receiving updates from RHN Classic or Red Hat Satellite.
Loading mirror speeds from cached hostfile
 * epel: mirror.karneval.cz
Resolving Dependencies
--> Running transaction check
---> Package clamav.x86_64 0:0.99.2-4.qt.el7 will be updated
--> Processing Dependency: libclamav.so.7()(64bit) for package: 
clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PRIVATE)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PUBLIC)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64

---> Package clamav.x86_64 0:0.99.2-8.el7 will be an update
--> Processing Dependency: data(clamav) for package: 
clamav-0.99.2-8.el7.x86_64

--> Running transaction check
---> Package clamav-data.noarch 0:0.99.2-8.el7 will be installed
--> Processing Dependency: clamav-filesystem = 0.99.2-8.el7 for 
package: clamav-data-0.99.2-8.el7.noarch

---> Package clamav-lib.x86_64 0:0.99.2-8.el7 will be installed
--> Running transaction check
---> Package clamav-filesystem.noarch 0:0.99.2-8.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

= 

 Package Arch Version 
RepositorySize
= 


Updating:
 clamav x86_64 0.99.2-8.el7 
centos-epel7 846 k

Installing for dependencies:
 clamav-data noarch 0.99.2-8.el7 
centos-epel7 111 M
 clamav-filesystem noarch 0.99.2-8.el7 
centos-epel7  21 k
 clamav-lib x86_64 0.99.2-8.el7 
centos-epel7 3.8 M


Transaction Summary
= 


Install ( 3 Dependent packages)
Upgrade  1 Package

Total size: 115 M
Is this ok [y/d/N]: n
Exiting on user command
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2017-09-01.15-07.PRd5ds.yumtx
[root@tonda ~]#



-
To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com
For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com






-
To unsubscribe, e-mail: 

Re: [qmailtoaster] WARNING: rpm package colision

2017-09-01 Thread Havrla

Thanks ...

It is possible, I try.
Around a year ago, I went to spacewalk-rhns.

Havrla

Dne 1.9.2017 v 15:40 Eric Broch napsal(a):

Hi, Havrla,

Shouldn't priority solve it?

[qmt-current]
# Qmailtoaster current repository
name=QMT Current Repository
mirrorlist=file:///etc/yum.repos.d/qmt-current-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/current 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/current/$basearch/ 


enabled=1
gpgcheck=0
priority=7
[qmt-testing]
# Qmailtoaster testing repository
name=QMT Testing Repository
mirrorlist=file:///etc/yum.repos.d/qmt-testing-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/testing 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/testing/$basearch/ 


enabled=0
gpgcheck=0
priority=7
[qmt-devel]
# Qmailtoaster development repository
name=QMT Development Repository
mirrorlist=file:///etc/yum.repos.d/qmt-devel-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/devel 

#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/devel/$basearch/ 


enabled=0
gpgcheck=0
priority=7

Eric


On 9/1/2017 7:12 AM, Havrla wrote:

Helooo

Warning:

clamav-0.99.2-4.qt.el7.x86_64!=clamav-0.99.2-8.el7

if "update to  clamav-0.99.2-8.el7/`yum update`"  then 
"qmailtoaster   qq soft reject ".


Havrla

Example  try update server:


[root@tonda ~]# rpm -qa | grep clam
clamav-0.99.2-4.qt.el7.x86_64
[root@tonda ~]# yum update --exclude=nagi*
Loaded plugins: changelog, fastestmirror, priorities, rhnplugin, 
versionlock

This system is receiving updates from RHN Classic or Red Hat Satellite.
Loading mirror speeds from cached hostfile
 * epel: mirror.karneval.cz
Resolving Dependencies
--> Running transaction check
---> Package clamav.x86_64 0:0.99.2-4.qt.el7 will be updated
--> Processing Dependency: libclamav.so.7()(64bit) for package: 
clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PRIVATE)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PUBLIC)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64

---> Package clamav.x86_64 0:0.99.2-8.el7 will be an update
--> Processing Dependency: data(clamav) for package: 
clamav-0.99.2-8.el7.x86_64

--> Running transaction check
---> Package clamav-data.noarch 0:0.99.2-8.el7 will be installed
--> Processing Dependency: clamav-filesystem = 0.99.2-8.el7 for 
package: clamav-data-0.99.2-8.el7.noarch

---> Package clamav-lib.x86_64 0:0.99.2-8.el7 will be installed
--> Running transaction check
---> Package clamav-filesystem.noarch 0:0.99.2-8.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

= 

 Package Arch Version 
RepositorySize
= 


Updating:
 clamav x86_64 0.99.2-8.el7 
centos-epel7 846 k

Installing for dependencies:
 clamav-data noarch 0.99.2-8.el7 
centos-epel7 111 M
 clamav-filesystem noarch 0.99.2-8.el7 
centos-epel7  21 k
 clamav-lib x86_64 0.99.2-8.el7 
centos-epel7 3.8 M


Transaction Summary
= 


Install ( 3 Dependent packages)
Upgrade  1 Package

Total size: 115 M
Is this ok [y/d/N]: n
Exiting on user command
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2017-09-01.15-07.PRd5ds.yumtx
[root@tonda ~]#



-
To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com
For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com







Re: [qmailtoaster] WARNING: rpm package colision

2017-09-01 Thread Eric Broch

Hi, Havrla,

Shouldn't priority solve it?

[qmt-current]
# Qmailtoaster current repository
name=QMT Current Repository
mirrorlist=file:///etc/yum.repos.d/qmt-current-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/current
#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/current/$basearch/
enabled=1
gpgcheck=0
priority=7
[qmt-testing]
# Qmailtoaster testing repository
name=QMT Testing Repository
mirrorlist=file:///etc/yum.repos.d/qmt-testing-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/testing
#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/testing/$basearch/
enabled=0
gpgcheck=0
priority=7
[qmt-devel]
# Qmailtoaster development repository
name=QMT Development Repository
mirrorlist=file:///etc/yum.repos.d/qmt-devel-mirrors
#mirrorlist=https://raw.githubusercontent.com/qmtoaster/mirrorlist/master/devel
#baseurl=ftp://ftp.qmailtoaster.com/pub/repo/qmt/CentOS/$releasever/devel/$basearch/
enabled=0
gpgcheck=0
priority=7

Eric


On 9/1/2017 7:12 AM, Havrla wrote:

Helooo

Warning:

clamav-0.99.2-4.qt.el7.x86_64    !=    clamav-0.99.2-8.el7

if "update to  clamav-0.99.2-8.el7/`yum update`"  then "qmailtoaster   
qq soft reject ".


Havrla

Example  try update server:


[root@tonda ~]# rpm -qa | grep clam
clamav-0.99.2-4.qt.el7.x86_64
[root@tonda ~]# yum update --exclude=nagi*
Loaded plugins: changelog, fastestmirror, priorities, rhnplugin, 
versionlock

This system is receiving updates from RHN Classic or Red Hat Satellite.
Loading mirror speeds from cached hostfile
 * epel: mirror.karneval.cz
Resolving Dependencies
--> Running transaction check
---> Package clamav.x86_64 0:0.99.2-4.qt.el7 will be updated
--> Processing Dependency: libclamav.so.7()(64bit) for package: 
clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PRIVATE)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PUBLIC)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64

---> Package clamav.x86_64 0:0.99.2-8.el7 will be an update
--> Processing Dependency: data(clamav) for package: 
clamav-0.99.2-8.el7.x86_64

--> Running transaction check
---> Package clamav-data.noarch 0:0.99.2-8.el7 will be installed
--> Processing Dependency: clamav-filesystem = 0.99.2-8.el7 for 
package: clamav-data-0.99.2-8.el7.noarch

---> Package clamav-lib.x86_64 0:0.99.2-8.el7 will be installed
--> Running transaction check
---> Package clamav-filesystem.noarch 0:0.99.2-8.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

= 

 Package Arch Version 
Repository    Size
= 


Updating:
 clamav x86_64 0.99.2-8.el7 
centos-epel7 846 k

Installing for dependencies:
 clamav-data noarch 0.99.2-8.el7 
centos-epel7 111 M
 clamav-filesystem noarch 0.99.2-8.el7 
centos-epel7  21 k
 clamav-lib x86_64 0.99.2-8.el7 
centos-epel7 3.8 M


Transaction Summary
= 


Install ( 3 Dependent packages)
Upgrade  1 Package

Total size: 115 M
Is this ok [y/d/N]: n
Exiting on user command
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2017-09-01.15-07.PRd5ds.yumtx
[root@tonda ~]#



-
To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com
For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com



--
Eric Broch
White Horse Technical Consulting (WHTC)


-
To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com
For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com



[qmailtoaster] WARNING: rpm package colision

2017-09-01 Thread Havrla

Helooo

Warning:

clamav-0.99.2-4.qt.el7.x86_64!=clamav-0.99.2-8.el7

if "update to  clamav-0.99.2-8.el7/`yum update`"  then "qmailtoaster   
qq soft reject ".


Havrla

Example  try update server:


[root@tonda ~]# rpm -qa | grep clam
clamav-0.99.2-4.qt.el7.x86_64
[root@tonda ~]# yum update --exclude=nagi*
Loaded plugins: changelog, fastestmirror, priorities, rhnplugin, versionlock
This system is receiving updates from RHN Classic or Red Hat Satellite.
Loading mirror speeds from cached hostfile
 * epel: mirror.karneval.cz
Resolving Dependencies
--> Running transaction check
---> Package clamav.x86_64 0:0.99.2-4.qt.el7 will be updated
--> Processing Dependency: libclamav.so.7()(64bit) for package: 
clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PRIVATE)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64
--> Processing Dependency: libclamav.so.7(CLAMAV_PUBLIC)(64bit) for 
package: clamav-0.99.2-8.el7.x86_64

---> Package clamav.x86_64 0:0.99.2-8.el7 will be an update
--> Processing Dependency: data(clamav) for package: 
clamav-0.99.2-8.el7.x86_64

--> Running transaction check
---> Package clamav-data.noarch 0:0.99.2-8.el7 will be installed
--> Processing Dependency: clamav-filesystem = 0.99.2-8.el7 for package: 
clamav-data-0.99.2-8.el7.noarch

---> Package clamav-lib.x86_64 0:0.99.2-8.el7 will be installed
--> Running transaction check
---> Package clamav-filesystem.noarch 0:0.99.2-8.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=
 Package Arch Version 
RepositorySize

=
Updating:
 clamav x86_64 0.99.2-8.el7 
centos-epel7 846 k

Installing for dependencies:
 clamav-data noarch 0.99.2-8.el7 
centos-epel7 111 M
 clamav-filesystem noarch 0.99.2-8.el7 
centos-epel7  21 k
 clamav-lib x86_64 0.99.2-8.el7 
centos-epel7 3.8 M


Transaction Summary
=
Install ( 3 Dependent packages)
Upgrade  1 Package

Total size: 115 M
Is this ok [y/d/N]: n
Exiting on user command
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2017-09-01.15-07.PRd5ds.yumtx
[root@tonda ~]#



-
To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com
For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com



Re: [qmailtoaster] qq soft reject errors on high load

2017-09-01 Thread Rajesh M
remo / eric

i have still not being able to resolve the qq soft reject error.

these are my findings

1) the errors i see are "error forking qmail-queue" and "ripmime error" which 
causes the qq soft reject.

2) the max concurrent connections in the logs is around 35.

3)  These errors come up during peak working hours when the server is under a  
load of 4 - 8, and they increase the load even more to over 10-15.

4) i came across this link (not sure if this is related)
https://github.com/qmail/simscan/blob/master/simscan.c

5) i can share with you my live smtp logs with simscan debug.

have extracted some lines below


Error forking qmail-queue

@400059a8fa7b0a2ed1b4 tcpserver: status: 31/200
@400059a8fa7b13162584 simscan: cdb looking up version spam
@400059a8fa7b13166bd4 simscan: runned_scanners is  attach: 1.4.0 clamav: 
0.98.6/m: spam: 3.3.2
@400059a8fa7b13166fbc simscan: found 3.3.2
@400059a8fa7b13168efc simscan:[10757]:CLEAN (5.00/30.00):9.7712s:-Possible 
Spam- RE_ REQUIRE BOOKING // 1X20  //
ICD TKD TO BANDAR 
ABASS:103.241.181.228:cs@atlasdecargo.com:rathe...@radiant-india.net
@400059a8fa7b1316cd7c simscan: done, execing qmail-queue
@400059a8fa7b1316fc5c simscan: error forking qmail-queue
@400059a8fa7b13199854 simscan: exit error code: 71
@400059a8fa7b131c4004 qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)): MAILFROM:
RCPTTO:rathe...@y.net


Error in ripmime

@400059a8fa98045a4bc4 simscan: pelookup: domain is aissamaritime.in
@400059a8fa98045a4bc4 simscan: cdb looking up aissamaritime.in
@400059a8fa98045a4fac simscan: pelookup: local part is shailesh_k_bom
@400059a8fa98045a4fac simscan: lpart: local part is **
@400059a8fa98045a5394 simscan: cdb looking up 
shailesh_k_...@aissamaritime.in
@400059a8fa98045a5394 simscan: ripmime error
@400059a8fa98045a6334 simscan: exit error code: 71
@400059a8fa98045a95fc qmail-smtpd: qq soft reject (mail server temporarily 
rejected message (#4.3.0)):
MAILFROM: RCPTTO:shailesh_k_...@yy.in


Wierd error logs

@400059a9032f3aa79a24 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aa7b964 simscan: clamdscan: 
/var/qmail/simscan/1504248613.321653.5221: OK
@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0
@400059a9032f3aaba164 simscan: clamdscan: Time: 0.135 sec (0 m 0 s)
@400059a9032f3aac39bc simscan: clamdscan: /var/qmail/simscan/15simscan: 
exit error code: 71
@400059a9032f3aaca334 04248613.308469.5216: OK
@400059a9032f3aacddcc simscan: clamdscan:
@400059a9032f3aace984 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9




@400059a9032f3aa86d14 simscan: clamdscan:
@400059a9032f3aa870fc simscan: clamdscan: ---simscan: cdb looking up 
version clamav
@400059a9032f3aa8a3c4  SCAN simscan: clamdscan: SIUnMfMeAcRtYe d- 
-fsimscan: runned_scanners is  attach: 1.4.0 clamav: 0.98.6/m:
@400059a9032f3aa8c304 -isimscan: found 0.98.6/m:
@400059a9032f3aa8c6ec -l-e-s-:- -0
@400059a9032f3aa8f1e4 --simscan: normal clamdscan return code: 0
@400059a9032f3aa8f1e4
@400059a9032f3aa8f5cc simscan: clamdscan: Infected fsimscan: clamdscan: 
iTliemes::  00
@400059a9032f3aa93834 .simscan: clamdscan: 1T1i8m es:e c0 .1(002  ms 
e0simscan: calling spamc
@400059a9032f3aa96ee4 c  s(0)simscan: calling /usr/bin/spamc simscan: 
clamdscan:
@400059a9032f3aa999dc  spamcm
@400059a9032f3aa999dc 0 s)
@400059a9032f3aa9ad64 /var/qmail/simscan/1simscan: check_spam had an error 
ret: -1
@400059a9032f3aa9e02c 504248613.307311.5215: OK
@400059a9032f337c simscan: clamdscan:
@400059a9032f3764 simscan: clamdscan: --- SCAN SUMMARY 
---
@400059a9032f3aab3fbc simscan: clamdscan: Infected files: 0

Re: [qmailtoaster] using dovecot seive

2017-09-01 Thread Rajesh M
eric / remo

will be working on remo's config over the weekend and will definitely revert 
with the step by step process

rajesh

- Original Message -
From: Eric Broch [mailto:ebr...@whitehorsetc.com]
To: qmailtoaster-list@qmailtoaster.com
Sent: Thu, 31 Aug 2017 19:35:30 -0600
Subject:

Hi Rajesh,

I'm not sure if you've gotten this working yet. I tried some
experimentation and I got this working on my host albeit that roundcube
created my files and directories under the user.

Notice especially the 'tmp' directory under ~/.sieve, you may need
it...not sure. Anyway here's everything I did.

# ls -la /home/vpopmail/domains/mydomain.com/user/
total 24
drwx--  4 vpopmail vchkpw 4096 Aug 31 19:11 .
drwx--  5 vpopmail vchkpw 4096 Aug 31 19:06 ..
-rw---  1 vpopmail vchkpw  300 Aug 31 19:11 .dovecot.lda-dupes
lrwxrwxrwx  1 vpopmail vchkpw   22 Aug 31 07:16 .dovecot.sieve ->
.sieve/roundcube.sieve
-rw---  1 vpopmail vchkpw  278 Aug 31 19:09 .dovecot.svbin
drwx-- 14 vpopmail vchkpw 4096 Aug 31 19:13 Maildir
drwx--  3 vpopmail vchkpw 4096 Aug 31 19:08 .sieve

--

# ls -la /home/vpopmail/domains/mydomain.com/user/.sieve
total 16
drwx-- 3 vpopmail vchkpw 4096 Aug 31 19:08 .
drwx-- 4 vpopmail vchkpw 4096 Aug 31 19:11 ..
-rw--- 1 vpopmail vchkpw  120 Aug 31 19:08 roundcube.sieve
drwx-- 2 vpopmail vchkpw 4096 Aug 31 19:08 tmp

--

# cat /home/vpopmail/domains/mydomain.com/user/.dovecot.sieve
# rule:[ToUserOtherDomain]
if header :contains "from" "u...@mydomain2.com"
{
         redirect "u...@myotherdomain.com";
}

--

It all came out in the log file /var/log/dovecot-lda/lda.log correctly

--

Dovecot settings: /etc/dovecot/local.conf :

protocol lda {
   mail_debug=yes
   mail_plugins = $mail_plugins sieve
   deliver_log_format = From:<%f>-<%e> :: Subject:<%s> :: Status:<%$> ::
MsgID:<%m> :: Size<%p> :: vSize<%w>
   log_path = /var/log/dovecot-lda/lda-err.log
   info_log_path = /var/log/dovecot-lda/lda.log
   #postmaster_address = postmaster@
}
plugin {
       sieve = ~/.dovecot.sieve
       sieve_dir = ~/.sieve
}

--

Dovecot settings: /etc/dovecot/toaster.conf

protocols = imap pop3 sieve

service managesieve-login {
    inet_listener sieve {
    port = 4190
    }
}

--

# ls -ld /var/log/dov*lda*
drwxrwx--- 2 vpopmail vchkpw 4096 Nov 10  2016 /var/log/dovecot-lda

--

# ls -l /var/log/dov*lda*
total 136
-rw--- 1 vpopmail vchkpw    418 Nov 12  2016 lda-err.log
-rw--- 1 vpopmail vchkpw 129882 Aug 31 19:12 lda.log

--

# cat /home/vpopmail/domains/mydomain.com/.qmail-default

|/var/qmail/bin/preline -f /usr/libexec/dovecot/deliver -d $EXT@$USER -o
postmaster_address=postmas...@mydomain.com


--

Hope this helps!

Eric


On 8/31/2017 12:12 PM, Rajesh M wrote:
> eric / remo
>
> do we need to make any changes to the files inside conf.d ?
>
> rajesh
>
> - Original Message -
> From: Rajesh M [mailto:24x7ser...@24x7server.net]
> To: qmailtoaster-list@qmailtoaster.com
> Sent: Thu, 31 Aug 2017 23:33:59 +0530
> Subject:
>
> nothing at all in /var/log/dovecot-lda/dovecot-lda.log
>
> looks like i am missing something crucial.
>
> rajesh
>
> - Original Message -
> From: Eric Broch [mailto:ebr...@whitehorsetc.com]
> To: qmailtoaster-list@qmailtoaster.com
> Sent: Thu, 31 Aug 2017 11:55:28 -0600
> Subject:
>
> Nothing/Anything in /var/log/dovecot-lda/dovecot-lda-errors.log ???
>
>
> On 8/31/2017 11:50 AM, Rajesh M wrote:
>> this is what i have done
>>
>> 2a) Add the following lines to /etc/dovecot/local.conf:
>>   protocol lda {
>> log_path = /var/log/dovecot-lda/dovecot-lda-errors.log
>> info_log_path = /var/log/dovecot-lda/dovecot-lda.log
>>  }
>>  Create and change the permissions on the directory /var/log/dovecot-lda
>>  # mkdir /var/log/dovecot-lda
>>  # chmod 770 /var/log/dovecot-lda
>>  # chown vpopmail.vchkpw /var/log/dovecot-lda
>>  Add /etc/logrotate.d/dovecot-lda and settings appropriate
>>
>> i am sending email from host...@.com to raj...@.com and a there is a 
>> sieve rule to forward the email to ad...@.com
>> email is being correctly delivered to raj...@.com but not being 
>> forwarded to ad...@.com
>>
>> [root@ns1 rajesh]# tail -f