[AMaViS-user] amavis-stats-0.1.21 no data in domain.com

2006-02-24 Thread Joachim Schoenberg
Hello list,

is there really nobody using this feature (domain splitting)?
I am responsible for several domains and would like to
divide the traffic graphs...

Joe

 I have installed the  amavis-stats-0.1.19 on my Linux server with
 Amavisd-new 2.3.3 .
 But I am not able to see the domain-wise graphs / stats.
 --
 The /usr/local/var/lib/amavis-stats/amavis-stats.* are getting updated 
 properly.
  /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.count 0 bytes
  /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.seen 0 bytes
  /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.state 58 bytes
 
 [EMAIL PROTECTED] #cat domain.com/amavis-stats.state
 pos: 12378614
 lastupdate: 1134474900
 LC_TIME: C
 spamsess:
 -

Did everyone solve this or has a working config for domain splitting?
I have the above problem with version 0.1.21 too.

From my log:
...
Amavis-Stats[27653]: updateRRD: 34 - /usr/local/var/lib/amavis-stats/5.rrd
Amavis-Stats[27653]: saveState(): eof: 27214354 numv: 8 lastupdate: 1140439200
Amavis-Stats[27653]: Finished - localhost
Amavis-Stats[27653]: Starting - domain1.de
Amavis-Stats[27653]: opening file 
/usr/local/var/lib/amavis-stats/domain1.de/amavis-stats.state
Amavis-Stats[27653]: opening file 
/usr/local/var/lib/amavis-stats/domain1.de/amavis-stats.cont
Amavis-Stats[27653]: opening file 
/usr/local/var/lib/amavis-stats/domain1.de/amavis-stats.seen
Amavis-Stats[27653]: start position: 26992806 numv: 8 lastupdate: 1140438900
Amavis-Stats[27653]: parseFile(/var/log/mail, 26992806, 27216124)
Amavis-Stats[27653]: saveState(): eof: 27216124 numv: 8 lastupdate: 1140438900
Amavis-Stats[27653]: saveState(): eof: 27216124 numv: 8 lastupdate: 1140439200
Amavis-Stats[27653]: Finished - domain1.de

I can see no errors in the log. I tried debug mode, no hints.
The domain1.de subfolder includes the same files like mentioned in the original 
post,
but no rrd files were created.

domain1.de is a domain I relay mail for.
If I grep /var/log/mail for lines with domain1.de and amavis manually, I get
several hundred hits but it seems to me that amavis-stats doesn't see them.

Joe


-- 

 Joachim Schoenberg  PHONE:+49 30 20377 374  
 Paul-Drude-Institut for FAX:  +49 30 20377 257  
 Solid State Electronics, Berlin



---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] SQL lookups and maddr table

2006-02-24 Thread Paolo Cravero as2594

Mark Martinec wrote:


Why domain in maddr table is in 'subdomain fields in reverse' format?


To facilitate producing a quick by-domain summary report by a single SELECT.


Mark,
I think this kind of query is not in the documentation, right?

Do you have any ready-to-use examples for this kind of reports?
Perhaps they were posted on this list so they're in the archives?!

Hvala,
Paolo


---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] SQL lookups and maddr table

2006-02-24 Thread Bartłomiej Syryjczyk

Paolo Cravero as2594 napisał(a):

Mark,
I think this kind of query is not in the documentation, right?

Do you have any ready-to-use examples for this kind of reports?
Perhaps they were posted on this list so they're in the archives?!

Hint: SUBSTRING_INDEX(domain, '.', 1)

--
___
Bartłomiej Syryjczyk
1181 Sekcja Utrzymania Ruchu
Dział Bezpieczeństwa; Wydział Rozwoju
P.I.KAMSOFT; 40-235 Katowice, ul.1 Maja 133; tel.(48-32)209-07-05; fax 
209-07-15



---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] S/MIME problem

2006-02-24 Thread Ralph
Ok, some extra information about the subject. I discovered the exact
line that is causing the problem and it was not the first line I
mentioned previously. It appeared that in between my mail server and
the pop3 server of my friend the header of one part of the message got
altered.

The outline of the mail I send is as follows.

headers

This is a multi-part message in MIME format.

--boundary
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

mail body

--boundary
Content-Type: application/x-pkcs7-signature; name=smime.p7s
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename=smime.p7s
Content-Description: S/MIME Cryptographic Signature

signature
--boundary--

However, when received, the first header line of the mail body part
got changed to:

Content-Type: text/plain;
format=flowed;
charset=ISO-8859-1

And this is what causes the signature to be invalid. If I save the
message and correct this to what it should be, the mail is valid
again. Notice the extra quotes added and the other order of the e-
mail. If I keep these and thus getting the following line.

Content-Type: text/plain; format=flowed; charset=ISO-8859-1

Then the mail is also invalid. Strangly if the header of the
attachment itself are altered (added newlines) the mail is still
valid.

But because of your responses I now understand that it is not caused
by amavis, but some other program. So I will search further in my
quest for unaltered e-mails :D. Thanks for the responses.

Greetings,

Ralph


---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] S/MIME problem

2006-02-24 Thread Mark Martinec
Ralph,

 Ok, some extra information about the subject. I discovered the exact
 line that is causing the problem ...
 Content-Type: text/plain; charset=ISO-8859-1; format=flowed

 However, when received, the first header line of the mail body part
 got changed to:
 Content-Type: text/plain;
 format=flowed;
 charset=ISO-8859-1
 And this is what causes the signature to be invalid.

 But because of your responses I now understand that it is not caused
 by amavis, but some other program. So I will search further in my
 quest for unaltered e-mails :D. Thanks for the responses.

Indeed neither amavisd-new nor Postfix does that.

  Mark


---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] SQL lookups and maddr table

2006-02-24 Thread Mark Martinec
Paolo,

  Why domain in maddr table is in 'subdomain fields in reverse' format?
  To facilitate producing a quick by-domain summary report by a single
  SELECT.

 I think this kind of query is not in the documentation, right?

The schema is documented, the rest is up to your needs, imagination
and documentation on SQL language.

 Do you have any ready-to-use examples for this kind of reports?

One general example of a sophisticated SELECT is near the end of README.sql.

If you don't already have this key indexed, this might be
beneficial for queries on maddr.domain:
  CREATE INDEX maddr_idx_domain ON maddr (domain);

Here are some example on using domain-in-reverse field:

# clean messages ordered by count, grouped by domain:
SELECT count(*) as cnt, avg(bspam_level), sender.domain
  FROM msgs
  LEFT JOIN msgrcpt ON msgs.mail_id=msgrcpt.mail_id
  LEFT JOIN maddr AS sender ON msgs.sid=sender.id
  LEFT JOIN maddr AS recip ON msgrcpt.rid=recip.id
  WHERE content='C'
  GROUP BY sender.domain ORDER BY cnt DESC LIMIT 50;

# most spamy domains, sorted by spam average, grouped by domain:
SELECT count(*) as cnt, avg(bspam_level) as spam_avg, sender.domain
  FROM msgs
  LEFT JOIN msgrcpt ON msgs.mail_id=msgrcpt.mail_id
  LEFT JOIN maddr AS sender ON msgs.sid=sender.id
  LEFT JOIN maddr AS recip ON msgrcpt.rid=recip.id
  GROUP BY sender.domain ORDER BY spam_avg DESC LIMIT 50;

# sender domains with 100 messages, sorted on sender.domain:
SELECT count(*) as cnt, avg(bspam_level) as spam_avg, sender.domain
  FROM msgs
  LEFT JOIN msgrcpt ON msgs.mail_id=msgrcpt.mail_id
  LEFT JOIN maddr AS sender ON msgs.sid=sender.id
  LEFT JOIN maddr AS recip ON msgrcpt.rid=recip.id
  GROUP BY sender.domain HAVING cnt  100
  ORDER BY sender.domain DESC LIMIT 100;


---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] amavis-stats-0.1.21 no data in domain.com

2006-02-24 Thread Shane Hickey
Joachim Schoenberg [EMAIL PROTECTED] [2006-02-24 12:57]:
 Hello list,
 
 is there really nobody using this feature (domain splitting)?
 I am responsible for several domains and would like to
 divide the traffic graphs...

Joe,
As I understand it, the domain feature in amavis-statis only works for 
to segregate the traffic based on which syslog server sent it.  That is to say, 
if you have one mailserver with many domains, it's not going to create graphs 
per domain.  However, if you had 3 mailservers each with their own domain all 
sending syslog back to the machine running amavis-stats, then you could see all 
3 graphs.
I wish it worked the way that you want.  I, too, have many domains on 
this server and many relay domains, I'd like to be able to see stats for each 
of them, but I don't think that's how it works today.

Shane

-- 
Shane Hickey [EMAIL PROTECTED]: Network/System Consultant
GPG KeyID: 777CBF3F
Key fingerprint: 254F B2AC 9939 C715 278C  DA95 4109 9F69 777C BF3F


---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] amavis-stats-0.1.21 no data in domain.com

2006-02-24 Thread Dale Walsh


On Feb 24, 2006, at 06:57 , Joachim Schoenberg wrote:


Hello list,

is there really nobody using this feature (domain splitting)?
I am responsible for several domains and would like to
divide the traffic graphs...

Joe


I have installed the  amavis-stats-0.1.19 on my Linux server with
Amavisd-new 2.3.3 .
But I am not able to see the domain-wise graphs / stats.
--
The /usr/local/var/lib/amavis-stats/amavis-stats.* are getting  
updated properly.
 /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.count 0  
bytes

 /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.seen 0 bytes
 /usr/local/var/lib/amavis-stats/domain.com/amavis-stats.state 58  
bytes


[EMAIL PROTECTED] #cat domain.com/amavis-stats.state
pos: 12378614
lastupdate: 1134474900
LC_TIME: C
spamsess:
-


Did everyone solve this or has a working config for domain splitting?
I have the above problem with version 0.1.21 too.

From my log:


How about a couple of passed entries from your amavisd-new log.


...
Amavis-Stats[27653]: updateRRD: 34 - /usr/local/var/lib/amavis- 
stats/5.rrd
Amavis-Stats[27653]: saveState(): eof: 27214354 numv: 8 lastupdate:  
1140439200

Amavis-Stats[27653]: Finished - localhost
Amavis-Stats[27653]: Starting - domain1.de
Amavis-Stats[27653]: opening file /usr/local/var/lib/amavis-stats/ 
domain1.de/amavis-stats.state
Amavis-Stats[27653]: opening file /usr/local/var/lib/amavis-stats/ 
domain1.de/amavis-stats.cont
Amavis-Stats[27653]: opening file /usr/local/var/lib/amavis-stats/ 
domain1.de/amavis-stats.seen
Amavis-Stats[27653]: start position: 26992806 numv: 8 lastupdate:  
1140438900

Amavis-Stats[27653]: parseFile(/var/log/mail, 26992806, 27216124)
Amavis-Stats[27653]: saveState(): eof: 27216124 numv: 8 lastupdate:  
1140438900
Amavis-Stats[27653]: saveState(): eof: 27216124 numv: 8 lastupdate:  
1140439200

Amavis-Stats[27653]: Finished - domain1.de


Running amavis-stats in debug mode is only recommended if your  
experiencing programming difficulties and is really meant to aid me  
in correcting any potential problems.



I can see no errors in the log. I tried debug mode, no hints.
The domain1.de subfolder includes the same files like mentioned in  
the original post,

but no rrd files were created.

domain1.de is a domain I relay mail for.
If I grep /var/log/mail for lines with domain1.de and amavis  
manually, I get
several hundred hits but it seems to me that amavis-stats doesn't  
see them.


It sees the lines as recorded in the logs otherwise it wouldn't graph  
any data.



Joe


Amavis-stats looks at the amavisd-new log entries and pulls the  
domain name form it.


If you have multi domains and log via syslog you would have entries  
like the following (I use mutliple instances of amavisd-new).


Feb 24 19:38:58 daleenterprise.com /usr/bin/amavisd[24456]:  
(24456-11) Passed CLEAN, [203.59.1.195] [203.53.37.182]  
[EMAIL PROTECTED] - [EMAIL PROTECTED], Message-ID:  
[EMAIL PROTECTED], mail_id: RYp 
+mbz4cHGd, Hits: 0.288, 12621 ms
Feb 24 19:39:04 mustangrestomods.com /usr/bin/amavisd[7582]:  
(07582-13) Passed CLEAN, [17.254.13.37] [59.167.253.82] darwin-dev- 
[EMAIL PROTECTED] -  
[EMAIL PROTECTED], Message-ID: 4A19F58B-A076-46E9-87C9- 
[EMAIL PROTECTED], mail_id: dq5un0aA9YMq, Hits: 0, 1837 ms


The first three field are the date and time, the fourth field is the  
domain name, if all the domain names fields are all the same then you  
are not logging additional servers via syslog so you will need to  
make other adjustments either by running multiple instances of  
amavisd-new (easy to do) or log the other servers via syslog (also  
easy to do).


The proposed amavisd-new 2.4 is supposed to support virtual domain  
name logging but a working model is currently not available.


-- Dale




---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] amavis-stats-0.1.21 no data in domain.com

2006-02-24 Thread Dale Walsh


On Feb 24, 2006, at 13:08 , Shane Hickey wrote:


Joachim Schoenberg [EMAIL PROTECTED] [2006-02-24 12:57]:

Hello list,

is there really nobody using this feature (domain splitting)?
I am responsible for several domains and would like to
divide the traffic graphs...


Joe,
	As I understand it, the domain feature in amavis-statis only works  
for to segregate the traffic based on which syslog server sent it.   
That is to say, if you have one mailserver with many domains, it's  
not going to create graphs per domain.  However, if you had 3  
mailservers each with their own domain all sending syslog back to  
the machine running amavis-stats, then you could see all 3 graphs.
	I wish it worked the way that you want.  I, too, have many domains  
on this server and many relay domains, I'd like to be able to see  
stats for each of them, but I don't think that's how it works today.


Not entirely try, I've successfully graphed multi domains from a  
single server using multiple instances of amavisd-new and this will  
be changing in the near future as amavisd-new progresses.




Shane


-- Dale



---
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=110944bid=241720dat=121642
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/