Thanks Brian. This helps me better understand. FWIW, the software is working very well for us now... very few false positives. I'm combing through the caught spam/porn daily to do fine tuning (whitelisting, etc) and am only seeing a couple of false positives out of 1000+ caught messages daily. A pretty good ratio.

Mark





Mark

At 11:42 AM 12/23/2002, you wrote:

I sincerely doubt that there would be any way to design a product that can
reliably handle these kinds of messages. There were 76 recipients, and one of
the recipients name was "pern" which also matches the pattern P?RN. We use
that for a pattern because that particular word is obfuscated in about 20
different ways, and I have seen "PERN-O" before. Because the message was so
short (about the equal to of 4 60 character lines, the saturation level was
too high.

The saturation value is extremely difficult make really accurate with short
messages. Many adult messages are very short like this, and it needs to be
used, but it can also be the number 1 reason for a false positive.

If it wasn't for "PERN" it would have had no adult score at all. If this is a
regular occurrence, you might want to add [-3]PERN so that if this is the word
caught, it's value will be negated. Also some creative whitelisting may help.
Add "PERN" or VOTD.


On 12/23/02 2:07pm you wrote...
>Brian,
>
>Why such a high adult rating on this one?  Log entry at bottom.
>
>Thanks.
>
>Mark
>
>
>
>Date: Mon, 23 Dec 2002 10:30:46 -0500
>From: John Cristion <[EMAIL PROTECTED]>
>Subject: [NOX ADULT] RE: VOTD
>To: "Cristion, John A." <[EMAIL PROTECTED]>,
>"\"Ashley Cristion\"" <[EMAIL PROTECTED]>,
>Al Greuter <[EMAIL PROTECTED]>, Andersons <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], [EMAIL PROTECTED],
>Cathy Benson <[EMAIL PROTECTED]>,
>Charlie Stockham <[EMAIL PROTECTED]>, Chuck Dean <[EMAIL PROTECTED]>,
>Connie <[EMAIL PROTECTED]>, Dave Ritch <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Debbie Carlson <[EMAIL PROTECTED]>,
>Delores Johnson <[EMAIL PROTECTED]>, Dematatis <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Drake Warrick <[EMAIL PROTECTED]>,
>Drew Prouse <[EMAIL PROTECTED]>, Duane & Freda Clutts <[EMAIL PROTECTED]>,
>"Dub Crawford (E-mail)" <[EMAIL PROTECTED]>, [EMAIL PROTECTED],
>Emelio <[EMAIL PROTECTED]>,
>"Gilbert Jefferson (E-mail)" <[EMAIL PROTECTED]>,
>Goodier <[EMAIL PROTECTED]>, [EMAIL PROTECTED],
>Heather Cristion <[EMAIL PROTECTED]>, Inez <[EMAIL PROTECTED]>,
>Iris White <[EMAIL PROTECTED]>, "Iris White (home)" <[EMAIL PROTECTED]>,
>Jeff Cook <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED],
>Jim & Lyric Bogdanor <[EMAIL PROTECTED]>,
>Jim Gregory <[EMAIL PROTECTED]>, Jim Kinnison
><[EMAIL PROTECTED]>,
>John Vassar <[EMAIL PROTECTED]>, JR <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Kara Keener <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Karen Vassar <[EMAIL PROTECTED]>,
>Kathy Greuter <[EMAIL PROTECTED]>, Ken Gosnell <[EMAIL PROTECTED]>,
>Ken White <[EMAIL PROTECTED]>, [EMAIL PROTECTED], [EMAIL PROTECTED],
>[EMAIL PROTECTED], Linden and Tonya Mercer <[EMAIL PROTECTED]>,
>Louis Redd <[EMAIL PROTECTED]>,
>Mark Ridenour <[EMAIL PROTECTED]>, McCarty <[EMAIL PROTECTED]>,
>Melody Warford <[EMAIL PROTECTED]>, [EMAIL PROTECTED],
>Mike Stevens <[EMAIL PROTECTED]>, [EMAIL PROTECTED],
>Nancy Neel <[EMAIL PROTECTED]>, Norris <[EMAIL PROTECTED]>,
>Pastor Steve <[EMAIL PROTECTED]>, [EMAIL PROTECTED],
>Pern <[EMAIL PROTECTED]>, [EMAIL PROTECTED], [EMAIL PROTECTED],
>Rhonda Ritch <[EMAIL PROTECTED]>,
>Richard_Higdon <[EMAIL PROTECTED]>,
>"Roger Phillips @ work" <[EMAIL PROTECTED]>, Ron Wilson <[EMAIL PROTECTED]>,
>Scott Burdick <[EMAIL PROTECTED]>,
>Steve & Carol Goslen <[EMAIL PROTECTED]>,
>Steve Barber <[EMAIL PROTECTED]>, Steve Crafton <[EMAIL PROTECTED]>,
>"Steve Goslen (work)" <[EMAIL PROTECTED]>,
>Steve Soliday <[EMAIL PROTECTED]>, Taylor <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Terry Rudd <[EMAIL PROTECTED]>,
>[EMAIL PROTECTED], Vernon Stark <[EMAIL PROTECTED]>
>Reply-to: [EMAIL PROTECTED]
>X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0)
>Importance: Normal
>X-CYBERsitter-NoXMail: FAILED - Score Adult: 29 (Req: 18) Spam: 19 (Req:
>18) Tot: 48 (Req: 20)
>X-RBL-Warning: HELOBOGUS: Domain CNCFWblue.cn.edu has no MX or A records.
>X-RBL-Warning: WEIGHT10: Weight of 18 reaches or exceeds the limit of 10.
>X-Declude-Sender: [EMAIL PROTECTED] [10.1.1.10]
>X-Declude-Spoolname: D2beb0a0800cec4a6.SMD
>X-Spam-Tests-Failed: HELOBOGUS, IPNOTINMX, WEIGHT10, CYBERSITTER
>
>[The Angel Gabriel speaking to Mary:]
>"For with God nothing will be impossible." Then
>Mary said, "Behold the maidservant of the Lord!
>Let it be to me according to your word."
>
>Luke 1:37-38
>Have a terrific Monday!
>
>
>--------
>
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD (IN) [FAILED ADULT] Scores -
>Adult: 29 (Req: 18) Spam: 19 (Req: 18) ExitCode: 48 (Req: 20)
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - (Adult test) Hits/Wgt: 1/3
>(Req: 4) Matches: 1 (Req: 2) Saturation: 25 (Req: 5)
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - MSG TO:
><[EMAIL PROTECTED]>
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - MSG FROM:
><[EMAIL PROTECTED]>
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - MSG SUBJECT: RE: VOTD
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - Excessive Routing: 4
>penalty points added.
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - TO address contains
>multiple (76) recipients: 1 penalty point added.
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - Recipient list consistent
>with SPAM: 10 penalty points added.
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD -
>MATCHED:  (#Spam)STOCK(2*2) (Adlt)P?RN(1*3)
>12/23/2002 10:29:49 AM - D2beb0a0800cec4a6.SMD - Msg processed in: 109ms -
>Msg Size: 4067 bytes
>
>
>Mark Seagroves                  voice: (865) 471-3506
>Dir, Campus Computing           fax: (865) 471-3555
>Asst Prof, Computer Science             e-mail:  [EMAIL PROTECTED]
>Carson-Newman College
>
>
>
>
>Archives: http://www.mail-archive.com/nox-list%40mail.noxmail.com/
>Removal address: [EMAIL PROTECTED]


Archives: http://www.mail-archive.com/nox-list%40mail.noxmail.com/
Removal address: [EMAIL PROTECTED]
oxmail.com

Mark Seagroves                  voice: (865) 471-3506
Dir, Campus Computing           fax: (865) 471-3555
Asst Prof, Computer Science             e-mail:  [EMAIL PROTECTED]
Carson-Newman College




Archives: http://www.mail-archive.com/nox-list%40mail.noxmail.com/
Removal address: [EMAIL PROTECTED]

Reply via email to