Re: Bayes filter marking everything as ham

2016-06-02 Thread Martin Gregorie
On Thu, 2016-06-02 at 12:28 +0200, Matus UHLAR - fantomas wrote: > > > > > Therefore I agree that there could be better way of noticing admins > of a [URIBL_BLOCKED] issue. > There's one obvious way of doing this for very little cost & effort: use logwatch.  If you're a pukka sysadmin you'll

Re: Bayes filter marking everything as ham

2016-06-02 Thread Reindl Harald
ot;buh my setup don't work well" style posts where it's pretty clear that nobody spent a second to ensure it works proper and others should solve it and google for them yes, that thread was primary about bayes - but at the end it's a example of a careless setup from the very start signa

Re: Bayes filter marking everything as ham

2016-06-02 Thread Matus UHLAR - fantomas
his thread started, the main reason was broken BAYES. -- Matus UHLAR - fantomas, uh...@fantomas.sk ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. Microsoft dick is soft to do no harm

Re: Bayes filter marking everything as ham

2016-06-02 Thread Reindl Harald
that actually *did* get hits on BAYES_00 in this scenario then you likely are not training the bayes database than SA is actually using. What user are you training Bayes as, and what user is SA running under? Both my sa-learn commands (manual and scripted) as well as SA pointed to the correct db, ho

Re: Bayes filter marking everything as ham

2016-06-01 Thread John Hardin
00 in this scenario then you > > likely are not training the bayes database than SA is actually using. > > What user are you training Bayes as, and what user is SA running > > under? > Both my sa-learn commands (manual and scripted) as well as SA pointed to >

Re: Bayes filter marking everything as ham

2016-06-01 Thread Peter Carlson
05:06 schrieb Peter Carlson: ok, after over 50 hours of trying to get this work, I finally have a solution. The first (certainly not the only) response that was helpful to the specific problem I posted was: If that actually *did* get hits on BAYES_00 in this scenario then you likely are not trainin

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
likely are not training the bayes database than SA is actually using. What user are you training Bayes as, and what user is SA running under? Both my sa-learn commands (manual and scripted) as well as SA pointed to the correct db, however it turns out the training I did re-wrote the ownership

Re: Bayes filter marking everything as ham

2016-06-01 Thread Peter Carlson
ok, after over 50 hours of trying to get this work, I finally have a solution. The first (certainly not the only) response that was helpful to the specific problem I posted was: If that actually *did* get hits on BAYES_00 in this scenario then you likely are not training the bayes database

Re: Bayes filter marking everything as ham

2016-06-01 Thread shanew
://www.maiamailguard.com/maia/wiki/sa-autolearn "autolearn=ham, autolearnscore=-0.001" "autolearnscore=-0.001" must be a bad joke in the config hence it's dangerous, unpredictable and will sooner or later ruin your bayes without having a corpus where you could kill bad samples

Re: Bayes filter marking everything as ham

2016-06-01 Thread Benny Pedersen
On 2016-06-01 14:14, Joe Quinn wrote: write 1000 times " YOUR SETUP IS CRIPPLED http://uribl.com/refused.shtml " in the rpeort header and every 5 seconds into the maillog so that the biggest fool can't ignore it Perhaps, score URIBL_BLOCKED -1000? disconnect

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
I've never used Cyrus, but my understanding is that it has one directory per folder that holds both emails and metadata files. You appear to be training on both. and even if not blindly train every inbox as ham is a road straight to hell for bayes, the same for spam in reality - how does one

Re: Bayes filter marking everything as ham

2016-06-01 Thread RW
On Tue, 31 May 2016 14:58:05 -0700 Peter Carlson wrote: > # grab all the user folders > users=`find /var/spool/cyrus/mail -name SPAM -print` ... >     sa-learn --nosync --spam --progress --dir $inbox/SPAM >     sa-learn --nosync --ham --progress --dir $inbox I've never used Cyrus, but my

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
Am 01.06.2016 um 15:24 schrieb Matus UHLAR - fantomas: On 6/1/2016 3:06 AM, Reindl Harald wrote: write 1000 times " YOUR SETUP IS CRIPPLED http://uribl.com/refused.shtml " in the rpeort header and every 5 seconds into the maillog so that the biggest fool can't ignore

Re: Bayes filter marking everything as ham

2016-06-01 Thread Matus UHLAR - fantomas
On 6/1/2016 3:06 AM, Reindl Harald wrote: write 1000 times " YOUR SETUP IS CRIPPLED http://uribl.com/refused.shtml " in the rpeort header and every 5 seconds into the maillog so that the biggest fool can't ignore it the setup doesn't have to be crippled to get

Re: Bayes filter marking everything as ham

2016-06-01 Thread Bowie Bailey
On 5/31/2016 8:32 PM, sha...@shanew.net wrote: Kind of a shot in the dark, but are you sure everyone is promptly moving their spam out of the inboxes? I worry about automated learning like this. Even then, it seems unlikely that every mail would get tagged by bayes as likely ham. Someone just

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
Am 01.06.2016 um 14:14 schrieb Joe Quinn: On 6/1/2016 3:06 AM, Reindl Harald wrote: Am 01.06.2016 um 02:38 schrieb David Jones: From: Reindl Harald <h.rei...@thelounge.net> Sent: Tuesday, May 31, 2016 6:27 PM To: users@spamassassin.apache.org Subject: Re: Bayes filter marking ever

Re: Bayes filter marking everything as ham

2016-06-01 Thread Joe Quinn
On 6/1/2016 3:06 AM, Reindl Harald wrote: Am 01.06.2016 um 02:38 schrieb David Jones: From: Reindl Harald <h.rei...@thelounge.net> Sent: Tuesday, May 31, 2016 6:27 PM To: users@spamassassin.apache.org Subject: Re: Bayes filter marking everything as ham Am 31.05.2016 um 23:58 schrieb

Re: Bayes filter marking everything as ham

2016-06-01 Thread Matus UHLAR - fantomas
HTML mail to mailing lists, whenever possible. All of my messages are being tagged with BAYES_00=-1.9 I have cleared the bayes db (sa-learn --clear), then I manually trained.  Here are the results: sa-learn --dump magic 0.000  0  3  0  non-token data: bayes db

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
-autolearn "autolearn=ham, autolearnscore=-0.001" "autolearnscore=-0.001" must be a bad joke in the config hence it's dangerous, unpredictable and will sooner or later ruin your bayes without having a corpus where you could kill bad samples, move them from ham to spam or the othe

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
Am 01.06.2016 um 02:38 schrieb David Jones: From: Reindl Harald <h.rei...@thelounge.net> Sent: Tuesday, May 31, 2016 6:27 PM To: users@spamassassin.apache.org Subject: Re: Bayes filter marking everything as ham Am 31.05.2016 um 23:58 schrieb Peter Carlson: May 30 09:04:53 www

Re: Bayes filter marking everything as ham

2016-06-01 Thread Reindl Harald
is causing a BAYES_00 false negative? WTF - in your original post it was not clear that bayes is your problem because even with a BAYES_00 when you would follow basic best prctices like a recusrsion dns-cache on your inbound MX you would have a ton of RBL/URIBL likely catch the message

Re: Bayes filter marking everything as ham

2016-05-31 Thread David Jones
>https://wiki.apache.org/spamassassin/ImproveAccuracy >I have gone through this wiki (and ones like it) at least a dozen times. >My server is blocking about 50% of the spam, thanks to some of the >other layers of spam protection. It's just bayes that I can't seem to get >right

Re: Bayes filter marking everything as ham

2016-05-31 Thread Martin Gregorie
On Wed, 2016-06-01 at 00:38 +, David Jones wrote: > > Too bad we couldn't make SA do something very annoying and > more obvious when the URIBL_BLOCKED rule was hit. > I notice, rather to my surprise, that the SA Wiki doesn't seem to have an entry for the URIBL_BLOCKED rule. However, since

Re: Bayes filter marking everything as ham

2016-05-31 Thread Martin Gregorie
, it looks as though you haven't searched for answers in either place before coming here.      > > My initial question still remains, why is BAYES_00 always at -1.9. > Why is it marking all messages as ham? > Because you haven't trained Bayes correctly. Training it is well explained in

Re: Bayes filter marking everything as ham

2016-05-31 Thread John Hardin
.  It's just bayes that I can't seem to get right Why is it marking all messages as ham? Probably because you're overtraining as ham. I have tried the following 3 scenarios: 1.  Training SPAM only  (it's in its own folder) Won't work, bayes needs both spam and ham

Re: Bayes filter marking everything as ham

2016-05-31 Thread Peter Carlson
of spam protection.  It's just bayes that I can't seem to get right Why is it marking all messages as ham? Probably because you're overtraining as ham. I have tried the following 3 scenarios: 1.  Training SPAM only  (it's in its

Re: Bayes filter marking everything as ham

2016-05-31 Thread John Hardin
On Tue, 31 May 2016, Peter Carlson wrote: On 05/31/2016 04:27 PM, Reindl Harald wrote: Am 31.05.2016 um 23:58 schrieb Peter Carlson: > May 30 09:04:53 www amavis[16577]: (16577-03) Passed CLEAN > {RelayedInbound}, Tests: >

Re: Bayes filter marking everything as ham

2016-05-31 Thread David Jones
>From: Reindl Harald <h.rei...@thelounge.net> >Sent: Tuesday, May 31, 2016 6:27 PM >To: users@spamassassin.apache.org >Subject: Re: Bayes filter marking everything as ham >Am 31.05.2016 um 23:58 schrieb Peter Carlson: >> May 30 09:04:53 www amavis[1657

Re: Bayes filter marking everything as ham

2016-05-31 Thread shanew
Kind of a shot in the dark, but are you sure everyone is promptly moving their spam out of the inboxes? I worry about automated learning like this. Even then, it seems unlikely that every mail would get tagged by bayes as likely ham. Someone just today suggested in another thread to add

Re: Bayes filter marking everything as ham

2016-05-31 Thread Peter Carlson
On 05/31/2016 04:27 PM, Reindl Harald wrote: Am 31.05.2016 um 23:58 schrieb Peter Carlson: May 30 09:04:53 www amavis[16577]: (16577-03) Passed CLEAN {RelayedInbound}, Tests: [BAYES_00=-1.9,RCVD_IN_MSPIKE_H2=-0.001,SPF_PASS=-0.001,URIBL_BLOCKED=0.001], autolearn=ham

Re: Bayes filter marking everything as ham

2016-05-31 Thread Reindl Harald
Am 31.05.2016 um 23:58 schrieb Peter Carlson: May 30 09:04:53 www amavis[16577]: (16577-03) Passed CLEAN {RelayedInbound}, Tests: [BAYES_00=-1.9,RCVD_IN_MSPIKE_H2=-0.001,SPF_PASS=-0.001,URIBL_BLOCKED=0.001], autolearn=ham autolearn_force=no, autolearnscore=-0.001, 3992 ms

Bayes filter marking everything as ham

2016-05-31 Thread Peter Carlson
are being tagged with BAYES_00=-1.9 I have cleared the bayes db (sa-learn --clear), then I manually trained.  Here are the results: sa-learn --dump magic 0.000  0  3  0  non-token data: bayes db version 0.000  0

Re: Bayes duplicate message detection algorithm?

2016-05-13 Thread RW
On Fri, 13 May 2016 12:44:40 -0500 (CDT) David B Funk wrote: > What algorithm does Bayes use to detect that it has already 'seen' a > given message? > > When I receive a bolus (say 40~60) of 'phish' messages from a > compromised Hotmail/gmail/yahoo account which are mostly the sam

Bayes duplicate message detection algorithm?

2016-05-13 Thread David B Funk
What algorithm does Bayes use to detect that it has already 'seen' a given message? When I receive a bolus (say 40~60) of 'phish' messages from a compromised Hotmail/gmail/yahoo account which are mostly the same (body, many headers same, only recipients, Message-ID, Date, and a few Received

Re: Bayes expiry vs. sync, again

2016-03-19 Thread RW
On Tue, 15 Mar 2016 18:00:22 -0700 Ian Zimmerman wrote: > I am sorry to return to this horse which has perhaps been beaten > enough. But I still don't know and don't understand (_after_ reading > the docs) if I can, at the same time: > > 1. completely disable expiry You can only disable

Bayes expiry vs. sync, again

2016-03-15 Thread Ian Zimmerman
does _not_ necessarily force one. (The manpage is ambiguous about it.) But I don't want to pass --force-expire because of 1. I am asking in the context of using the default db backend for Bayes, but if there is a way to do this with one of the other options, I'll consider it. -- Please

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Robert Chalmers
working. So fortunately not too badly out of whack… thanks folks. Robert > On 3 Mar 2016, at 16:06, Tom Hendrikx <t...@whyscream.net> wrote: > > > Hi, > > you probably messed up the permissions by running sa-learn or any other > tool that messes with the bayes f

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread RW
On Thu, 3 Mar 2016 15:35:38 + Robert Chalmers wrote: > So what exactly is the ?kludge? - given that mostly I followed the > Wiki and various other setup guidelines? I?m not doing per user > configs, but site wide. If you are running spamd as spamuser the files, and the directory they are

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Tom Hendrikx
Hi, you probably messed up the permissions by running sa-learn or any other tool that messes with the bayes files directly (i.e. not via spamd) as root. Your changes work because they allow read/write access to anyone on the system, which is not very secure. Best would be to do something like

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Robert Chalmers
ok, I can see that. Interesting I missed it on the set up So, I’m running on OSX, and have to use plist files to start processes. The spamd owner is ‘spamuser’ - ( just because I did…. and as it’s not used outside that, I may as well leave it as such.) /opt/local/bin/daemondo

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread RW
On Thu, 3 Mar 2016 14:46:33 + Robert Chalmers wrote: > > /var/spamassassin/bayes_db > > drwxr-xr-x 3 root wheel 102 3 Mar 14:37 . > drwxr-xr-x 28 root wheel 952 23 Jan 15:58 .. > drwxr-xr-x 5 root wheel 170 3 Mar 14:37 bayes_db > > > -rw-rw-rw- 1 root wheel 2304 3 Mar

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Reindl Harald
Am 03.03.2016 um 15:30 schrieb Robert Chalmers: ok, I fixed it, but what is it recording ??? tail -f bayes_journal t 1457015338 ba89bf20a0 t 1457015338 f5539dc198 t 1457015338 11973086ed http://spamassassin.apache.org/full/3.4.x/doc/sa-learn.html the timestamps when a token was last seen

Re: What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Robert Chalmers
ok, I fixed it, but what is it recording ??? tail -f bayes_journal t 1457015338 ba89bf20a0 t 1457015338 f5539dc198 t 1457015338 11973086ed > On 3 Mar 2016, at 14:22, Robert Chalmers wrote: > > /var/spamassassin/bayes_db/bayes_journal Robert Chalmers

What do I do to fix this? bayes db update ignored: Permission denied

2016-03-03 Thread Robert Chalmers
Should this set of directories be globally writable? Or writable by spamd? or postfix? spamd[298]: bayes: cannot write to /var/spamassassin/bayes_db/bayes_journal, bayes db update ignored: Permission denied Robert Chalmers rob...@chalmers.com <mailto:rob...@chalmers.com>.au Quantum

Re: Redis Bayes Expire

2016-03-02 Thread Reindl Harald
Am 02.03.2016 um 16:52 schrieb Marc Perkel: My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Google "spamassassin redis expire" and hit number 2: http://www.gossamer-threads

Re: Redis Bayes Expire

2016-03-02 Thread Axb
On 03/02/2016 05:32 PM, Marc Perkel wrote: On 03/02/16 08:02, Axb wrote: On 03/02/2016 04:52 PM, Marc Perkel wrote: My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Here's my settings

Re: Redis Bayes Expire

2016-03-02 Thread Marc Perkel
On 03/02/16 08:02, Axb wrote: On 03/02/2016 04:52 PM, Marc Perkel wrote: My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Here's my settings. bayes_sql_dsn server=localhost:6379

Re: Redis Bayes Expire

2016-03-02 Thread Axb
On 03/02/2016 05:02 PM, Axb wrote: On 03/02/2016 04:52 PM, Marc Perkel wrote: My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Here's my settings. bayes_sql_dsn server=localhost:6379

Re: Redis Bayes Expire

2016-03-02 Thread Axb
On 03/02/2016 04:52 PM, Marc Perkel wrote: My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Here's my settings. bayes_sql_dsn server=localhost:6379 use_bayes 1 use_bayes_rules 1 # Your

Redis Bayes Expire

2016-03-02 Thread Marc Perkel
My Redis bayes keeps growing. It acts like it's not expiring like it should. Do I need to do something to force expire? Also - anything ekse I should set? Here's my settings. bayes_sql_dsn server=localhost:6379 use_bayes 1 use_bayes_rules 1 # Your choice if you want to use auto_learn

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread John Hardin
On Thu, 25 Feb 2016, RW wrote: On Thu, 25 Feb 2016 13:58:03 -0800 (PST) John Hardin wrote: On Thu, 25 Feb 2016, Steve wrote: b) Configure spamc -C report (run as any user) to initiate training of the amavis bayes database (in ~amavis/.spamassassin) ? That would probably be a code change

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread RW
On Thu, 25 Feb 2016 13:58:03 -0800 (PST) John Hardin wrote: > On Thu, 25 Feb 2016, Steve wrote: > > b) Configure spamc -C report (run as any user) to initiate > > training of the amavis bayes database (in ~amavis/.spamassassin) ? > > That would probably be a code ch

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread Reindl Harald
Am 25.02.2016 um 22:58 schrieb John Hardin: b) Configure spamc -C report (run as any user) to initiate training of the amavis bayes database (in ~amavis/.spamassassin) ? That would probably be a code change, unless you want to write a wrapped script that calls the real spamc and then sa

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread John Hardin
- and autolearn became self-reinforcing as a result. I had been misinterpreting my logs (face-palm)! I now see that the training initiated by spamc (behind dovecot antispam) was trying to train the bayes database in ~/.spamassassin/bayes* - but amavis was using the bayes database in ~ amavis

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread Bill Cole
would say that autolearn is probably the cause of this behavior. Note that the bayes score doesn't contribute to the autolearning decision to avoid positive feedback, but if there are no non-Bayes spam signs and the message scores lightly negative like that one does, it can be learned as ham. T

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-25 Thread RW
On Thu, 25 Feb 2016 00:41:04 + Steve wrote: > On 24/02/2016 22:59, John Hardin wrote: > > How do you train your Bayes? Autolearn? General user submissions? > > Trusted user submissions? Only you, from only your personal mail? > Only my personal mailbox *really* matte

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread Reindl Harald
the result of purge the whole bayes (commercial appliance using SpamAssassin as one part) after build up my own spamfilter solution, keep the whole corpus and *only* train by hand with no autlearning/autoexpire the bayes is 100% trustworthy and can be scored as nearly posion pill for sp

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread John Hardin
On Thu, 25 Feb 2016, Reindl Harald wrote: 7.0 URIBL_BLACKContains an URL listed in the URIBL blacklist [URIs: leslie-bib***b.org] That, too. Steve, you might consider boosting your local score for URIBL_BLACK. :) -- John Hardin KA7OHZ

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread John Hardin
the cause of this behavior. Note that the bayes score doesn't contribute to the autolearning decision to avoid positive feedback, but if there are no non-Bayes spam signs and the message scores lightly negative like that one does, it can be learned as ham. That would make any subsequent similar messages s

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread Reindl Harald
INVESTMENT_ADVICE BODY: Message mentions investment advice 1.5 BAYES_50 BODY: Bayes spam probability is 40 to 60% [score: 0.5002] 0.0 HTML_MESSAGE BODY: HTML included in message -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread Steve
match BAYES_00 - attracting a default score of -1.9. BAYES_00 seems to be at the crux of the misclassification. Is there a way to delve into why these messages have been allocated such a low bayes score - while (to a human) appearing blatant, simple, spam on "vanilla" spam topics? Ha

Re: Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread John Hardin
positives all match BAYES_00 - attracting a default score of -1.9. BAYES_00 seems to be at the crux of the misclassification. Is there a way to delve into why these messages have been allocated such a low bayes score - while (to a human) appearing blatant, simple, spam on "vanilla" spam to

Spamassassin Bayes... "why give that spam that score???"

2016-02-24 Thread Steve
. * The emails consist fairly plain HTML and appear not to employ any significant obfuscation. * I have tried to train spamassassin with many of these spam samples - without any effect. * The bayes database is updated. The bayes_journal (37k), bayes_seen (5.2mb) and bayes_toks (5.4mb) files all have recent

Re: Error when trying to re-use Bayes database from one server to another

2016-02-16 Thread Kris Deugau
John Hardin wrote: > On Fri, 12 Feb 2016, Kris Deugau wrote: > >> In general though, if you're operating at a scale where one server isn't >> enough to handle your SA load, you may want to start thinking about SQL >> for Bayes, which can be shared much more easily than pus

[Solved] Re: Error when trying to re-use Bayes database from one server to another

2016-02-14 Thread Sebastian Arcus
that in the end I decided not to mess too much with a working system and didn't upgrade to db48 on the older system. I went down the route of backing up and restoring the bayes database using sa-learn - which worked perfectly fine. There is still the question of the initial sa-learn error message

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Marc Perkel
fine and relieable, at least without autolearning and autoexpire and having the bayes-db path read-only for the running spamd with namespaces 0 60388SPAM 0 21651HAM 02510401TOKEN insgesamt 73M -rw--- 1 sa-milt sa-milt 10M 2016-02-13 09:12 bayes_seen -rw--- 1 sa

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Reindl Harald
networks for different clients BDB works fine and relieable, at least without autolearning and autoexpire and having the bayes-db path read-only for the running spamd with namespaces 0 60388SPAM 0 21651HAM 02510401TOKEN insgesamt 73M -rw--- 1 sa-milt sa-milt 10M 2016

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Marc Perkel
it comes to different servers in different networks for different clients BDB works fine and relieable, at least without autolearning and autoexpire and having the bayes-db path read-only for the running spamd with namespaces 0 60388SPAM 0 21651HAM 02510401TOKEN insgesamt

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Reindl Harald
work in the cases we have in real life where another company with independent infrastructure fetchs our bayes in context of a subscription over webservices, move the files in a temp-folder and train own samples before replace the local bayes with the result reason? 2510401 tokens with dump

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Antony Stone
On Saturday 13 February 2016 at 16:50:56, Reindl Harald wrote: > a different company with it's own infrastructure has no business to > ssh-tunneling or access *my server* in any other way directly > > DIFFERENT NETWORKS > DIFFERENT INFRASTRUCTURES > DIFFERENT OWNERS > DIFFERENT ADMINS > > NO

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Reindl Harald
database to the customer, for use on their own machines. Sounds perfectly reasonable to share this as a commercial service, to me that's exactly what happens, fetch the bayes over a webservice when the checksum has changed - nobody on both sides want to use redis for a million reasons the point

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Bill Cole
On 13 Feb 2016, at 3:49, Sebastian Arcus wrote: Thank you. The donor machine has db42, db44 and db44 packages installed, Based on the question below, I'll assume the second db44 above was a typo for db48, i.e. a Berkeley DB v4.8.x package. Tangentially: that's a risky mess. It's a common

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Sebastian Arcus
On 13/02/16 18:58, Bill Cole wrote: On 13 Feb 2016, at 3:49, Sebastian Arcus wrote: Thank you. The donor machine has db42, db44 and db44 packages installed, Based on the question below, I'll assume the second db44 above was a typo for db48, i.e. a Berkeley DB v4.8.x package. Yes - sorry,

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Reindl Harald
autolearning and autoexpire and having the bayes-db path read-only for the running spamd with namespaces 0 60388SPAM 0 21651HAM 02510401TOKEN insgesamt 73M -rw--- 1 sa-milt sa-milt 10M 2016-02-13 09:12 bayes_seen -rw--- 1 sa-milt sa-milt 81M 2016-02-13 09:12

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Reindl Harald
Am 13.02.2016 um 02:46 schrieb Benny Pedersen: On 12. feb. 2016 20.06.52 Marc Perkel <supp...@junkemailfilter.com> wrote: # ls -l /var/spool/spamd/bayes/ Set bayes path without bayes why do you always give wrong advises? https://wiki.apache.org/spamassassin/SiteWideBayesSetu

Re: Error when trying to re-use Bayes database from one server to another

2016-02-13 Thread Sebastian Arcus
DB (Hash, version 9, native byte-order) On the receiver machine, but with bayes files created locally: #file bayes_seen bayes_seen: Berkeley DB (Hash, version 8, native byte-order) # file bayes_toks bayes_toks: Berkeley DB (Hash, version 8, native byte-order) Could the hash version account

Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted. I re-transferred them several times over ssh, to make sure they were not corrupted. The database files are in the correct

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread John Hardin
On Fri, 12 Feb 2016, Sebastian Arcus wrote: # ls -l /var/spool/spamd/bayes/ total 5912 -rw-rw-rw- 1 spamd spamd 1310720 2016-02-09 08:42 bayes_seen -rw-rw-rw- 1 spamd spamd 4739072 2016-02-09 08:43 bayes_toks When I try to learn a new message on the receiving server (where I moved the bayes

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 16:59, Reindl Harald wrote: Am 12.02.2016 um 17:29 schrieb Sebastian Arcus: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted. I re-transferred them several

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Reindl Harald
mail - that was already verified looking closer "No such file or directory" is not a permission problem there was a hint "please re-run with -D" at least re-use bayes on different servers, even over different operating systems is no problem, or bayes is running on 3 own and

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 16:59, Reindl Harald wrote: Am 12.02.2016 um 17:29 schrieb Sebastian Arcus: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted. I re-transferred them several

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Marc Perkel
from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted. I re-transferred them several times over ssh, to make sure they were not corrupted. The database files are in the correct location

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Bill Cole
) On the receiver machine, but with bayes files created locally: #file bayes_seen bayes_seen: Berkeley DB (Hash, version 8, native byte-order) # file bayes_toks bayes_toks: Berkeley DB (Hash, version 8, native byte-order) Could the hash version account for the errors I am seeing? Absolutely

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
look at the directories. see previous mail - that was already verified looking closer "No such file or directory" is not a permission problem there was a hint "please re-run with -D" at least re-use bayes on different servers, even over different operating systems is

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread John Hardin
On Fri, 12 Feb 2016, Kris Deugau wrote: In general though, if you're operating at a scale where one server isn't enough to handle your SA load, you may want to start thinking about SQL for Bayes, which can be shared much more easily than pushing file-based Bayes data around. Or Redis (right

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 20:49, Bowie Bailey wrote: On 2/12/2016 3:45 PM, Sebastian Arcus wrote: On 12/02/16 20:31, Antony Stone wrote: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Kris Deugau
Sebastian Arcus wrote: > On 12/02/16 20:31, Antony Stone wrote: >> On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: >> >>> As per advice from this list, I have been re-using my bayes databases on >>> several different servers running SA. On one of the

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 20:31, Antony Stone wrote: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted. Are the servers all

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Reindl Harald
ignore my last post, which assumed it was an SElinux problem. Could the problem be down to differing versions of the bayes database manager? If so, it may be worth letting SA set up an empty Bayes database and using the backup tool to make a backup on the source system in a version-agnostic format, e.g

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 21:40, Kris Deugau wrote: Sebastian Arcus wrote: On 12/02/16 20:31, Antony Stone wrote: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Martin Gregorie
hich assumed it was an SElinux problem. Could the problem be down to differing versions of the bayes database manager? If so, it may be worth letting SA set up an empty Bayes database and using the backup tool to make a backup on the source system in a version-agnostic format, e.g as a CSV file, and th

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Reindl Harald
Am 12.02.2016 um 22:40 schrieb Kris Deugau: In general though, if you're operating at a scale where one server isn't enough to handle your SA load, you may want to start thinking about SQL for Bayes, which can be shared much more easily than pushing file-based Bayes data around

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Antony Stone
On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: > As per advice from this list, I have been re-using my bayes databases on > several different servers running SA. On one of the servers though, the > database is not accepted. Are the servers all the same distro, release an

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Bowie Bailey
On 2/12/2016 3:45 PM, Sebastian Arcus wrote: On 12/02/16 20:31, Antony Stone wrote: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Martin Gregorie
On Fri, 2016-02-12 at 15:49 -0500, Bowie Bailey wrote: > On 2/12/2016 3:45 PM, Sebastian Arcus wrote: > > On 12/02/16 20:31, Antony Stone wrote: > > > On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: > > > > > > > As per advice from t

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Reindl Harald
Am 12.02.2016 um 21:31 schrieb Antony Stone: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one of the servers though, the database is not accepted

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Sebastian Arcus
On 12/02/16 21:40, Kris Deugau wrote: Sebastian Arcus wrote: On 12/02/16 20:31, Antony Stone wrote: On Friday 12 February 2016 at 17:29:23, Sebastian Arcus wrote: As per advice from this list, I have been re-using my bayes databases on several different servers running SA. On one

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Benny Pedersen
On 12. feb. 2016 20.06.52 Marc Perkel <supp...@junkemailfilter.com> wrote: # ls -l /var/spool/spamd/bayes/ Set bayes path without bayes bayes: cannot open bayes databases /var/spool/spamd/bayes/bayes_* R/W: Remove bayes from local.cf Sent with AquaMail for Android http://ww

Re: Error when trying to re-use Bayes database from one server to another

2016-02-12 Thread Marc Perkel
For what it's worth - just used Redis. Redis is the only thing that's worked reliably for me.

Re: Can your bayes do this?

2016-01-24 Thread Dave Warren
On 2016-01-20 22:21, Marc Perkel wrote: Here is a list of 3494938 words and phrases used in the subject line of SPAM and never seen in the subject line of HAM http://www.junkemailfilter.com/data/subject-spam.txt I thought I'd take you up on this using a combination of my corpus, and the

<    1   2   3   4   5   6   7   8   9   10   >