Re: freqsd on sa-vm masscheck box?
On 21 Feb 2021, at 0:07, John Hardin wrote: On Sun, 21 Feb 2021, Henrik K wrote: On Sat, Feb 20, 2021 at 10:30:30AM -0800, John Hardin wrote: All: It seems that freqsd was never migrated to the new masscheck VM. I'm working on doing that now, but I was wondering whether anybody remembers deferring that for a specific reason...? I don't think this will affect masschecks and rule publication, it looks like it's just background processing to support the ruleqa website. What is it supposed to do exactly, looks deprecated? It maintains the data supporting these parts of the ruleqa detail web page: 1) which file each rule lives in (partially working, seems to have problems sometimes with __subrules and T_rules) 2) when the source file was last updated (seems to be using checkout date rather than last commit date, may look deeper into that) 3) collects data for the hit rate over time graphs 4) collects data for the corpus quality analysis (I think; that's still not working) 5) potentially other less-visible stuff, like the "source details" link on the right side of the section headers I'm pretty sure that these have been broken since before the migration. -- Bill Cole b...@scconsult.com or billc...@apache.org (AKA @grumpybozo and many *@billmail.scconsult.com addresses) Not Currently Available For Hire
Re: freqsd on sa-vm masscheck box?
On Sun, 21 Feb 2021, Henrik K wrote: On Sat, Feb 20, 2021 at 10:30:30AM -0800, John Hardin wrote: All: It seems that freqsd was never migrated to the new masscheck VM. I'm working on doing that now, but I was wondering whether anybody remembers deferring that for a specific reason...? I don't think this will affect masschecks and rule publication, it looks like it's just background processing to support the ruleqa website. What is it supposed to do exactly, looks deprecated? It maintains the data supporting these parts of the ruleqa detail web page: 1) which file each rule lives in (partially working, seems to have problems sometimes with __subrules and T_rules) 2) when the source file was last updated (seems to be using checkout date rather than last commit date, may look deeper into that) 3) collects data for the hit rate over time graphs 4) collects data for the corpus quality analysis (I think; that's still not working) 5) potentially other less-visible stuff, like the "source details" link on the right side of the section headers What I was most interested in fixing was the source file reference. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.org pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 --- A superior gunman is one who uses his superior judgment to keep himself out of situations that would require the use of his superior skills. --- 2 days until George Washington's 289th Birthday
Re: freqsd on sa-vm masscheck box?
On Sat, Feb 20, 2021 at 10:30:30AM -0800, John Hardin wrote: > All: > > It seems that freqsd was never migrated to the new masscheck > VM. I'm working on doing that now, but I was wondering > whether anybody remembers deferring that for a specific > reason...? > > I don't think this will affect masschecks and rule > publication, it looks like it's just background processing to > support the ruleqa website. What is it supposed to do exactly, looks deprecated?
Re: freqsd on sa-vm masscheck box?
On Sat, 20 Feb 2021, Kevin A. McGrail wrote: I am sure it was just missed. Henrik did a great job on the box migration but that was likely missed. Any chance you can take a stab at it? Already got it mostly working. It's getting the last updated date wrong but I'm going to let it run overnight and see what happens before troubleshooting further. Is there any interest in running it once manually with a longer cutoff in order to catch up more than the last 30 days so that the performance-over-time graphs go back further? On Sat, Feb 20, 2021, 13:30 John Hardin wrote: All: It seems that freqsd was never migrated to the new masscheck VM. I'm working on doing that now, but I was wondering whether anybody remembers deferring that for a specific reason...? I don't think this will affect masschecks and rule publication, it looks like it's just background processing to support the ruleqa website. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.org pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 --- A superior gunman is one who uses his superior judgment to keep himself out of situations that would require the use of his superior skills. --- 2 days until George Washington's 289th Birthday
Re: freqsd on sa-vm masscheck box?
I am sure it was just missed. Henrik did a great job on the box migration but that was likely missed. Any chance you can take a stab at it? On Sat, Feb 20, 2021, 13:30 John Hardin wrote: > All: > > It seems that freqsd was never migrated to the new masscheck VM. I'm > working on doing that now, but I was wondering whether anybody remembers > deferring that for a specific reason...? > > I don't think this will affect masschecks and rule publication, it looks > like it's just background processing to support the ruleqa website. > > > -- > John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ > jhar...@impsec.org pgpk -a jhar...@impsec.org > key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 > --- >USMC Rules of Gunfighting #20: The faster you finish the fight, >the less shot you will get. > --- > 2 days until George Washington's 289th Birthday >
pushDNStoSVN.sh on sa-vm.apache.org - 1 DNS zone updated
spamassassin.org: pdnsutil list-zone spamassassin.org OK (use 'load-zone spamassassin.org FILE' to restore) svn status /usr/local/spamassassin/automc/svn/dns M /usr/local/spamassassin/automc/svn/dns/spamassassin.org OK svn commit -m 'DNS updates' /usr/local/spamassassin/automc/svn/dns Sendingsvn/dns/spamassassin.org Transmitting file data .done Committing transaction... Committed revision 1886730.
freqsd on sa-vm masscheck box?
All: It seems that freqsd was never migrated to the new masscheck VM. I'm working on doing that now, but I was wondering whether anybody remembers deferring that for a specific reason...? I don't think this will affect masschecks and rule publication, it looks like it's just background processing to support the ruleqa website. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.org pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 --- USMC Rules of Gunfighting #20: The faster you finish the fight, the less shot you will get. --- 2 days until George Washington's 289th Birthday
Cron ~/svn/trunk/build/mkupdates/run_nightly | /usr/bin/tee /var/www/automc.spamassassin.org/mkupdates/mkupdates.txt
+ promote_active_rules + pwd + svn co https://svn.apache.org/repos/asf/spamassassin/trunk/rules https://svn.apache.org/repos/asf/spamassassin/trunk/rulesrc /usr/local/spamassassin/automc/svn/trunk Checked out revision 1886710. Urulesrc/scores/72_scores.cf Urulesrc/scores/scores-set0 Urulesrc/scores/scores-set1 Urulesrc/scores/scores-set2 Urulesrc/scores/scores-set3 Urulesrc/scores/stats-set0 Urulesrc/scores/stats-set1 Urulesrc/sandbox/jhardin/20_misc_testing.cf Urulesrc/sandbox/jhardin/40_local_419replyto.cf Urulesrc/sandbox/jhardin/40_local_googlestorage.cf Checked out revision 1886710. + /usr/bin/perl build/mkupdates/listpromotable HTTP get: https://ruleqa.spamassassin.org/last-net?xml=1 HTTP get: https://ruleqa.spamassassin.org/1-days-ago?xml=1 HTTP get: https://ruleqa.spamassassin.org/2-days-ago?xml=1 HTTP get: https://ruleqa.spamassassin.org/3-days-ago?xml=1 HTTP get: https://ruleqa.spamassassin.org/4-days-ago?xml=1 HTTP get: https://ruleqa.spamassassin.org/5-days-ago?xml=1 + mv rules/active.list.new rules/active.list + svn diff rules + cat /var/www/ruleqa.spamassassin.org/reports/LATEST Index: rules/active.list === --- rules/active.list (revision 1886710) +++ rules/active.list (working copy) @@ -1,6 +1,6 @@ # DO NOT EDIT: file generated by build/mkupdates/listpromotable # active ruleset list, automatically generated from https://ruleqa.spamassassin.org/ -# with results from: last-net: net-axb-coi-bulk net-axb-generic net-axb-ham-misc net-darxus net-ena-week1 net-ena-week2 net-ena-week3 net-ena-week4 net-giovanni-ham net-giovanni-spam net-giovanni-spammy net-grenier net-jhardin net-llanga net-mmiroslaw-mails-ham net-mmiroslaw-mails-spam net-pds net-sihde net-spamsponge net-thendrikx; day 1: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 2: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 3: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-ma ils-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 4: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 5: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx +# with results from: last-net: net-axb-coi-bulk net-axb-generic net-axb-ham-misc net-darxus net-ena-week1 net-ena-week2 net-ena-week3 net-ena-week4 net-giovanni-ham net-giovanni-spam net-giovanni-spammy net-grenier net-jhardin net-llanga net-mmiroslaw-mails-ham net-mmiroslaw-mails-spam net-pds net-sihde net-spamsponge net-thendrikx; day 1: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge; day 2: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 3: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mm iroslaw-mails-spam pds sihde spamsponge thendrikx; day 4: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week0 ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx; day 5: axb-coi-bulk axb-generic axb-ham-misc darxus ena-week1 ena-week2 ena-week3 ena-week4 giovanni-ham giovanni-spam giovanni-spammy grenier jhardin llanga mmiroslaw-mails-ham mmiroslaw-mails-spam pds sihde spamsponge thendrikx # good enough ACCT_PHISHING_MANY + echo 'Committing promotions in rules/active.list...' Committing promotions in rules/active.list... + svn commit -m 'promotions validated' rules/active.list Sendingrules/active.list Transmitting file data .done Committing transaction... Committed revision 1886711. + /usr/bin/perl masses/rule-qa/list-bad-rules ++ date +%w + [[ 6 = 3 ]] + for VER in $VERSIONS +
