http://bugzilla.spamassassin.org/show_bug.cgi?id=3620
------- Additional Comments From [EMAIL PROTECTED] 2004-07-19 23:54 ------- Subject: Re: SpamAssassin takes a *very* long time to process a particular message > isn't the problem that the long line of "..................." matches > this part of the regexp: > > [\d\.]+ It was that combined with the first part. I changed the [\d\.]+ and made a small change for the second paren group. That only helped, but when I removed the optional stuff at the beginning, the cost dropped dramatically (enough that I didn't attempt any more optimization). I also noticed that DOMAIN_4U2 is very slow on that message, we might want to check that and a few other rules out. Total Elapsed Time = 3.339984 Seconds User+System Time = 2.249984 Seconds Exclusive Times %Time ExclSec CumulS #Calls sec/call Csec/c Name 9.78 0.220 0.220 2 0.1100 0.1100 Mail::SpamAssassin::PerMsgStatus::DOMAIN_4U2_body_test 6.62 0.149 1.938 104 0.0014 0.0186 Mail::SpamAssassin::PerMsgStatus::BEGIN 6.53 0.147 0.230 2 0.0736 0.1150 Mail::SpamAssassin::Conf::Parser::parse 2.67 0.060 0.288 20 0.0030 0.0144 Mail::SpamAssassin::BEGIN 1.78 0.040 0.040 2 0.0200 0.0200 Mail::SpamAssassin::PerMsgStatus::DRUGS_SMEAR1_body_test 1.78 0.040 0.079 10 0.0040 0.0079 base::import 1.73 0.039 0.066 6 0.0066 0.0110 Mail::SpamAssassin::PerMsgStatus::do_head_tests 1.33 0.030 0.030 2 0.0150 0.0150 Mail::SpamAssassin::PerMsgStatus::__NIGERIAN_BODY_45_body_test 1.33 0.030 0.030 2 0.0150 0.0150 Mail::SpamAssassin::PerMsgStatus::_check_unique_words 1.33 0.030 0.030 2 0.0150 0.0150 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_235_body_test 1.33 0.030 0.030 3 0.0100 0.0100 Cwd::abs_path 1.33 0.030 0.030 2 0.0150 0.0150 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_227_body_test 1.33 0.030 0.074 1878 0.0000 0.0000 Mail::SpamAssassin::Conf::__ANON__ 1.33 0.030 0.037 1135 0.0000 0.0000 Mail::SpamAssassin::Conf::Parser::add_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_DIET1_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::DRUG_DOSAGE_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ANXIETY3_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_SLEEP2_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::DIET_3_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::LESBIAN_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_SLEEP1_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ANXIETY5_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ANXIETY1_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::ONLINE_PHARMACY_body_test 0.89 0.020 0.020 1 0.0200 0.0200 Mail::SpamAssassin::Conf::Parser::finish_parsing 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::REMOVE_POSTAL_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::FULL_REFUND_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN9_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN4_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_132_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ERECTILE1_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_96_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::REFINANCE_NOW_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_125_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_221_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::DRUG_ED_CAPS_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::MARKETING_PARTNERS_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::MEET_SINGLES_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_44_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_100_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ERECTILE3_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__NIGERIAN_BODY_41_body_test 0.89 0.020 0.020 2 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN10_body_test 0.89 0.020 0.020 4 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::do_meta_tests 0.89 0.020 0.020 1 0.0200 0.0199 Mail::SpamAssassin::Bayes::new 0.89 0.020 0.337 13 0.0015 0.0260 Mail::SpamAssassin::ArchiveIterator::BEGIN 0.89 0.020 0.020 4 0.0050 0.0050 Mail::SpamAssassin::read_cf 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::FIND_ANYTHING_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::SENT_IN_COMPLIANCE_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::AMATEUR_PORN_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::MORTGAGE_NETWORK_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN11_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_MUSCLE1_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::SUBJ_2_CREDIT_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__NIGERIAN_BODY_37_body_test 0.44 0.010 0.009 750 0.0000 0.0000 Mail::SpamAssassin::Conf::Parser::is_regexp_valid Total Elapsed Time = 3.339984 Seconds User+System Time = 2.249984 Seconds Exclusive Times %Time ExclSec CumulS #Calls sec/call Csec/c Name 0.44 0.010 0.010 65 0.0002 0.0002 constant::import 0.44 0.010 0.010 15 0.0007 0.0007 DynaLoader::dl_load_file 0.44 0.010 0.010 1 0.0100 0.0100 Getopt::Long::Parser::__ANON__ 0.44 0.010 0.010 24 0.0004 0.0004 Exporter::heavy_export 0.44 0.010 0.010 76 0.0001 0.0001 vars::import 0.44 0.010 0.010 156 0.0001 0.0001 Exporter::import 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ERECTILE_V_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::BANKRUPTCY_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::HARDCORE_PORN_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::BEST_PORN_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::FREE_GRANT_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::HAIR_LOSS_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_42_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__NIGERIAN_BODY_15_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::COMPLETELY_FREE_body_test 0.44 0.010 0.010 466 0.0000 0.0000 UNIVERSAL::can 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::BODY_ENHANCEMENT_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::CONSOLIDATE_DEBT_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::HIDE_WIN_STATUS_rawbody_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__T_FRAUD_94_body_test 0.44 0.010 0.010 205 0.0000 0.0000 Mail::SpamAssassin::Message::Node::header 0.44 0.010 0.009 750 0.0000 0.0000 Mail::SpamAssassin::PerMsgStatus::hash_line_for_rule 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::GUARANTEED_STUFF_body_test 0.44 0.010 0.010 6 0.0017 0.0017 Mail::SpamAssassin::Message::Metadata::parse_received_line 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::LYING_EYES_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::US_DOLLARS_3_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN1_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_PAIN3_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::PORN_CELEBRITY_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::UNIVERSITY_DIPLOMAS_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_DIET2_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_DIET4_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_DIET6_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::DRUG_ED_SILD_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_ERECTILE11_body_test 0.44 0.010 0.010 4 0.0025 0.0025 AutoLoader::AUTOLOAD 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::Conf::Parser::set_default_scores 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__DRUGS_DEPRESSION5_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::APPLY_FREE_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::PORN_15_body_test 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::SAVE_THOUSANDS_body_test 0.44 0.010 0.010 3 0.0033 0.0033 AutoLoader::import 0.44 0.010 0.010 1 0.0100 0.0100 Mail::SpamAssassin::PerMsgStatus::word_is_in_dictionary 0.44 0.010 0.019 227 0.0000 0.0001 Mail::SpamAssassin::Message::Node::get_header 0.44 0.010 0.010 2 0.0050 0.0050 Mail::SpamAssassin::PerMsgStatus::__THEBAT_MUA_head_test 0.44 0.010 0.010 6 0.0017 0.0017 Mail::SpamAssassin::PerMsgStatus::check_for_uppercase 0.44 0.010 0.010 74 0.0001 0.0001 Mail::SpamAssassin::PerMsgStatus::dbg 0.44 0.010 0.010 8 0.0012 0.0012 Mail::SpamAssassin::Message::get_decoded_body_text_array 0.44 0.010 0.010 1 0.0100 0.0100 Razor2::Preproc::deNewline::BEGIN 0.44 0.010 0.020 2 0.0050 0.0100 POSIX::BEGIN 0.44 0.010 0.010 4 0.0025 0.0025 Sys::Syslog::BEGIN 0.44 0.010 0.020 8 0.0012 0.0025 Mail::SpamAssassin::Message::Node::BEGIN 0.44 0.010 0.010 11 0.0009 0.0009 Net::DNS::Resolver::Base::BEGIN 0.44 0.010 0.010 3 0.0033 0.0033 Mail::SpamAssassin::HTML::BEGIN 0.44 0.010 0.010 6 0.0017 0.0016 IO::Socket::BEGIN 0.44 0.010 0.010 14 0.0007 0.0007 Mail::SpamAssassin::Message::Metadata::BEGIN ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
