Script 'mail_helper' called by obssrc Hello community, here is the log from the commit of package rspamd for openSUSE:Factory checked in at 2021-11-10 21:47:09 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Comparing /work/SRC/openSUSE:Factory/rspamd (Old) and /work/SRC/openSUSE:Factory/.rspamd.new.1890 (New) ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Package is "rspamd" Wed Nov 10 21:47:09 2021 rev:7 rq:930680 version:3.1 Changes: -------- --- /work/SRC/openSUSE:Factory/rspamd/rspamd.changes 2021-06-09 21:53:30.454603662 +0200 +++ /work/SRC/openSUSE:Factory/.rspamd.new.1890/rspamd.changes 2021-11-10 21:47:58.943851568 +0100 @@ -1,0 +2,386 @@ +Wed Nov 3 13:39:29 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- Update to 3.1 + - [Feature] Add junk_threshold for autolearn + - [Feature] Add neural test command + - [Feature] Antivirus: Allow to set fake eicar patterns for + testing AV engines + - [Feature] Lua_cdb: Add cdb building interface + - [Feature] Ratelimit: Add per bucket configurations + - [Feature] S3: Allow to store structured data in messagepack + - [Fix] Add concept of uncancellable events to prevent + use-after-free + - [Fix] Add temporary guard to prevent linked list exploitation + - [Fix] Allow spaces in DKIM key records + - [Fix] Another rework of the ucl hashing + - [Fix] Another try to fix references safety + - [Fix] Another try to fix rspamd_text passing in the selectors + - [Fix] Avoid copy for received structure as it has raw C + pointers + - [Fix] Avoid dangling reference + - [Fix] Correctly check numeric URLs in URL DNS lists + - [Fix] Delete the correct pointer type + - [Fix] Dmarc: Always lowercase domain + - [Fix] Fix compilation of the hyperscan databases with errors + - [Fix] Fix hash table lookup + - [Fix] Fix http message flag shift + - [Fix] Fix parsing of the from_hostname when it is an IP address + - [Fix] Fix parsing of the unquoted attributes in HTML + - [Fix] Fix passing of rspamd_text in selectors pipelines + - [Fix] Fix rubbish QP sequences decoding + - [Fix] Fix some complicated case with the closing tags parsing + - [Fix] Fix the case when l tag is too small + - [Fix] Html: Fix the case where only bgcolor is explicitly set + - [Fix] Libucl: Fix deletion from ucl objects + - [Fix] Namespace and add metadata for OpenMetrics, fix + interleaving + - [Fix] Plug memory leak in http settings reload + - [Fix] Preserve SPF top record in the mempool variable + - [Fix] Remove aarch64 GC64 workaround + - [Fix] Remove bogus G_LIKELY + - [Fix] Spf: Do not parse non TXT DNS replies as TXT replies + - [Fix] Try to use on_connect/on_disconnect callbacks to handle + internal Redis failures + - [Fix] buffer overflow in rspamc counters + - [Fix] fix static building + - [Fix] lua_scanners - message_min_words logic + - [Fix] src/lua/lua_mimepart.c: fix null dereference + - [Project] Add constant iterators + - [Project] Add helper library to handle mime strings in a more + safe matter + - [Project] Add preliminary support of CDB bayes dump + - [Project] Add trim operations + - [Project] Allow mempool allocated mime strings + - [Project] Cdb: Finish backend implementation + - [Project] Cdb: Fix configuration load + - [Project] Cdb: Use shared data between cdb statfiles + - [Project] Cdb: continue statistics backend implementation + - [Project] Finish received headers rework part + - [Project] Move C++ specific declarations to C++ header + - [Project] Rework received headers parsing to C++ + - [Project] Start using of the new received structure + - [Project] Start work on cdb backend + - [Rework] Further rework of the redis pool + - [Rework] Redis_pool: fix issues found + - [Rework] Rework learn and add classify condition + - [Rework] Save invisible content to a separate buffer + - [Rework] Start rewriting of the redis pool logic + - [Rules] Improve zero font rule + Full Changelog: https://github.com/rspamd/rspamd/compare/3.0...3.1 +- drop patches included in this update: + https://github.com/onqtam/doctest/commit/099d5414e97244ec44cf46b14cd176b3a3dc52e3.patch + https://github.com/rspamd/rspamd/commit/cdedeb9f4.patch + https://github.com/rspamd/rspamd/commit/309bb213cf.patch + +------------------------------------------------------------------- +Thu Sep 30 17:58:39 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- backported https://github.com/onqtam/doctest/commit/099d5414e97244ec44cf46b14cd176b3a3dc52e3.patch + slighty modified to match rspamd + +------------------------------------------------------------------- +Fri Sep 17 22:31:22 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- backport https://github.com/rspamd/rspamd/commit/cdedeb9f4.patch + improve lua 5.4 support + +------------------------------------------------------------------- +Fri Sep 17 21:18:15 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- switch to autosetup, all target distros are new enough + +------------------------------------------------------------------- +Fri Sep 17 21:17:54 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- backport https://github.com/rspamd/rspamd/commit/309bb213cf.patch + to actually make it use system fmt + +------------------------------------------------------------------- +Fri Sep 17 20:42:24 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- force gcc 9 all distros before Tumbleweed: + leap default compiler is gcc7 which is not enough anymore + +------------------------------------------------------------------- +Fri Sep 17 20:30:05 UTC 2021 - Marcus Rueckert <mrueck...@suse.de> + +- use system libfmt and libzstd instead of building the intree copy + +------------------------------------------------------------------- +Thu Aug 19 23:06:34 UTC 2021 - Michael Str??der <mich...@stroeder.com> + +- removed obsolete rspamd-add-lua-5.4.patch +- update to 3.0 + * [Conf] Align ARC scores with DKIM scores + * [CritFix] Neural: Fix sorting application + * [Feature] Add a simple dumper for bayes tokens + * [Feature] Add lua_maps.fill_config_maps function + * [Feature] Add preliminary exporter to AWS S3 + * [Feature] Add preliminary restore bayes support + * [Feature] Add race condition protection against hs_helper restarts + * [Feature] Add rspamd_utf8_strcmp utility + * [Feature] Add zstd streaming API + * [Feature] Allow to log severity level explicitly + * [Feature] Allow to save and show attachment name when inserting AV scan results + * [Feature] Allow to sort urls for Lua + * [Feature] Allow to specify different timeouts/retransmits for fuzzy rules + * [Feature] Aws_s3: Allow to compress data stored + * [Feature] CMakeLists.txt: Change check and run-test to use rspamd-test-cxx * fixes #3807 + * [Feature] Dmarc_report: allow sending reports in batches + * [Feature] Fuzzy_check: Allow to disable subject when making short text hash + * [Feature] Lua_cryptobox: Add keyed ssl hash functions via HMAC + * [Feature] Lua_task: Add get_urls_filtered method + * [Feature] Make monitored checks less frequent + * [Feature] Milter_headers: Add x-rspamd-pre-result header + * [Feature] Neural: Allow to balance FP/FN for the network + * [Feature] Ppopagate monitored errors from rbl module + * [Feature] Pyzor calculate score dynamically Count - WL-Count of default_score in percent + * [Feature] Rbl: Distinguish flattened and non-flattened selectors in RBL requests + * [Feature] Re-add pyzor support + * [Feature] Settings: add ip_map check and rework structure slightly + * [Feature] Spamassassin: Allow to set the default priority for SA scores + * [Feature] Strip smtp comments from message id + * [Feature] add SYSTEM_ZSTD cmake option To use the system zstd instead on the bundled version + * [Feature] external_relay plugin + * [Feature] rspamadm clickhouse neural_train subcommand + * [Fix] #3400 milter_headers: fix inverted logic for extended_headers_rcpt + * [Fix] ASN: fix _FAIL symbol for when main symbol is disabled + * [Fix] Add a special logic for text part with no text extraction + * [Fix] Add diacritics flag for several eu languages + * [Fix] Another FSM fix to accomodate possibility of multiple consequent ? + * [Fix] Avoid curse of dynamic array referencing + * [Fix] Avoid reinitialising neural settings + * [Fix] Check remain before processing TXT records + * [Fix] Enable error multiplier on http errors + * [Fix] Finally rework parsing entities logic + * [Fix] Fix '==' parsing in the content type attributes parser + * [Fix] Fix IPv6 expansion for SPF macros + * [Fix] Fix Mozilla Message-ID detection + * [Fix] Fix an edge case in BITCOIN_ADDR rule + * [Fix] Fix brain-damaged behaviour when http request has a custom Host header + * [Fix] Fix check of limits in email address parsing + * [Fix] Fix copy&paste error and rework + * [Fix] Fix expressions logic for and/or and float values + * [Fix] Fix fuzzy retransmits + * [Fix] Fix http maps with no or invalid expires data + * [Fix] Fix last quote character parsing in the content-type state machine + * [Fix] Fix normalisation flags propagation + * [Fix] Fix overflow when appending many broken tags + * [Fix] Fix parsing of rfc2047 tokens with '?' inside + * [Fix] Fix phishing flag set + * [Fix] Fix rfc2047 embedded into rfc2231 pieces in special headers + * [Fix] Fix round-robin rotation + * [Fix] Fix searching for symbols + * [Fix] Fix storing of the regexps inside variant + * [Fix] Fix tokenization near exceptions + * [Fix] Fix visibility calculations + * [Fix] Html: Attach inline tags to the structure + * [Fix] Html: Do not treat empty tags as block tags + * [Fix] Ical: Do not extract urls from all flags using merely specific ones + * [Fix] Initialise symcache even if it cannot be loaded properly + * [Fix] Lua_fuzzy: Remove text parts check when checking image dimensions + * [Fix] Lua_maps: Fix adjustments for the map type in the complex map definitions + * [Fix] Lua_task: Fix deleted symbols in has_symbol/get_symbol + * [Fix] Move metric and symcache link from validation to the init stage + * [Fix] Oletools: Another try to fix table sorting + * [Fix] One more default behaviour fix + * [Fix] Phishing: Rework urls processing + * [Fix] RBL: was missing some config schema + * [Fix] Replies: Fix 'Reply-To' handling in task:get_reply_sender + * [Fix] Rework metrics handling + * [Fix] Save symcache on exit + * [Fix] Selectors: Filter nil elements in lists + * [Fix] Selectors: Properly fix implicit tostring for nils + * [Fix] Try to fix some broken code in DMARC reporting plugin + * [Fix] Urls: Fix processing of html urls when it comes to the flags + * [Fix] Use proper buffer length + * [Fix] Various visibility fixes ++++ 189 more lines (skipped) ++++ between /work/SRC/openSUSE:Factory/rspamd/rspamd.changes ++++ and /work/SRC/openSUSE:Factory/.rspamd.new.1890/rspamd.changes Old: ---- rspamd-2.7.tar.gz rspamd-add-lua-5.4.patch New: ---- rspamd-3.1.tar.gz ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Other differences: ------------------ ++++++ rspamd.spec ++++++ --- /var/tmp/diff_new_pack.WIo2g4/_old 2021-11-10 21:47:59.415851773 +0100 +++ /var/tmp/diff_new_pack.WIo2g4/_new 2021-11-10 21:47:59.419851775 +0100 @@ -52,12 +52,12 @@ %global _wwwdir /srv/www/webapps -%if 0%{?suse_version} && 0%{?suse_version} < 1500 +%if 0%{?suse_version} && 0%{?suse_version} < 1550 %global force_gcc_version 9 %endif Name: rspamd -Version: 2.7 +Version: 3.1 Release: 0 Summary: Spam filtering system License: Apache-2.0 @@ -68,7 +68,6 @@ Patch0: rspamd-conf.patch Patch1: rspamd-after-redis-target.patch # PATCH-FIX-UPSTREAM - https://github.com/rspamd/rspamd/issues/3656 -Patch2: rspamd-add-lua-5.4.patch %if !0%{?is_opensuse} # because 80-check-malware-scan-clamav triggered in SLE-15-SP2 BuildRequires: -post-build-checks-malwarescan @@ -100,6 +99,7 @@ BuildRequires: pcre2-devel %endif BuildRequires: pkgconfig +BuildRequires: pkgconfig(fmt) BuildRequires: pkgconfig(glib-2.0) >= 2.28 %if %{with ext_hiredis} BuildRequires: pkgconfig(hiredis) @@ -116,11 +116,16 @@ BuildRequires: pkgconfig(systemd) %{?systemd_ordering} %endif +BuildRequires: pkgconfig(libzstd) -%if 0%{?suse_version} < 1500 -Requires: lua51-LPeg +%if 0%{?suse_version} >= 1550 +Requires: lua54-lpeg %else +%if 0%{?suse_version} >= 1500 Requires: lua53-lpeg +%else +Requires: lua51-LPeg +%endif %endif %if 0%{?with split_out_client} Requires: rspamd-client = %{version} @@ -163,10 +168,7 @@ %endif %prep -%setup -q -%patch0 -p1 -%patch1 -p1 -%patch2 -p1 +%autosetup -p1 %build %if 0%{?force_gcc_version} @@ -229,6 +231,8 @@ %if %{with jemalloc} -DENABLE_JEMALLOC=ON \ %endif + -DSYSTEM_FMT=ON \ + -DSYSTEM_ZSTD=ON \ -DDEBIAN_BUILD=1 \ -DRSPAMD_GROUP=%{rspamd_group} \ -DRSPAMD_USER=%{rspamd_user} @@ -373,6 +377,7 @@ %dir %{_sysconfdir}/rspamd/modules.d %config(noreplace) %{_sysconfdir}/rspamd/modules.d/antivirus.conf +%config(noreplace) %{_sysconfdir}/rspamd/modules.d/aws_s3.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/arc.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/asn.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/chartable.conf @@ -383,6 +388,7 @@ %config(noreplace) %{_sysconfdir}/rspamd/modules.d/dmarc.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/elastic.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/emails.conf +%config(noreplace) %{_sysconfdir}/rspamd/modules.d/external_relay.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/external_services.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/force_actions.conf %config(noreplace) %{_sysconfdir}/rspamd/modules.d/forged_recipients.conf @@ -421,7 +427,9 @@ %dir %{_sysconfdir}/rspamd/override.d %dir %{_datadir}/rspamd +%{_datadir}/rspamd/aws_s3.lua %{_datadir}/rspamd/effective_tld_names.dat +%{_datadir}/rspamd/external_relay.lua %{_datadir}/rspamd/http_headers.lua %dir %{_datadir}/rspamd/elastic @@ -484,6 +492,7 @@ %{_datadir}/rspamd/lualib/global_functions.lua %{_datadir}/rspamd/lualib/lpegre.lua %{_datadir}/rspamd/lualib/lua_auth_results.lua +%{_datadir}/rspamd/lualib/lua_aws.lua %{_datadir}/rspamd/lualib/lua_bayes_learn.lua %{_datadir}/rspamd/lualib/lua_cfg_transform.lua %{_datadir}/rspamd/lualib/lua_clickhouse.lua @@ -494,6 +503,7 @@ %{_datadir}/rspamd/lualib/lua_maps_expressions.lua %{_datadir}/rspamd/lualib/lua_meta.lua %{_datadir}/rspamd/lualib/lua_mime.lua +%{_datadir}/rspamd/lualib/lua_mime_types.lua %{_datadir}/rspamd/lualib/lua_redis.lua %{_datadir}/rspamd/lualib/lua_settings.lua %{_datadir}/rspamd/lualib/lua_smtp.lua @@ -511,6 +521,7 @@ %{_datadir}/rspamd/lualib/lua_content/ical.lua %{_datadir}/rspamd/lualib/lua_content/init.lua %{_datadir}/rspamd/lualib/lua_content/pdf.lua +%{_datadir}/rspamd/lualib/lua_content/vcard.lua %dir %{_datadir}/rspamd/lualib/lua_ffi %{_datadir}/rspamd/lualib/lua_ffi/common.lua @@ -537,6 +548,7 @@ %{_datadir}/rspamd/lualib/lua_scanners/kaspersky_se.lua %{_datadir}/rspamd/lualib/lua_scanners/oletools.lua %{_datadir}/rspamd/lualib/lua_scanners/p0f.lua +%{_datadir}/rspamd/lualib/lua_scanners/pyzor.lua %{_datadir}/rspamd/lualib/lua_scanners/razor.lua %{_datadir}/rspamd/lualib/lua_scanners/savapi.lua %{_datadir}/rspamd/lualib/lua_scanners/sophos.lua @@ -553,11 +565,12 @@ %dir %{_datadir}/rspamd/lualib/rspamadm %{_datadir}/rspamd/lualib/rspamadm/clickhouse.lua -%{_datadir}/rspamd/lualib/rspamadm/confighelp.lua %{_datadir}/rspamd/lualib/rspamadm/configgraph.lua +%{_datadir}/rspamd/lualib/rspamadm/confighelp.lua %{_datadir}/rspamd/lualib/rspamadm/configwizard.lua %{_datadir}/rspamd/lualib/rspamadm/cookie.lua %{_datadir}/rspamd/lualib/rspamadm/corpus_test.lua +%{_datadir}/rspamd/lualib/rspamadm/dmarc_report.lua %{_datadir}/rspamd/lualib/rspamadm/dns_tool.lua %{_datadir}/rspamd/lualib/rspamadm/fuzzy_convert.lua %{_datadir}/rspamd/lualib/rspamadm/fuzzy_stat.lua @@ -566,10 +579,13 @@ %{_datadir}/rspamd/lualib/rspamadm/mime.lua %{_datadir}/rspamd/lualib/rspamadm/rescore.lua %{_datadir}/rspamd/lualib/rspamadm/stat_convert.lua +%{_datadir}/rspamd/lualib/rspamadm/statistics_dump.lua %{_datadir}/rspamd/lualib/rspamadm/template.lua %{_datadir}/rspamd/lualib/rspamadm/vault.lua +%{_datadir}/rspamd/lualib/rspamadm/neural_test.lua %dir %{_datadir}/rspamd/lualib/plugins +%{_datadir}/rspamd/lualib/plugins/dmarc.lua %{_datadir}/rspamd/lualib/plugins/neural.lua %{_datadir}/rspamd/lualib/plugins/rbl.lua ++++++ rspamd-2.7.tar.gz -> rspamd-3.1.tar.gz ++++++ ++++ 120702 lines of diff (skipped)