Script 'mail_helper' called by obssrc Hello community, here is the log from the commit of package python-tokenizers for openSUSE:Factory checked in at 2026-09-30 16:23:52 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Comparing /work/SRC/openSUSE:Factory/python-tokenizers (Old) and /work/SRC/openSUSE:Factory/.python-tokenizers.new.1465845 (New) ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Package is "python-tokenizers" Wed Sep 30 16:23:52 2026 rev:9 rq:1381506 version:0.23.2 Changes: -------- --- /work/SRC/openSUSE:Factory/python-tokenizers/python-tokenizers.changes 2026-07-21 23:11:25.860411632 +0200 +++ /work/SRC/openSUSE:Factory/.python-tokenizers.new.1465845/python-tokenizers.changes 2026-09-30 16:24:46.402655817 +0200 @@ -1,0 +2,18 @@ +Tue Sep 29 15:10:11 UTC 2026 - Christian Goll <[email protected]> + +- Update to 0.23.2: + * Last v0 release before the v1 series + * Parity-aware BPE training (ParityBpeTrainer) + * Bump pyo3 to 0.29 + * Avoid full vocab clone in get_vocab_size() + * Acquire model read-lock once per call instead of per pre-token + * Update daachorse from 1.0.1 to 3.0.0 + * Add benchmarks for the decode API + * CI and dependency cleanup +- Fixes (via rustls-webpki 0.103.15) (bsc#1282221): + * CVE-2026-93599 + * CVE-2026-93600 + * CVE-2026-93601 + * CVE-2026-93602 + +------------------------------------------------------------------- Old: ---- tokenizers-0.23.1.tar.gz New: ---- tokenizers-0.23.2.tar.gz ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Other differences: ------------------ ++++++ python-tokenizers.spec ++++++ --- /var/tmp/diff_new_pack.d0izb0/_old 2026-09-30 16:24:48.533744555 +0200 +++ /var/tmp/diff_new_pack.d0izb0/_new 2026-09-30 16:24:48.535744638 +0200 @@ -21,7 +21,7 @@ %endif %{?sle15_python_module_pythons} Name: python-tokenizers -Version: 0.23.1 +Version: 0.23.2 Release: 0 Summary: Provides an implementation of today's most used tokenizers License: Apache-2.0 ++++++ registry.tar.zst ++++++ /work/SRC/openSUSE:Factory/python-tokenizers/registry.tar.zst /work/SRC/openSUSE:Factory/.python-tokenizers.new.1465845/registry.tar.zst differ: char 7, line 1 ++++++ tokenizers-0.23.1.tar.gz -> tokenizers-0.23.2.tar.gz ++++++ ++++ 24273 lines of diff (skipped)
