commits  

Messages by Date

• 2026/09/19 (paimon) branch master updated: [common] Keep the selected variant schema when its evidence is gone (#9532) lzljs3620320
• 2026/09/19 (paimon) 07/13: [python] Reuse Parquet fragment metadata for single-file reads (#9881) hope
• 2026/09/19 (paimon) 11/20: [python] Support reading shared-shredding maps (#9763) hope
• 2026/09/19 (paimon) branch release-2.1 updated (b6d8a70499 -> eaf7c8744b) hope
• 2026/09/19 (paimon) 12/20: [format] Use buffered encoder for Avro writes (#9928) hope
• 2026/09/19 (paimon) branch release-2.1 updated (6bfd8418dc -> 8ce380d29b) hope
• 2026/09/19 (paimon) 02/13: [eslib] Do not require build-time es-index options when reading persisted indexes (#9969) hope
• 2026/09/19 (paimon) 09/13: [python] Fix flaky Daft-on-Ray CI failures (#9975) hope
• 2026/09/19 (paimon) 04/13: [flink] Fix GlobalFullCompactionSinkWrite re-reading snapshots on every checkpoint after a full compaction (#9959) hope
• 2026/09/19 (paimon) 05/20: [core] Fix remaining byte[] identity comparisons in collect and merge_map aggregators (#9870) hope
• 2026/09/19 (paimon) 09/20: [core] Add option to disable overflow exception in sum/product agg (#9874) hope
• 2026/09/19 (paimon) 20/20: [core][python] Add optional Bloom filters to BTree indexes (#9946) hope
• 2026/09/19 (paimon) 13/13: [release] Align Spark 4.0 UT parent version with 2.1 hope
• 2026/09/19 (paimon) 08/13: [core] Add adaptive BTree posting list encoding (#9981) hope
• 2026/09/19 (paimon) 10/13: [python] Avoid redundant blob stream opens on index cache hits (#9974) hope
• 2026/09/19 (paimon) 06/13: [python] Consolidate composite writer lifecycle and file output (#9948) hope
• 2026/09/19 (paimon) 11/13: [python] Fix MAP and MULTISET type JSON serialization (#9682) hope
• 2026/09/19 (paimon) 05/13: [python] Support batch vector search with Ray (#9950) hope
• 2026/09/19 (paimon) 01/13: [e2e] Strip any trailing Spark error log from spark-sql output before comparison (#9971) hope
• 2026/09/19 (paimon) 15/20: [core] Separate commit history bounds from strict mode (#9960) hope
• 2026/09/19 (paimon) branch release-2.1 updated (eaf7c8744b -> 6bfd8418dc) hope
• 2026/09/19 (paimon) 01/20: [core][spark][docs] Support row filters in full-text search (#9855) hope
• 2026/09/19 (paimon) 05/20: [core][flink][spark] Add API for top partitions (#9914) hope
• 2026/09/19 (paimon) 18/20: [core] Support input streams in Avro block readers (#9842) hope
• 2026/09/19 (paimon) 13/20: [spark] Support remove_orphan_blobs procedure. (#9812) hope
• 2026/09/19 (paimon) 01/20: [common] Forward newTwoPhaseOutputStream through ResolvingFileIO and resolve it at commit (#9655) hope
• 2026/09/19 (paimon) 04/20: [core] Reject a non-parquet per-level or changelog format for variant columns at DDL time (#9942) hope
• 2026/09/19 (paimon) 06/20: [common] Convert variant timestamps with the requested zone instead of the JVM default (#9939) hope
• 2026/09/19 (paimon) 08/20: [python] Keep batch vector scoring vectorized for null rows (#9934) hope
• 2026/09/19 (paimon) 14/20: [format] Simplify buffered Avro encoder selection hope
• 2026/09/19 (paimon) 10/20: [python] Support distributed vector search with Ray (#9930) hope
• 2026/09/19 (paimon) 13/20: [api] Sign x-acs-action in DLFOpenApiV4Signer (#9937) hope
• 2026/09/19 (paimon) 02/20: [core] Use a single BTree scan for bounded range predicates (#9844) hope
• 2026/09/19 (paimon) 07/20: [python] Share final lookups across batch vector queries (#9935) hope
• 2026/09/19 (paimon) 18/20: [python] Distribute vector search refinement with Ray (#9951) hope
• 2026/09/19 (paimon) 03/20: [flink] Fix rollback_to procedure throwing NullPointerException when neither snapshot_id nor tag is set (#9944) hope
• 2026/09/19 (paimon) 17/20: [core] Fix OOM error handling in MergeTreeWriter and improve resource cleanup (#9933) hope
• 2026/09/19 (paimon) 09/20: [core] Preserve query authorization when narrowing chain table splits (#9929) hope
• 2026/09/19 (paimon) 05/20: [common] Infer a variant shredding schema regardless of the writer's key order (#9940) hope
• 2026/09/19 (paimon) 11/20: [core] Apply deletion vectors during data evolution file index pushdown (#9922) hope
• 2026/09/19 (paimon) 16/20: [core] Request only top-k candidates from data-evolution full-text indexes (#9955) hope
• 2026/09/19 (paimon) 19/20: [python] Add opt-in Rust native data reads (#9954) hope
• 2026/09/19 (paimon) 20/20: [core] Optimize tag reads during snapshot expiration (#9967) hope
• 2026/09/19 (paimon) 07/20: [common] Read a shredded variant decimal as the same string as an unshredded one (#9818) hope
• 2026/09/19 (paimon) 07/20: [flink][cdc][iceberg] Include table identifier in schema-change and CDC-commit exception messages (#9892) hope
• 2026/09/19 (paimon) 08/20: [format] Support file.block-size for Avro data file (#9910) hope
• 2026/09/19 (paimon) 06/20: [python] Preserve manifest sidecar references on commit retries (#9921) hope
• 2026/09/19 (paimon) 10/20: [python] Support allow_exact_matches in temporal as-of joins (#9915) hope
• 2026/09/19 (paimon) 04/20: [python] Keep local search and lookup on one snapshot (#9843) hope
• 2026/09/19 (paimon) 18/20: [core] Preserve query authorization when wrapping data evolution index splits (#9925) hope
• 2026/09/19 (paimon) 15/20: [flink] Scope scan.parallelism to source operators (#9803) hope
• 2026/09/19 (paimon) 12/20: [common] Keep blank variant object keys unshredded during schema inference (#9813) hope
• 2026/09/19 (paimon) 02/20: [python] Add manifest sidecar codec and block-pruned reads (#9908) hope
• 2026/09/19 (paimon) 16/20: [python] Build global index shards concurrently (#9798) hope
• 2026/09/19 (paimon) 03/20: [format] Drop filters on unprojected columns before Parquet conversion (#9858) hope
• 2026/09/19 (paimon) 14/20: [common] Reject out-of-range integral casts when extracting a variant scalar (#9809) hope
• 2026/09/19 (paimon) 07/20: [python] Clean up normal files when composite writer metadata creation fails (#9917) hope
• 2026/09/19 (paimon) 01/20: [core] Skip BTree index reads for all-matching predicates (#9834) hope
• 2026/09/19 (paimon) 09/20: [iceberg] Retry transient REST DNS failures (#9903) hope
• 2026/09/19 (paimon) 11/20: [core] Fall back to raw vector search when scalar index cannot evaluate filter (#9909) hope
• 2026/09/19 (paimon) 19/20: [core] Reuse sidecar block cache for unfiltered scans (#9924) hope
• 2026/09/19 (paimon) 18/20: Revert "[format] Support file.block-size for Avro (#9901)" hope
• 2026/09/19 (paimon) 02/20: [common] Delegate listFilesIterative through the remaining FileIO wrappers (#9865) hope
• 2026/09/19 (paimon) 17/20: [format] Support file.block-size for Avro (#9901) hope
• 2026/09/19 (paimon) 15/20: [common] Fix snapshot and tag reads failing when the file is deleted concurrently (#9851) hope
• 2026/09/19 (paimon) 16/20: [python] Make BLOB I/O merge parameters configurable (#9890) hope
• 2026/09/19 (paimon) 09/20: [python] Read LeRobot video datasets for training (#9757) hope
• 2026/09/19 (paimon) 11/20: [common] Bound the file-size memo in both local cache managers (#9775) hope
• 2026/09/19 (paimon) 14/20: [core] Simplify ManifestFileMeta constructors and field order hope
• 2026/09/19 (paimon) 12/20: [core] Use full-range anchor as row representative in DE read-type pruning (#9899) hope
• 2026/09/19 (paimon) 01/20: [core] Introduce a vector read planner for data evolution (#9877) hope
• 2026/09/19 (paimon) 18/20: [core] Add compression extension to text format data file names (#9853) hope
• 2026/09/19 (paimon) 06/20: [cdc] Support per-table configuration for MySQL database CDC (#9871) hope
• 2026/09/19 (paimon) 20/20: [core] Fix the failing DataEvolutionUtilsTest (#9911) hope
• 2026/09/19 (paimon) 19/20: [codegen] Fix equaliser treating null array elements and map values as unequal (#9860) hope
• 2026/09/19 (paimon) 17/20: [core] Preserve quoted empty and null keys/values in string-to-MAP cast (#9849) hope
• 2026/09/19 (paimon) 11/20: [test] Wait for a commit past the aborted savepoint after region failover (#9907) hope
• 2026/09/19 (paimon) 13/20: [common] Read VECTOR fields from NestedRow (#9864) hope
• 2026/09/19 (paimon) 04/20: [common] Stop answering value predicates from a truncated bitmap index (#9866) hope
• 2026/09/19 (paimon) branch release-2.1 updated (1fc0f17ad2 -> b6d8a70499) hope
• 2026/09/19 (paimon) 10/20: [format] Reject multi-character csv delimiter, quote and escape (#9904) hope
• 2026/09/19 (paimon) 16/20: [python] Batch TorchCodec frame decoding for LeRobot datasets (#9836) hope
• 2026/09/19 (paimon) 03/20: [core] Fix FileStore tag manager ignoring the table branch (#9868) hope
• 2026/09/19 (paimon) 13/20: [core] Prune manifest blocks with sidecars during scans (#9897) hope
• 2026/09/19 (paimon) 19/20: [python] Honor snapshot.ignore-empty-commit for empty appends (#9878) hope
• 2026/09/19 (paimon) 08/20: [core] Manage manifest extra file lifecycle (#9886) hope
• 2026/09/19 (paimon) 06/20: [python] Support writing shared-shredding MAPs in Parquet (#9837) hope
• 2026/09/19 (paimon) 09/20: [python] Use conditional OSS puts for atomic metadata writes (#9715) hope
• 2026/09/19 (paimon) 03/20: [python] Expand native planning across resolved tables and scan modes (#9873) hope
• 2026/09/19 (paimon) 01/20: [python] Cover native dynamic PK events and compacted first-row scans (#9854) hope
• 2026/09/19 (paimon) 15/20: [python] Resolve value stats columns using file schema (#9906) hope
• 2026/09/19 (paimon) 02/20: [python] Speed up nested VARIANT reads by vectorizing offsets (#9847) hope
• 2026/09/19 (paimon) 04/20: [core] Execute complete filters with unprojected fields (#9872) hope
• 2026/09/19 (paimon) 10/20: [core] Generate sidecars for newly written manifests (#9889) hope
• 2026/09/19 (paimon) 20/20: [python] Extend ContiguousWindowDataset for frame-level training (#9875) hope
• 2026/09/19 (paimon) branch release-2.1 updated (a5f3dd4b99 -> 1fc0f17ad2) hope
• 2026/09/19 (paimon) 12/20: [spark][core] Support more expressions in V2 filter pushdown (#9891) hope
• 2026/09/19 (paimon) 05/20: [python] Speed up LeRobot video window reads (#9852) hope
• 2026/09/19 (paimon) 11/20: [python] Reduce memory usage for Parquet row-id updates (#9840) hope
• 2026/09/19 (paimon) 05/20: [api] Require field ids for schema fields, auto-assign them for parameter lists (#9767) hope
• 2026/09/19 (paimon) 11/20: [python] Support selected-key projection for shared-shredding MAP (#9789) hope
• 2026/09/19 (paimon) 12/20: [python] Fix bucket registration for dynamic bucket overflow (#9788) hope
• 2026/09/19 (paimon) 15/20: [core] Support manifest sorting for non-partitioned bucketed tables (#9808) hope
• 2026/09/19 (paimon) 08/20: [python] Skip empty batches when advancing merge readers (#9820) hope
• 2026/09/19 (paimon) branch release-2.1 updated (eb43b419ce -> a5f3dd4b99) hope
• 2026/09/19 (paimon) 19/20: [python] Expand native planning and align incremental reads with Java (#9846) hope
• 2026/09/19 (paimon) 06/20: [filesystem][s3] Serve s3a:// paths with the S3 plugin (#9814) hope
• 2026/09/19 (paimon) 03/20: [python] Stream batch vector refinement candidates (#9806) hope
• 2026/09/19 (paimon) 13/20: [python] Add block-based manifest Avro reader (#9826) hope
• 2026/09/19 (paimon) 15/20: [mosaic] Push row selection down to row-group reads (#9742) hope
• 2026/09/19 (paimon) 01/20: [python] Preserve declared primary-key order in merge reads (#9801) hope
• 2026/09/19 (paimon) 09/20: [format] Validate ORC stripe metadata before reading (#9828) hope
• 2026/09/19 (paimon) 14/20: [core] Expose Avro header and physical block locations (#9835) hope
• 2026/09/19 (paimon) 16/20: [rest] Add generic entity labels to REST Catalog (#9838) hope
• 2026/09/19 (paimon) 20/20: [rest] Add semantic view definition management to REST Catalog (#9848) hope
• 2026/09/19 (paimon) 02/20: [python] Reuse gathered window values across aggregations (#9804) hope
• 2026/09/19 (paimon) 15/20: [python] Align batch scan semantics with Java and extend native planning (#9839) hope
• 2026/09/19 (paimon) 04/20: [vortex] Do not push nanosecond timestamp literals that overflow int64 (#9810) hope
• 2026/09/19 (paimon) 05/20: [common] Fix inferred variant shredding failing on decimals with trailing zeros (#9811) hope
• 2026/09/19 (paimon) 10/20: [python] Group LeRobot video frame decoding by payload (#9799) hope
• 2026/09/19 (paimon) 15/20: [python] Vectorize raw vector scoring and refinement in bounded blocks (#9759) hope
• 2026/09/19 (paimon) 17/20: [core] Fix nullable file records in the manifest Avro reader (#9816) hope
• 2026/09/19 (paimon) 19/20: [python] Vectorize batch raw vector scoring (#9796) hope
• 2026/09/19 (paimon) 02/20: [python] Stream training samples into native vector index trainers (#9758) hope
• 2026/09/19 (paimon) branch release-2.1 updated (2a5cbe906c -> eb43b419ce) hope
• 2026/09/19 (paimon) 10/20: [python] Support custom dataset readers in PaimonLeRobotDataset (#9785) hope
• 2026/09/19 (paimon) 16/20: [core] Make compact_manifest perform a full manifest sort (#9802) hope
• 2026/09/19 (paimon) 06/20: [common] Make quoting mean literal in array and row string cast rules (#9769) hope
• 2026/09/19 (paimon) 09/20: [fs] Delegate skipFully to hadoop's IOUtils (#9779) hope
• 2026/09/19 (paimon) 08/20: [common] Widen hilbert index bytes beyond 8 dimensions (#9777) hope
• 2026/09/19 (paimon) 03/20: [core] Allow custom primary-key compaction rewriters (#9762) hope
• 2026/09/19 (paimon) 20/20: [python] Execute hybrid search routes concurrently (#9797) hope
• 2026/09/19 (paimon) 07/20: [common] Support VECTOR elements in InternalArray accessors (#9773) hope
• 2026/09/19 (paimon) 18/20: [python] Run native planning CI against paimon-rust main (#9817) hope
• 2026/09/19 (paimon) 13/20: [spark] Compile the shared Spark test sources against 4.0.3 for paimon-spark-4.0 (#9794) hope
• 2026/09/19 (paimon) 14/20: [python] Align manifest metadata and prune manifest files by bucket (#9807) hope
• 2026/09/19 (paimon) 04/20: [common] Reject out-of-range range-bitmap chunk-size option (#9765) hope
• 2026/09/19 (paimon) 03/20: [docs] Restructure Program API guides and add SVG diagrams (#9730) hope
• 2026/09/19 (paimon) branch master updated: [format] Follow Parquet list backward-compatibility rules in schema clipping (#9550) lzljs3620320
• 2026/09/19 (paimon) 04/20: [common] Version the memory-mode cache key in CachingFileIO (#9642) hope
• 2026/09/19 (paimon) 13/20: [core] Support bucket pruning for manifest files (#9791) hope
• 2026/09/19 (paimon) 03/20: [python] Close vector readers when search raises synchronously (#9755) hope
• 2026/09/19 (paimon) 07/20: [python] Read native vector index ranges with bounded concurrency (#9756) hope
• 2026/09/19 (paimon) 18/20: [core] Support bucket-first sorting for manifest files (#9792) hope
• 2026/09/19 (paimon) 12/20: [ci] Run affected test suites through reusable workflows (#9787) hope
• 2026/09/19 (paimon) 20/20: [common] Fix JSON round-trip of temporal and decimal predicate literals (#9640) hope
• 2026/09/19 (paimon) 10/20: [python] Support window joins in temporal alignment (#9760) hope
• 2026/09/19 (paimon) 04/20: [test] Switch minio test image to quay.io (#9761) hope
• 2026/09/19 (paimon) 06/20: [python] Share raw vector scans across batch queries (#9753) hope
• 2026/09/19 (paimon) 01/20: [python] Support linear interpolation in temporal alignment (#9747) hope
• 2026/09/19 (paimon) 17/20: [lumina] Release the vector file when FileBackedDataset fails to construct (#9481) hope
• 2026/09/19 (paimon) 02/20: [core] Improve the error when listing a Format Table custom partition location fails (#9748) hope
• 2026/09/19 (paimon) 08/20: [python] Use persisted vector metrics for raw search and refinement (#9754) hope
• 2026/09/19 (paimon) 16/20: [python] Stream batches when building generic global indexes (#9751) hope
• 2026/09/19 (paimon) 05/20: [python] Batch vector writes when building global indexes (#9752) hope
• 2026/09/19 (paimon) branch release-2.1 updated (08f3fa8bdf -> 2a5cbe906c) hope
• 2026/09/19 (paimon) 19/20: [core] Fix bucket-first manifest sorting for postpone tables hope
• 2026/09/19 (paimon) 16/20: [mosaic] Fix a close race in the reader stream pool and add pool and writer sizing tests (#9744) hope
• 2026/09/19 (paimon) 17/20: [common] Order decimal z-values through the signed long transform (#9626) hope
• 2026/09/19 (paimon) 12/20: [python] Add as-of joins for multimodal scans (#9536) hope
• 2026/09/19 (paimon) 02/20: [common] Range-check the digit guard in DateTimeUtils (#9649) hope
• 2026/09/19 (paimon) 13/20: [mosaic] Respect decoded byte budget when refilling prefetch hope
• 2026/09/19 (paimon) 03/20: [common] Never compare null literals when merging range predicates (#9647) hope
• 2026/09/19 (paimon) branch release-2.1 updated (7152705145 -> 08f3fa8bdf) hope
• 2026/09/19 (paimon) 19/20: [spark] Close the commit and release the cached RDD in remove_unexisting_files (#9706) hope
• 2026/09/19 (paimon) 20/20: [core] Add interrupt coverage for snapshot existence retries (#9745) hope
• 2026/09/19 (paimon) 05/20: [common] Skip null literals in btree global index IN predicates (#9624) hope
• 2026/09/19 (paimon) 09/20: [core] Push partition and bucket filters into the uncached manifest read path (#9739) hope
• 2026/09/19 (paimon) 11/20: [mosaic] Prefetch row groups and read with one input stream per concurrent read (#9740) hope
• 2026/09/19 (paimon) 14/20: [core][python] Add extra files to manifest metadata (#9746) hope
• 2026/09/19 (paimon) 10/20: [mosaic] Size the writer's Arrow vectors by write.batch-size (#9741) hope
• 2026/09/19 (paimon) 06/20: [common] Normalize row-id IN literals inside Range.toRanges (#9630) hope
• 2026/09/19 (paimon) 01/20: [common] Resolve the atomic rename under the Kerberos FileSystem wrapper (#9652) hope
• 2026/09/19 (paimon) 07/20: [spark] Support source table fileio for blob descriptors on spark (#9598) hope
• 2026/09/19 (paimon) 18/20: [api] Fall back to the HTTP status when the error body omits code (#9661) hope
• 2026/09/19 (paimon) 19/20: [codegen] Fix map equaliser for keys without value-based Java equality (#9738) hope
• 2026/09/19 (paimon) 13/20: [common][flink] Fix missing cast rule for DATE/TIME/TIMESTAMP to bounded CHAR/VARCHAR (#9670) hope
• 2026/09/19 (paimon) branch release-2.1 updated (a2748340ef -> 7152705145) hope
• 2026/09/19 (paimon) 17/20: [docs] Reorganize Learn Paimon guides and add SVG diagrams (#9736) hope
• 2026/09/19 (paimon) 18/20: [docs] Reorganize project guides and add SVG diagrams (#9734) hope
• 2026/09/19 (paimon) 09/20: [python][ray] Preserve row kind in TableRead.to_ray() (#9693) hope
• 2026/09/19 (paimon) 12/20: [format] Resolve the ORC compression kind independent of the default locale (#9671) hope
• 2026/09/19 (paimon) 15/20: [core] Retry snapshot existence checks after I/O failures (#9707) hope
• 2026/09/19 (paimon) 07/20: [cdc] Fix computed column args upper-cased in case-insensitive mode (#9717) hope
• 2026/09/19 (paimon) 16/20: [bug] Fix Self-suppression when close rethrows the same exception in FileIO.overwriteFileUtf8 (#9674) (#9679) hope
• 2026/09/19 (paimon) 05/20: [docs] Reorganize migration guides and add SVG diagrams (#9733) hope
• 2026/09/19 (paimon) 11/20: [common] Fix invalid DecimalType when extracting a variant decimal (#9672) hope
• 2026/09/19 (paimon) 20/20: [common] Stop answering value predicates from a truncated BSI index (#9654) hope
• 2026/09/19 (paimon) 10/20: [vortex] Do not push unrepresentable timestamp predicate literals (#9675) hope
• 2026/09/19 (paimon) 08/20: [core][python] Preserve historical field options during time travel (#9697) hope
• 2026/09/19 (paimon) 04/20: [docs] Reorganize Iceberg compatibility guides and add SVG diagrams (#9732) hope
• 2026/09/19 (paimon) 01/20: [docs] Reorganize ecosystem guides and add SVG diagrams (#9728) hope
• 2026/09/19 (paimon) 06/20: [spark] Convert EqualNullSafe(NaN) to isNaN in V2 filters (#9720) hope
• 2026/09/19 (paimon) 14/20: [core] Fix rewriting file index with multiple map keys of one column (#9669) hope
• 2026/09/19 (paimon) branch master updated: [core] Avoid data-file conflict scans for index-only compaction (#9963) lzljs3620320
• 2026/09/19 svn commit: r87683 - dev/paimon/paimon-vector-index-0.5.0-rc2 release/paimon/paimon-vector-index-0.5.0 yuzelin
• 2026/09/19 paimon-rust.git: Error while running github feature from main:.asf.yaml Apache Infrastructure
• 2026/09/19 (paimon-rust) branch main updated: [rust] Add parquet.filter.columnindex.enabled option to control Page Index pruning (#875) lzljs3620320
• 2026/09/19 (paimon-vector-index) annotated tag v0.5.0 updated (31d6b1a -> 0edd942) jerryjing
• 2026/09/19 (paimon) branch master updated: [python] Reduce LeRobot DataLoader worker startup time (#9888) lzljs3620320

• Earlier messages
• Later messages