commits  

Messages by Thread

• • (paimon) 14/20: [core] Simplify ManifestFileMeta constructors and field order hope
  • (paimon) 09/20: [python] Read LeRobot video datasets for training (#9757) hope
  • (paimon) 11/20: [python] Support reading shared-shredding maps (#9763) hope
• (paimon) branch release-2.1 updated (7152705145 -> 08f3fa8bdf) hope
  • (paimon) 18/20: [api] Fall back to the HTTP status when the error body omits code (#9661) hope
  • (paimon) 07/20: [spark] Support source table fileio for blob descriptors on spark (#9598) hope
  • (paimon) 01/20: [common] Resolve the atomic rename under the Kerberos FileSystem wrapper (#9652) hope
  • (paimon) 06/20: [common] Normalize row-id IN literals inside Range.toRanges (#9630) hope
  • (paimon) 10/20: [mosaic] Size the writer's Arrow vectors by write.batch-size (#9741) hope
  • (paimon) 14/20: [core][python] Add extra files to manifest metadata (#9746) hope
  • (paimon) 11/20: [mosaic] Prefetch row groups and read with one input stream per concurrent read (#9740) hope
  • (paimon) 09/20: [core] Push partition and bucket filters into the uncached manifest read path (#9739) hope
  • (paimon) 05/20: [common] Skip null literals in btree global index IN predicates (#9624) hope
  • (paimon) 20/20: [core] Add interrupt coverage for snapshot existence retries (#9745) hope
  • (paimon) 19/20: [spark] Close the commit and release the cached RDD in remove_unexisting_files (#9706) hope
  • (paimon) 03/20: [common] Never compare null literals when merging range predicates (#9647) hope
  • (paimon) 13/20: [mosaic] Respect decoded byte budget when refilling prefetch hope
  • (paimon) 02/20: [common] Range-check the digit guard in DateTimeUtils (#9649) hope
  • (paimon) 12/20: [python] Add as-of joins for multimodal scans (#9536) hope
  • (paimon) 17/20: [common] Order decimal z-values through the signed long transform (#9626) hope
  • (paimon) 16/20: [mosaic] Fix a close race in the reader stream pool and add pool and writer sizing tests (#9744) hope
  • (paimon) 04/20: [common] Version the memory-mode cache key in CachingFileIO (#9642) hope
  • (paimon) 15/20: [mosaic] Push row selection down to row-group reads (#9742) hope
• (paimon) branch release-2.1 updated (a2748340ef -> 7152705145) hope
  • (paimon) 14/20: [core] Fix rewriting file index with multiple map keys of one column (#9669) hope
  • (paimon) 06/20: [spark] Convert EqualNullSafe(NaN) to isNaN in V2 filters (#9720) hope
  • (paimon) 01/20: [docs] Reorganize ecosystem guides and add SVG diagrams (#9728) hope
  • (paimon) 04/20: [docs] Reorganize Iceberg compatibility guides and add SVG diagrams (#9732) hope
  • (paimon) 08/20: [core][python] Preserve historical field options during time travel (#9697) hope
  • (paimon) 10/20: [vortex] Do not push unrepresentable timestamp predicate literals (#9675) hope
  • (paimon) 20/20: [common] Stop answering value predicates from a truncated BSI index (#9654) hope
  • (paimon) 11/20: [common] Fix invalid DecimalType when extracting a variant decimal (#9672) hope
  • (paimon) 05/20: [docs] Reorganize migration guides and add SVG diagrams (#9733) hope
  • (paimon) 16/20: [bug] Fix Self-suppression when close rethrows the same exception in FileIO.overwriteFileUtf8 (#9674) (#9679) hope
  • (paimon) 07/20: [cdc] Fix computed column args upper-cased in case-insensitive mode (#9717) hope
  • (paimon) 15/20: [core] Retry snapshot existence checks after I/O failures (#9707) hope
  • (paimon) 12/20: [format] Resolve the ORC compression kind independent of the default locale (#9671) hope
  • (paimon) 09/20: [python][ray] Preserve row kind in TableRead.to_ray() (#9693) hope
  • (paimon) 18/20: [docs] Reorganize project guides and add SVG diagrams (#9734) hope
  • (paimon) 17/20: [docs] Reorganize Learn Paimon guides and add SVG diagrams (#9736) hope
  • (paimon) 13/20: [common][flink] Fix missing cast rule for DATE/TIME/TIMESTAMP to bounded CHAR/VARCHAR (#9670) hope
  • (paimon) 19/20: [codegen] Fix map equaliser for keys without value-based Java equality (#9738) hope
  • (paimon) 03/20: [docs] Restructure Program API guides and add SVG diagrams (#9730) hope
• (paimon) branch master updated: [core] Avoid data-file conflict scans for index-only compaction (#9963) lzljs3620320
• svn commit: r87683 - dev/paimon/paimon-vector-index-0.5.0-rc2 release/paimon/paimon-vector-index-0.5.0 yuzelin
• (paimon-rust) branch main updated: [rust] Add parquet.filter.columnindex.enabled option to control Page Index pruning (#875) lzljs3620320
• (paimon-vector-index) annotated tag v0.5.0 updated (31d6b1a -> 0edd942) jerryjing
• (paimon) branch master updated: [python] Reduce LeRobot DataLoader worker startup time (#9888) lzljs3620320
• (paimon) branch master updated: [python] Fix MAP and MULTISET type JSON serialization (#9682) lzljs3620320
• (paimon) branch master updated: [python] Avoid redundant blob stream opens on index cache hits (#9974) lzljs3620320
• (paimon) branch master updated: [python] Fix flaky Daft-on-Ray CI failures (#9975) lzljs3620320
• (paimon-vector-index) branch main updated: feat: add IVF-PQ L2 distance range search (#107) jerryjing
• (paimon-website) branch asf-site updated (9c9718aa7 -> 325b4e95b) github-bot
• (paimon) branch master updated: [python] Support batch vector search with Ray (#9950) lzljs3620320
• (paimon) branch master updated: [python] Reuse Parquet fragment metadata for single-file reads (#9881) lzljs3620320
• (paimon) branch master updated: [core] Add adaptive BTree posting list encoding (#9981) lzljs3620320
• (paimon) branch master updated (91af99540b -> 0c5f42d365) lzljs3620320
• (paimon) branch master updated: [python] Consolidate composite writer lifecycle and file output (#9948) lzljs3620320
• (paimon) branch master updated (93185cdc9c -> 91af99540b) lzljs3620320
• (paimon) branch master updated: [e2e] Strip any trailing Spark error log from spark-sql output before comparison (#9971) lzljs3620320
• (paimon) branch master updated: [eslib] Do not require build-time es-index options when reading persisted indexes (#9969) lzljs3620320
• (paimon-website) branch asf-site updated (32f279e39 -> 9c9718aa7) github-bot
• (paimon) branch master updated: [core] Optimize tag reads during snapshot expiration (#9967) lzljs3620320
• (paimon-rust) branch main updated: fix(arrow): map BLOB to LargeBinary (#874) lzljs3620320
• (paimon-cpp) branch main updated: perf(parquet): add opt-in parsed offset index caching (#314) lxy
• (paimon-rust) branch main updated: feat(mosaic): read row-group prefetch depth and byte budget from table options (#864) lzljs3620320
• (paimon) branch master updated: [python] Add opt-in Rust native data reads (#9954) lzljs3620320
• (paimon) branch master updated: [python] Distribute vector search refinement with Ray (#9951) lzljs3620320
• (paimon) branch master updated: [core] Fix OOM error handling in MergeTreeWriter and improve resource cleanup (#9933) lzljs3620320
• (paimon) branch master updated: [core] Request only top-k candidates from data-evolution full-text indexes (#9955) lzljs3620320
• (paimon) branch master updated: [core] Separate commit history bounds from strict mode (#9960) lzljs3620320
• (paimon-cpp) branch main updated: fix(orc): support CHAR/VARCHAR compatibility and extend format compatibility tests (#362) nicholasjiang
• (paimon-rust) branch main updated: feat(python): configure native BLOB read parallelism (#871) lzljs3620320
• (paimon-cpp) branch gh-pages updated (314697a1 -> 044d5703) github-bot
• (paimon-rust) branch main updated: fix(python): render field types as SQL strings, not Rust Debug (#786) lzljs3620320
• (paimon-rust) branch main updated: fix(deletion_vector): read Java bitmap64 deletion vectors (#785) lzljs3620320
• (paimon-rust) branch main updated: feat(file_index): generate indexes for append writes (#819) lzljs3620320
• (paimon-rust) branch main updated: fix(datafusion): truncate format tables instead of reporting success (#863) lzljs3620320
• (paimon-rust) branch main updated: [python] Expose streaming native table reader (#870) lzljs3620320
• (paimon-rust) branch main updated: perf(spec): deserialize DataType by keyword instead of untagged trial (#867) lzljs3620320
• (paimon) branch master updated: [format] Simplify buffered Avro encoder selection lzljs3620320
• (paimon-rust) branch main updated: fix(table): refuse row-level DML on a format table (#866) lzljs3620320
• (paimon) branch master updated: [api] Sign x-acs-action in DLFOpenApiV4Signer (#9937) lzljs3620320
• (paimon) branch master updated: [format] Use buffered encoder for Avro writes (#9928) lzljs3620320
• (paimon) branch master updated: [core] Apply deletion vectors during data evolution file index pushdown (#9922) lzljs3620320
• (paimon) branch master updated: [python] Support distributed vector search with Ray (#9930) lzljs3620320
• (paimon) branch master updated (dca0ab89db -> 2dcc4dab58) lzljs3620320
• (paimon) branch master updated: [python] Keep batch vector scoring vectorized for null rows (#9934) lzljs3620320
• (paimon) branch master updated: [common] Convert variant timestamps with the requested zone instead of the JVM default (#9939) lzljs3620320
• (paimon) branch master updated: [core] Reject a non-parquet per-level or changelog format for variant columns at DDL time (#9942) lzljs3620320
• (paimon) branch master updated: [python] Share final lookups across batch vector queries (#9935) lzljs3620320
• (paimon) branch master updated (1845d5e3f1 -> 926ed1d223) lzljs3620320
• (paimon) branch master updated: [flink] Fix rollback_to procedure throwing NullPointerException when neither snapshot_id nor tag is set (#9944) lzljs3620320
• (paimon) branch master updated: [core] Use a single BTree scan for bounded range predicates (#9844) lzljs3620320
• (paimon) branch master updated: [core][spark][docs] Support row filters in full-text search (#9855) lzljs3620320
• (paimon-rust) branch main updated: feat(btree): add optional bloom filters (#869) lzljs3620320
• (paimon) branch master updated: [core][python] Add optional Bloom filters to BTree indexes (#9946) lzljs3620320
• (terraform-provider-paimon) branch main updated: feat(client): name the missing resource in REST error diagnostics (#23) lzljs3620320
• (paimon-rust) branch main updated: perf(btree): optimize sparse IN queries (#868) lzljs3620320
• (paimon-website) branch asf-site updated (56a6fbcf1 -> 32f279e39) github-bot
• (paimon) branch master updated: [flink][cdc][iceberg] Include table identifier in schema-change and CDC-commit exception messages (#9892) lzljs3620320
• (paimon-rust) branch main updated: perf(mosaic): prefetch row groups with a Mosaic-owned budget (#851) lzljs3620320
• (paimon-rust) branch main updated: [Feature] Add manifest sidecar support (#861) lzljs3620320
• (paimon-cpp) branch main updated: perf(read): warm up only raw bytes by default (#366) lxy
• (paimon-cpp) branch gh-pages updated (322278ca -> 314697a1) github-bot
• (paimon) branch master updated: [common] Keep blank variant object keys unshredded during schema inference (#9813) lzljs3620320
• (paimon) branch master updated: [core] Reuse sidecar block cache for unfiltered scans (#9924) lzljs3620320
• (paimon) branch master updated: [api] Add an opt-in DLFOpenApiV4Signer for DlfNext endpoints (#9918) lzljs3620320
• (paimon) branch master updated: [core] Preserve query authorization when wrapping data evolution index splits (#9925) lzljs3620320
• (paimon) branch master updated: [python] Build global index shards concurrently (#9798) lzljs3620320
• (paimon) branch master updated: [flink] Scope scan.parallelism to source operators (#9803) lzljs3620320
• (paimon-cpp) branch gh-pages updated (220441d3 -> 322278ca) github-bot
• (paimon) branch master updated: [common] Reject out-of-range integral casts when extracting a variant scalar (#9809) lzljs3620320
• (paimon-rust) branch main updated: fix(write): avoid double separators in bucket paths (#860) jerryjing
• (paimon) branch master updated: [spark] Support remove_orphan_blobs procedure. (#9812) lzljs3620320
• (paimon) branch master updated: [core] Fall back to raw vector search when scalar index cannot evaluate filter (#9909) lzljs3620320
• (paimon-cpp) branch gh-pages updated (09dd0bd6 -> 43ae05a8) github-bot
• (paimon) branch master updated: [python] Support allow_exact_matches in temporal as-of joins (#9915) lzljs3620320
• (paimon) branch master updated: [core] Add option to disable overflow exception in sum/product agg (#9874) lzljs3620320
• (paimon) branch master updated: [format] Support file.block-size for Avro data file (#9910) lzljs3620320
• (paimon) branch master updated: [python] Clean up normal files when composite writer metadata creation fails (#9917) lzljs3620320
• (paimon) branch master updated: [python] Preserve manifest sidecar references on commit retries (#9921) junhao
• (paimon) branch master updated: [core][flink][spark] Add API for top partitions (#9914) lzljs3620320
• (paimon) branch master updated: [format] Drop filters on unprojected columns before Parquet conversion (#9858) lzljs3620320
• (paimon) branch master updated: [python] Keep local search and lookup on one snapshot (#9843) lzljs3620320
• (paimon-rust) branch main updated: fix(io): flush disk cache blocks before publishing (#836) lzljs3620320
• (paimon-rust) branch main updated: fix(parquet): reject unknown file.compression instead of ignoring it (#853) lzljs3620320
• (paimon-rust) branch main updated: feat(scan): read bucket metadata for manifest pruning (#850) lzljs3620320
• (paimon-rust) branch main updated: fix(table): support all Java-comparable types in min/max aggregators (#827) lzljs3620320
• (paimon-rust) branch main updated: fix(spec): encode TIME columns in the batch BinaryRow path (#823) lzljs3620320
• (paimon-rust) branch main updated: fix(rest-server): use Java's uppercase resourceType in error responses (#830) lzljs3620320
• (paimon-rust) branch main updated: feat(go): support case-insensitive column names on reads (#796) lzljs3620320
• (paimon) branch master updated: [common] Stop answering value predicates from a truncated bitmap index (#9866) lzljs3620320
• (paimon) branch master updated: [format] Reject multi-character csv delimiter, quote and escape (#9904) lzljs3620320
• (paimon) branch master updated: [core] Use full-range anchor as row representative in DE read-type pruning (#9899) lzljs3620320
• (paimon-cpp) branch main updated: perf(write): write input changelog and data files in parallel (#350) lxy
• (paimon) branch master updated: [iceberg] Retry transient REST DNS failures (#9903) lzljs3620320
• (paimon-vector-index) branch main updated: feat: add IVF-SQ L2 distance range search (#106) jerryjing
• (paimon-rust) branch main updated: fix(fm_index): store blocks in Java's codec envelope, not the SST one (#826) lzljs3620320
• (paimon) branch master updated: [python] Add manifest sidecar codec and block-pruned reads (#9908) lzljs3620320
• (paimon) branch master updated: [core] Add compression extension to text format data file names (#9853) lzljs3620320
• (paimon) branch master updated: [python] Search vector index shards concurrently (#9805) lzljs3620320
• (paimon) branch master updated: [core] Preserve quoted empty and null keys/values in string-to-MAP cast (#9849) lzljs3620320
• (paimon) branch master updated: [core] Skip BTree index reads for all-matching predicates (#9834) lzljs3620320
• (paimon) branch master updated: [python] Batch TorchCodec frame decoding for LeRobot datasets (#9836) lzljs3620320
• (paimon) branch master updated: [core] Fix the failing DataEvolutionUtilsTest (#9911) lzljs3620320
• (paimon) branch master updated: [codegen] Fix equaliser treating null array elements and map values as unequal (#9860) lzljs3620320
• (paimon) branch master updated: [common] Fix snapshot and tag reads failing when the file is deleted concurrently (#9851) lzljs3620320
• (paimon) branch master updated: [common] Read VECTOR fields from NestedRow (#9864) lzljs3620320
• (paimon-rust) branch main updated: fix(spec): decode _GLOBAL_INDEX fields by name, not by position (#843) lzljs3620320
• (paimon-cpp) branch main updated: perf(prefetch): prefetch the late-materialization payload ranges mid-read (#342) lxy
• (paimon-cpp) branch gh-pages updated (43ae05a8 -> 220441d3) github-bot
• (paimon) branch master updated: [test] Wait for a commit past the aborted savepoint after region failover (#9907) lzljs3620320
• (paimon) branch master updated: [format] Close the codec probe stream in HadoopCompressionUtils (#9902) lzljs3620320
• (paimon) branch master updated: [common] Delegate listFilesIterative through the remaining FileIO wrappers (#9865) lzljs3620320
• (paimon) branch master updated (81a5682208 -> ce6884bcd1) lzljs3620320
• (paimon) branch master updated: [core] Fix remaining byte[] identity comparisons in collect and merge_map aggregators (#9870) lzljs3620320
• (paimon) branch master updated: [core] Fix FileStore tag manager ignoring the table branch (#9868) lzljs3620320
• (paimon) branch master updated: [core] Introduce a vector read planner for data evolution (#9877) lzljs3620320
• (paimon) branch master updated: [python] Honor snapshot.ignore-empty-commit for empty appends (#9878) lzljs3620320
• (paimon) branch master updated: [python] Extend ContiguousWindowDataset for frame-level training (#9875) lzljs3620320
• (paimon-cpp) branch main updated: fix: respect parent validity in Arrow nullability checks (#340) nicholasjiang
• (paimon) branch master updated: Revert "[format] Support file.block-size for Avro (#9901)" lzljs3620320
• (paimon) branch master updated (c4bd2aaaab -> 7f8c08e169) lzljs3620320
• (paimon) branch master updated: [python] Make BLOB I/O merge parameters configurable (#9890) lzljs3620320
• (paimon) branch master updated: [python] Resolve value stats columns using file schema (#9906) lzljs3620320
• (paimon) branch master updated: [spark][core] Support more scalar transforms in V2 filter pushdown (#9905) lzljs3620320
• (paimon-cpp) branch main updated: perf(aggregate): use hash lookup for scalar field aggregators (#349) lxy
• (paimon) branch master updated: [core] Prune manifest blocks with sidecars during scans (#9897) lzljs3620320
• (paimon-website) branch asf-site updated (088c1043a -> 56a6fbcf1) github-bot
• (paimon-rust) branch main updated: fix(spec): preserve manifest extra files (#848) lzljs3620320
• (paimon-rust) branch main updated: feat(file-index): read range bitmap indexes (#849) lzljs3620320
• (paimon-rust) branch main updated: fix(go): serialize record batch reader access (#844) lzljs3620320
• (paimon) branch master updated: [spark][core] Support more expressions in V2 filter pushdown (#9891) lzljs3620320
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/rustls-webpki-0.103.15 created (now 65e7bc0b) github-bot
• (paimon) branch master updated: [python] Reduce memory usage for Parquet row-id updates (#9840) lzljs3620320
• (paimon) branch master updated: [core] Generate sidecars for newly written manifests (#9889) lzljs3620320
• (paimon) branch master updated: [python] Use conditional OSS puts for atomic metadata writes (#9715) lzljs3620320
• (paimon) branch master updated: [python] Support writing shared-shredding MAPs in Parquet (#9837) lzljs3620320
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/lz4_flex-0.11.6 deleted (was 6f07fab4) github-bot
• (paimon) branch release-2.1 updated (ca2017fbce -> a2748340ef) jerryjing
• (paimon) branch master updated: [core] Manage manifest extra file lifecycle (#9886) lzljs3620320
• (paimon-cpp) branch main updated: build(deps): bump time from 0.3.44 to 0.3.55 in /crates/lance_ffi (#358) lxy
• (paimon) branch master updated: [core] Execute complete filters with unprojected fields (#9872) lzljs3620320
• (paimon-cpp) branch main updated: build(deps): bump bytes from 1.10.1 to 1.12.1 in /crates/lance_ffi (#359) lxy
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/bytes-1.12.1 deleted (was e23e18d6) github-bot
• (paimon-cpp) branch main updated: build(deps): bump rsa from 0.9.8 to 0.9.10 in /crates/lance_ffi (#360) lxy
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/rsa-0.9.10 deleted (was 8bea7248) github-bot
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/time-0.3.55 deleted (was 86641a59) github-bot
• (paimon-cpp) branch main updated: build(deps): bump rustls-webpki in /crates/lance_ffi (#353) lxy
• (paimon) branch master updated: [python] Expand native planning across resolved tables and scan modes (#9873) lzljs3620320
• (paimon) branch master updated: [python] Speed up LeRobot video window reads (#9852) lzljs3620320
• (paimon) branch master updated: [filesystem] Isolate Jindo OSS presigning dependencies (#9856) jerryjing
• (paimon-cpp) branch main updated: build(deps): bump quinn-proto in /crates/lance_ffi (#356) lxy
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/bytes-1.12.1 updated (7176c29f -> e23e18d6) github-bot
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/rsa-0.9.10 created (now 8bea7248) github-bot
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/quinn-proto-0.11.18 deleted (was c96507e8) github-bot
• (paimon-cpp) branch main updated: build(deps): bump rand from 0.8.5 to 0.8.8 in /crates/lance_ffi (#354) lxy
• (paimon-cpp) branch main updated: build(deps): bump lz4_flex from 0.11.5 to 0.11.6 in /crates/lance_ffi (#355) lxy
• (paimon-cpp) branch dependabot/cargo/crates/lance_ffi/bytes-1.12.1 created (now 7176c29f) github-bot

• Earlier messages
• Later messages