commits  

Messages by Thread

• (paimon-website) branch asf-site updated (550a4416 -> c9704065) github-bot
• (paimon-website) branch asf-site updated (792951cc -> 550a4416) github-bot
• (paimon-website) branch asf-site updated (e7a3a841 -> 792951cc) github-bot
• (paimon-website) branch asf-site updated (83bebb95 -> e7a3a841) github-bot
• (paimon) branch dependabot/maven/paimon-flink/paimon-flink-cdc/org.apache.avro-avro-1.11.5 created (now 19cf065fc6) github-bot
• (paimon) branch master updated: [test] Remove the S3 dependency from paimon-hive and paimon-spark (#7279) lzljs3620320
• (paimon) branch master updated (89c94d9eda -> 7a09ee6c2b) lzljs3620320
• (paimon) branch master updated: [python] Improve error response parsing in HTTP client (#7276) lzljs3620320
• (paimon) branch master updated: [fs] Replace AWS SDK v2 bundle with explicit module dependencies (#7285) lzljs3620320
• (paimon) branch master updated: [docs] fix doc: fileformat.md (#7278) lzljs3620320
• (paimon) branch master updated: [core] Optimize between in Between lzljs3620320
• (paimon) branch master updated (213f75c5b5 -> 8c0d4e3e1c) lzljs3620320
• (paimon-website) branch asf-site updated (47bc46c7 -> 83bebb95) github-bot
• (paimon) branch master updated: [spark] Introduce TrimTransform for trim/ltrim/rtrim functions to pushdown (#7273) lzljs3620320
• (paimon) branch master updated (e1f8281865 -> ea6bc8f88d) lzljs3620320
• (paimon) branch master updated: [core] Fix performance issue in FileStoreCommitImpl#filterCommitted (#7275) yuzelin
• (paimon) branch master updated: [python] Fix pyarrow module missing attribute (#7258) lzljs3620320
• (paimon) branch master updated: [core] Fix merge adjacent files in DataEvolutionCompactCoordinator lzljs3620320
• (paimon) branch master updated: [python] Rename list_tag to list_tags lzljs3620320
• (paimon) branch master updated: [python] add list tag for TagManager (#7264) lzljs3620320
• (paimon) branch master updated (bda3eb031b -> ba209f88d3) lzljs3620320
• (paimon-rust) branch main updated: ci: fix clippy warn error to long issue (#88) lzljs3620320
• (paimon) branch master updated: [python] with_shard should be evenly distributed for data evolution mode (#7271) lzljs3620320
• (paimon-website) branch asf-site updated (21c185df -> 47bc46c7) github-bot
• (paimon) branch master updated: [core] Remove useless version in Varant lzljs3620320
• (paimon) branch master updated: [core] Should work with Split in DataTableBatchScan lzljs3620320
• (paimon) branch master updated: [core] Fix paimon_incremental_query with limit push down (#7269) lzljs3620320
• (paimon) branch master updated: [rest] Improve RestCatalog OpenAPI nonce generation (#7270) lzljs3620320
• (paimon) branch master updated (7914ab0cf1 -> 17fae8a855) lzljs3620320
• (paimon) branch master updated: [python] Fix avro write timestamp without timezone wrongly (#7259) lzljs3620320
• (paimon) branch master updated (b89a685116 -> b5ad53ca49) lzljs3620320
• (paimon) branch master updated (6af6711934 -> b89a685116) lzljs3620320
• (paimon) branch master updated: [core] Add listTableDetails method to Catalog interface (#7266) yuzelin
• (paimon) branch master updated: [python] Support filter by _ROW_ID for data evolution (#7252) lzljs3620320
• (paimon) branch master updated (4830eb229a -> 959170d8fe) yunfengzhou
• (paimon) branch master updated: [github] Add whether it is an AI-generated tag in the PR template (#7257) lzljs3620320
• (paimon) branch master updated: [core] Improve HttpClient error response handling (#7254) lzljs3620320
• (paimon-website) branch asf-site updated (8473a7d3 -> 21c185df) github-bot
• (paimon) branch master updated: [python] Light refactor: move _is_blob_file check into DataFileMeta (#7256) lzljs3620320
• (paimon) branch master updated: [core] RowIdPredicateVisitor supports converting between statement (#7255) lzljs3620320
• (paimon) branch master updated: [python] do not prune file when null_count stats are missing during isNull filter (#7250) lzljs3620320
• (paimon) branch master updated: [python] fix reading on legacy manifest list without _MIN_ROW_ID/_MAX_ROW_ID (#7248) lzljs3620320
• (paimon) branch master updated: [pvfs] support pread in pvfs (#7247) lzljs3620320
• (paimon) branch master updated: [python] Support create tag manually and read data from tag. (#7243) lzljs3620320
• (paimon) branch master updated: [core] Optimize FileStoreCommitImpl#filterCommitted when commit strict mode is set (#7239) lzljs3620320
• (paimon) branch master updated: [core] Minor refactor append table compaction (#7244) lzljs3620320
• (paimon) branch master updated: [cdc] Shade com.zaxxer.hikari to prevent AbstractMethodError in mysql cdc (#7246) lzljs3620320
• (paimon-website) branch asf-site updated (650f6891 -> 8473a7d3) github-bot
• (paimon) branch master updated: [core] fix btree index row range (#7242) lzljs3620320
• (paimon) branch master updated (5c5ba6e4e5 -> 71d6164798) lzljs3620320
• (paimon) branch master updated: [core][flink] supports reading blob descriptors from external storage (#7231) lzljs3620320
• (paimon) branch master updated: [spark] Bump Spark 4.0.2 (#7225) lzljs3620320
• (paimon) branch master updated: [flink] add flink support for VectorType (#7238) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'visibility-callback.enabled' (#7235) lzljs3620320
• (paimon) branch master updated: [index] add libstdc++ for faiss jni build (#7237) lzljs3620320
• (paimon) branch master updated: [core] add columnar impl for InternalVector and link to arrow module (#7236) lzljs3620320
• (paimon) branch master updated: [core] Fix record comparator cache key for sort order (#7222) lzljs3620320
• (paimon) branch master updated: [python] Fix null handling when filter with or expression (#7234) lzljs3620320
• (paimon) branch master updated: [python] Add more log for better trouble shooting (#7233) lzljs3620320
• (paimon-website) branch asf-site updated (58aa5c7a -> 650f6891) github-bot
• (paimon) branch master updated: [python] Do not abort on commit failure (#7232) lzljs3620320
• (paimon-website) branch asf-site updated (02f6cfb0 -> 58aa5c7a) github-bot
• (paimon-website) branch asf-site updated (831bbb77 -> 02f6cfb0) github-bot
• (paimon) branch master updated (160a3cdcbe -> b1c3463e20) lzljs3620320
• (paimon) branch master updated (082edcf95d -> e4a5ce1359) lzljs3620320
• (paimon) branch master updated: [core] Introduce supportsPartitionModification to Catalog (#7228) lzljs3620320
• (paimon) branch master updated (c2729bd550 -> b58585c648) lzljs3620320
• (paimon) branch master updated (9ca80b30e9 -> c2729bd550) lzljs3620320
• (paimon) branch master updated: [core] Remove useless fileReadCount in CacheManager lzljs3620320
• (paimon-website) branch asf-site updated (37dc53e0 -> 831bbb77) github-bot
• (paimon) branch master updated: [core] Clean up constructor for FileStoreCommitImpl (#7213) lzljs3620320
• (paimon) branch master updated: [spark] Support MergeInto on Paimon append-only table in spark V2 write (#7200) biyan
• (paimon) branch master updated: [flink] Remove typo in FlinkCatalog lzljs3620320
• (paimon) branch master updated: [core] Minor refactor arguements for FileStoreCommitImpl lzljs3620320
• (paimon) branch master updated: [core] Add pre check when drop partition for chain table (#7109) lzljs3620320
• (paimon) branch master updated (b6adddfff3 -> cca171f43c) lzljs3620320
• (paimon) branch master updated: [core] Refactor LeafFunction fromJson and toJson lzljs3620320
• (paimon) branch master updated: [core] introduce Between LeafFunction (#7209) lzljs3620320
• (paimon-website) branch asf-site updated (a50cb947 -> 37dc53e0) github-bot
• (paimon) branch master updated: [core] Limit max parallelism for postpone batch write fixed bucket to avoid too many buckets (#7212) lzljs3620320
• (paimon) branch master updated: [spark] Create global index topology update spark parallelism (#7210) lzljs3620320
• (paimon) branch master updated: [core] Support pushing down Timestamp filter in parquet format (#7203) lzljs3620320
• (paimon) branch master updated: [python] fix data evolution with_slice out-of-bounds: return empty rows instead of all data (#7207) lzljs3620320
• (paimon) branch master updated: [core] Disable async write for blob writer (#7208) lzljs3620320
• (paimon) branch master updated: [python] fix data evolution merge batch size mismatch issue (#7205) lzljs3620320
• (paimon) branch blob_ref_review deleted (was a1d0ae7836) junhao
• (paimon) branch blob_ref_review created (now a1d0ae7836) junhao
  • (paimon) 01/02: Fix minus junhao
  • (paimon) 02/02: Fix minus junhao
• (paimon) branch master updated: [python] Extract _write_manifest_file in FileStoreCommit lzljs3620320
• (paimon) branch master updated: [spark] Support UPDATE on Paimon append-only table in spark V2 write (#7097) biyan
• (paimon) branch master updated (4a48d4d037 -> f64b14747a) lzljs3620320
• (paimon) branch master updated (21a66d19a0 -> 4a48d4d037) lzljs3620320
• (paimon-website) branch asf-site updated (f253f923 -> a50cb947) github-bot
• (paimon) branch master updated: [python] Data Evolution with_slice should use row id to do slice (#7199) lzljs3620320
• (paimon) branch master updated (7f258f3405 -> 88618e5091) lzljs3620320
• (paimon) branch master updated (a10a44892c -> 7f258f3405) lzljs3620320
• (paimon) branch master updated: [spark] Add MergeIntoTable alignment methods for v2 write (#7144) biyan
• (paimon) branch master updated: [python] Python BTree support between predicate (#7193) lzljs3620320
• (paimon) branch master updated: [core] supports multiple partitions in BTreeGlobalIndexBuilder (#7191) lzljs3620320
• (paimon) branch master updated (47e780187e -> ebe39f0688) lzljs3620320
• (paimon) branch master updated: [python] Use pyroaring.BitMap64 for better performance (#7185) lzljs3620320
• (paimon) branch master updated: [spark] Fix rescale procedure to only read real buckets for postpone bucket table (#7184) lzljs3620320
• (paimon-website) branch asf-site updated (a2b4c67e -> f253f923) github-bot
• (paimon) branch master updated: [spark] Support spark compaction for postpone bucket table (#7169) lzljs3620320
• (paimon) branch master updated: [python] Refactor to File Scanner and add _filter_manifest_files_by_row_ranges (#7177) lzljs3620320
• (paimon) branch master updated: [python] fix oss path handling for pyarrow 6.x (py36 compatibility) (#7180) lzljs3620320
• (paimon) branch master updated: [core] remark row-tracking.enabled as Immutable (#7181) lzljs3620320
• (paimon) branch master updated: [python] fix column nullability info lost issue during schema rebuilding (#7174) lzljs3620320
• (paimon) branch master updated: [core] Allow chain table to use non-deduplicate merge engines. (#7172) lzljs3620320
• (paimon) branch master updated: [python] fix duplicated unused file in btree index module (#7178) lzljs3620320
• (paimon) branch master updated: [core] Support pushing down Decimal filter in parquet format (#7175) lzljs3620320
• (paimon) branch master updated (3c0dd803f5 -> ef263a71a7) lzljs3620320
• (paimon) branch master updated: [spark] Introduce substring transform (#7170) lzljs3620320
• (paimon-website) branch asf-site updated (b2c723bd -> a2b4c67e) github-bot
• (paimon) branch master updated (eecc022bdf -> 1cc351c8ff) lzljs3620320
• (paimon) branch master updated (6948f854bc -> eecc022bdf) lzljs3620320
• (paimon) branch master updated: [python] Python BTree index reader supports INT and BIGINT (#7163) lzljs3620320
• (paimon-website) branch asf-site updated (3399d13f -> b2c723bd) github-bot
• (paimon) branch master updated: [hotfix] Add Variant TODO in ParquetSchemaConverter lzljs3620320
• (paimon) branch master updated (327fe5cad0 -> c2e1532a03) lzljs3620320
• (paimon) branch master updated: [python] Implement BTree Reader in Python (#7160) lzljs3620320
• (paimon-website) branch asf-site updated (25327621 -> 3399d13f) github-bot
• (paimon) branch master updated: [core] Improve clustering columns parsing with trim support (#7159) lzljs3620320
• (paimon) branch master updated: [core][spark] Move btree builder from spark to core (#7156) junhao
• (paimon) branch master updated: [doc] Refactor to 'Update Columns By Shards' in python lzljs3620320
• (paimon) branch master updated: [doc] Add format table in python-api lzljs3620320
• (paimon) branch master updated: [python] support format table (#7154) lzljs3620320
• (paimon) branch master updated: [python] Enable update data to compute a New Column (scan + rewrite with shards) (#7148) lzljs3620320
• (paimon) branch master updated (64293b7475 -> f633efaa9d) lzljs3620320
• (paimon) branch master updated: [python] correct with_slice index for split with multi files (#7153) lzljs3620320
• (paimon-website) branch asf-site updated (6d17ab6e -> 25327621) github-bot
• (paimon) branch master updated: [hotfix] Minor optimize performance in authedReader lzljs3620320
• (paimon) branch master updated: [spark] Refactor UPDATE command to compute aligned expressions in analysis phase (#7149) biyan
• (paimon) branch master updated: [core] DataTableRead should add auth columns to row filters lzljs3620320
• (paimon) branch master updated: [core][flink][spark] Fix column pruning with row filter (#7150) lzljs3620320
• (paimon) branch master updated: [rest] Add pluggable signer architecture for REST API authentication (#7100) lzljs3620320
• (paimon) branch master updated (990b8e748e -> 58dfc4a268) lzljs3620320
• (paimon) branch master updated: [core] Support dls file system (#7145) lzljs3620320
• (paimon) branch master updated: [build] Use PR title and description for commit message (#7142) lzljs3620320
• (paimon) branch master updated: [flink] introduce a simplified MERGE INTO procedure on data-evolution-table for flink (#7128) lzljs3620320
• (paimon) branch master updated (7fddbe4467 -> 50a3d8f2bf) lzljs3620320
• (paimon-website) branch asf-site updated (c5e65c4a -> 6d17ab6e) github-bot
• (paimon) branch master updated: [python/doc] add alterTable in pypaimon doc (#7140) lzljs3620320
• (paimon) branch master updated: [rest] Fix auth header generation order in HttpClient (#7137) lzljs3620320
• (paimon) branch master updated: [clone] support skipping cloning if the target table already exists. (#7139) lzljs3620320
• (paimon) branch master updated: [iceberg] Support real uuid for iceberg table (#7136) lzljs3620320
• (paimon) branch master updated: [core] Add conflict detection for data evolution row id (#7124) junhao
• (paimon-website) branch asf-site updated (a5940c43 -> c5e65c4a) github-bot
• (paimon) branch master updated: [spark] Make SparkCatalystPartitionPredicate thread safe (#7135) lzljs3620320
• (paimon) branch master updated: [core][spark] Introduce lower transform (#7134) lzljs3620320
• (paimon) branch master updated: [core] Notify null blob to consumer in BlobFormatWriter lzljs3620320
• (paimon) branch master updated: [format] Introduce null blob (#7125) lzljs3620320
• (paimon) branch master updated: [core] Refactor format scan optimize to simplify predicates (#7132) lzljs3620320
• (paimon) branch master updated: [spark] Explicitly disable v2-write for row-level operation tests (#7131) biyan
• (paimon) branch master updated: [parquet] remove assertion when creating Range (#7133) lzljs3620320
• (paimon) branch master updated: [python] add support for ROW/STRUCT types in PyPaimon (#7129) lzljs3620320
• (paimon) branch master updated: [spark] Refactor DataSourceV2 fallback checks into reusable helper methods (#7130) biyan
• (paimon) branch master updated: [spark] Fix DescriptorToStringFunction (#7127) junhao
• (paimon) branch master updated: [core] Rename VectorSearchGlobalIndexResult to ScoredGlobalIndexResult lzljs3620320
• (paimon) branch master updated (7cf171cbd5 -> c056231f18) lzljs3620320
• (paimon) branch master updated: Bump org.assertj:assertj-core from 3.23.1 to 3.27.7 (#7126) lzljs3620320
• (paimon-website) branch asf-site updated (644dd447 -> a5940c43) github-bot
• (paimon) branch master updated: [core] Judge minSequenceNum to decide whether assign sequenceNum to ManifestEntry (#7121) lzljs3620320
• (paimon) branch master updated: [spark] Add test: Data Evolution: concurrent merge and compact (#7120) lzljs3620320
• (paimon) branch master updated: [spark] Throw exception when to sort compact data evolution table (#7119) junhao
• (paimon) branch master updated (bdcd3ecda1 -> ceefc5ca15) junhao
• (paimon) branch master updated: [spark] Avoid multiple scan in MergeIntoPaimonDataEvolutionTable (#7116) junhao
• (paimon) branch master updated: [spark] Enable blob as descriptor with v2 write (#7115) lzljs3620320
• (paimon-website) branch asf-site updated (5e158cd7 -> 644dd447) github-bot
• (paimon) branch master updated: [spark] Fix the display of V2 delete metrics (#7114) lzljs3620320
• (paimon-website) branch asf-site updated (0eef53d6 -> 5e158cd7) github-bot
• (paimon-website) branch asf-site updated (35b0b584 -> 0eef53d6) github-bot
• (paimon) branch master updated: [doc] Separate PyPaimon documentations lzljs3620320
• (paimon) branch master updated: [core] Data Evolution: cache fileFields to speed up (#7112) lzljs3620320
• (paimon) branch master updated: [doc] Separate blob storage in append table lzljs3620320
• (paimon) branch master updated: [docs] Move blob page to data-evolution (#7113) lzljs3620320
• (paimon) branch master updated: [common] Copy bundle while shredding (#7111) lzljs3620320
• (paimon) branch master updated: [core] Support multiple blob fields definition (#7105) junhao
• (paimon) branch master updated: [spark] Fix DELETE with range condition in v2 write (#7104) zouxxyy
• (paimon-website) branch asf-site updated (25b53d3f -> 35b0b584) github-bot
• (paimon) branch master updated: [variant] Annotate Variant columns with Variant logical type annotation (#7110) lzljs3620320
• (paimon) branch master updated: [python] Python commit snapshot should not contain None fields (#7103) lzljs3620320
• (paimon) branch master updated: [parquet] Bump parquet version to 1.16.0 (#7081) lzljs3620320
• (paimon) branch master updated: [python] fix data-evolution double-counting issue by using mergedRowCount in ray datasource (#7087) lzljs3620320
• (paimon) branch master updated: [python] Avro schema inconsistents between Java and Python (#7077) lzljs3620320
• (paimon-website) branch dependabot/npm_and_yarn/lodash-4.17.23 created (now 715fefc2) github-bot
• (paimon) branch master updated: [core] Data-evolution mode support compact data-evolution table without manifest-meta:min/maxRowId (#7102) lzljs3620320
• (paimon) branch master updated: [core] Add option to support reading sequence_number in AuditLogTable and BinlogTable (#6933) yuzelin
• (paimon) branch master updated: [hotfix] Log channelWriterOutputView writeBytes after close (#7101) lzljs3620320
• (paimon) branch master updated: [core] Do not use path.toUri().toString() when a location string is expected internally (#7098) lzljs3620320
• (paimon) branch master updated: [core] Fix Iceberg metadata parsing error by excluding null doc field from JSON serialization (#7099) lzljs3620320
• (paimon) branch master updated: [hotfix] Correct mergedRowCount in QueryAuthSplit lzljs3620320
• (paimon) branch master updated (1f7477b381 -> f3d6caa2b6) lzljs3620320
• (paimon) branch master updated: [rest] Support getTable by id (#7085) lzljs3620320
• (paimon-website) branch asf-site updated (21bf4712 -> 25b53d3f) github-bot
• (paimon) branch master updated (8526f01c9f -> f8a1cf29a6) lzljs3620320
• (paimon) branch master updated: [core] Introduce IncrementalSplit to simplify DataSplit (#7093) lzljs3620320
• (paimon) branch master updated: [test] Add timestamp partition column test (#7091) lzljs3620320
• (paimon) branch master updated: [core] Introduce mergedRowCount in Split (#7090) lzljs3620320

• Earlier messages