commits  

Messages by Thread

• (paimon) branch master updated: [core] Support non null column with write type (#6513) lzljs3620320
• (paimon) branch master updated: [core][fix] Blob with rolling file failed (#6518) lzljs3620320
• (paimon) branch master updated: [core][rest] Support schema validation and infer for external paimon table (#6501) lzljs3620320
• (paimon) branch master updated (3b66ba1ddd -> ebdfa02bdd) lzljs3620320
• (paimon) branch master updated: [hotfix] Rename to copy from withNewInputs in TransformPredicate lzljs3620320
• (paimon) branch master updated: [core][spark] Support push down transform predicate (#6506) lzljs3620320
• (paimon) branch master updated: [spark] Implement SupportsReportStatistics for PaimonFormatTableBaseScan (#6515) lzljs3620320
• (paimon) branch master updated: [docs] add docs for auto-clustering of historical partitions (#6516) lzljs3620320
• (paimon) branch master updated: [csv] Csv Parser should not depends on jackson (#6508) kerwin
• (paimon) branch master updated (2a2276bf41 -> 336f8cd46c) kerwin
• (paimon) branch master updated (ca2c9b155c -> 2a2276bf41) lzljs3620320
• (paimon) branch master updated: [flink-cdc] Preserve Avro field documentation as Paimon column comments (#6505) lzljs3620320
• (paimon) branch master updated: [core] format table: refactor overwrite to both Flink and Spark (#6497) lzljs3620320
• (paimon) annotated tag release-1.3.0-rc3 updated (0e64d8f637 -> 0aa6ba55c6) yuzelin
• (paimon) branch release-1.3.0-rc3 deleted (was 0e64d8f637) yuzelin
• (paimon) branch release-1.3.0-rc3 created (now 0e64d8f637) yuzelin
  • (paimon) 01/01: [release] Update version to 1.3.0 yuzelin
• svn commit: r80408 - dev/paimon/pypaimon-1.3.0-rc3 yuzelin
• svn commit: r80407 - dev/paimon/paimon-1.3.0-rc3 yuzelin
• (paimon) branch master updated: [core] Extract a PosponeUtils to getKnownNumBuckets lzljs3620320
• (paimon) branch master updated: [flink] Postpone bucket table supports to batch write fixed bucket (#6460) lzljs3620320
• (paimon) branch release-1.3 updated (4f9bfd85fc -> d495257d4c) lzljs3620320
  • (paimon) 03/09: [doc] Fix typo in flink/sql-ddl.md (#6476) lzljs3620320
  • (paimon) 04/09: [typo] fix typo in distinct (#6475) lzljs3620320
  • (paimon) 02/09: [doc] add view doc (#6469) lzljs3620320
  • (paimon) 07/09: [core] Refactor HistoryPartitionCluster to load less history partitions lzljs3620320
  • (paimon) 06/09: [core] support automatically clustering historical partition (#6472) lzljs3620320
  • (paimon) 09/09: [core] Fix endian spec for BloomFilter index reader (#6493) lzljs3620320
  • (paimon) 08/09: [spark] Fix write non-pk dv table with external paths (#6487) lzljs3620320
  • (paimon) 05/09: [doc] Update batch partition mark done doc (#6478) lzljs3620320
  • (paimon) 01/09: [doc] fix MarkPartitionDoneProcedure doc. (#6473) lzljs3620320
• (paimon) branch master updated: [core] Introduce transform predicate for complex predicate (#6498) lzljs3620320
• (paimon) branch master updated (86e2e2f698 -> 5c3965d422) junhao
• (paimon) branch master updated: [core] Fix endian spec for BloomFilter index reader (#6493) lzljs3620320
• (paimon) branch master updated: [test][core] Fix test in DataEvolutionSplitGeneratorTest, make it more accurate (#6495) lzljs3620320
• (paimon) branch master updated: [Python] Change pyarrow version (#6492) lzljs3620320
• (paimon) branch release-1.3 updated: [Python] Move __version__ to setup.py (#6491) lzljs3620320
• (paimon) branch master updated: [core] Support row id push down (#6483) lzljs3620320
• (paimon) branch master updated: [Python] Blob Table supports partition (#6488) lzljs3620320
• (paimon) branch master updated (4574a154ee -> 0a68a122c4) junhao
• (paimon) branch master updated (8787e27afa -> 4574a154ee) lzljs3620320
• (paimon) branch master updated: [core] Default value of 'cache.deletion-vectors.max-num' to 100_000 lzljs3620320
• (paimon) branch master updated: [core] Refactor HistoryPartitionCluster to load less history partitions lzljs3620320
• (paimon) branch master updated: [core] support automatically clustering historical partition (#6472) lzljs3620320
• (paimon) branch master updated: [core] Don't check -2 and fixed buckets changes (#6485) lzljs3620320
• (paimon) branch master updated: [core] Fix issue: data evolution meet writeCols not equals to statsCols (#6481) lzljs3620320
• (paimon) branch master updated: [core] format table: update format-table.implementation default value from engine to paimon (#6474) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'commit.discard-duplicate-files' to make append safe (#6464) junhao
• (paimon) branch master updated: [spark] Refactor for spark format table (#6477) lzljs3620320
• (paimon) branch master updated: [doc] Update batch partition mark done doc (#6478) lzljs3620320
• (paimon) annotated tag release-1.3.0-rc2 updated (c34994bd9c -> fca32b696f) yuzelin
• svn commit: r80325 - dev/paimon/pypaimon-1.3.0-rc2 yuzelin
• svn commit: r80324 - dev/paimon/paimon-1.3.0-rc2 yuzelin
• (paimon) branch master updated: [core] Refactor dv index cache in SnapshotReaderImpl lzljs3620320
• (paimon) branch master updated: [typo] fix typo in distinct (#6475) lzljs3620320
• (paimon) branch master updated: [doc] Fix typo in flink/sql-ddl.md (#6476) lzljs3620320
• (paimon) branch master updated: [core] Introduce deletion vector meta cache at bucket level (#6407) lzljs3620320
• (paimon) branch master updated: [rest] Support external paimon table in rest catalog (#6446) lzljs3620320
• (paimon) branch master updated: [core] format table: jindo io use upload part to support two-phase commit (#6470) lzljs3620320
• (paimon) branch master updated: [doc] add view doc (#6469) lzljs3620320
• (paimon) branch master updated: [doc] fix MarkPartitionDoneProcedure doc. (#6473) lzljs3620320
• (paimon) branch release-1.3 updated (a7500e4700 -> edda9f0412) lzljs3620320
  • (paimon) 08/14: [python] Use _try_to_pad_batch_by_schema in TableRead lzljs3620320
  • (paimon) 10/14: [Python] Add basic tests for schema evolution read (#6463) lzljs3620320
  • (paimon) 07/14: [python] Split read should discard predicate for other fields lzljs3620320
  • (paimon) 13/14: [doc] Refactor names in python-api lzljs3620320
  • (paimon) 03/14: [Python] Fix bug comparing string and int in row_key_extractor (#6448) lzljs3620320
  • (paimon) 01/14: [Python] parallel read manifest entries (#6451) lzljs3620320
  • (paimon) 05/14: [Python] Support schema evolution read for changing column position (#6458) lzljs3620320
  • (paimon) 09/14: [core] disable dv mode for incremental clustering table (#6461) lzljs3620320
  • (paimon) 06/14: [python] Introduce schema cache in SchemaManager lzljs3620320
  • (paimon) 14/14: [arrow] Fix java.lang.IllegalArgumentException in ArrowFormatCWriter. (#6459) lzljs3620320
  • (paimon) 12/14: [doc] Supplementary the document of python REST API (#6466) lzljs3620320
  • (paimon) 04/14: [rest] Add more hint message when commit failed because of NoSuchResourceException(#6456) lzljs3620320
  • (paimon) 11/14: [Python] Blob read supports with_shard (#6465) lzljs3620320
  • (paimon) 02/14: [Python] max_workers at least 8 for manifest_file_manager.read_entries_paralle lzljs3620320
• (paimon-website) branch asf-site updated (8e932a03 -> a486c9e5) github-bot
• (paimon) branch master updated: [arrow] Fix java.lang.IllegalArgumentException in ArrowFormatCWriter. (#6459) lzljs3620320
• (paimon) branch master updated: [core] Enable manifest filter in data evolution table (#6455) lzljs3620320
• (paimon) branch master updated: [doc] Refactor names in python-api lzljs3620320
• (paimon) branch master updated: [doc] Supplementary the document of python REST API (#6466) lzljs3620320
• (paimon-website) branch asf-site updated (e00ca860 -> 8e932a03) github-bot
• (paimon-website) branch asf-site updated (494dafab -> e00ca860) github-bot
• (paimon) branch master updated (2080559eb8 -> f50733b53f) jerryjing
• (paimon) branch master updated: [Python] Blob read supports with_shard (#6465) lzljs3620320
• (paimon-website) branch asf-site updated (e2eaad39 -> 494dafab) github-bot
• (paimon) branch master updated: [Python] Add basic tests for schema evolution read (#6463) lzljs3620320
• (paimon) branch master updated (966cdd0426 -> 7583bb07c1) lzljs3620320
• (paimon) branch master updated: [python] Use _try_to_pad_batch_by_schema in TableRead lzljs3620320
• (paimon) branch master updated: [python] Split read should discard predicate for other fields lzljs3620320
• (paimon) branch master updated: [python] Introduce schema cache in SchemaManager lzljs3620320
• (paimon) branch master updated: [Python] Support schema evolution read for changing column position (#6458) lzljs3620320
• (paimon-website) branch asf-site updated (54ebe365 -> e2eaad39) github-bot
• (paimon) branch master updated: [rest] Add more hint message when commit failed because of NoSuchResourceException(#6456) lzljs3620320
• (paimon) branch master updated: [Python] Fix bug comparing string and int in row_key_extractor (#6448) lzljs3620320
• (paimon) branch master updated (cef2c5e64b -> 96c5fe6a6e) lzljs3620320
• (paimon) branch master updated: [Python] parallel read manifest entries (#6451) lzljs3620320
• (paimon) branch release-1.3 updated: [flink] Incremental Clustering support specify partitions (#6449) lzljs3620320
• (paimon) branch master updated: [flink] Incremental Clustering support specify partitions (#6449) lzljs3620320
• (paimon) branch release-1.3 updated: [core] Disable data evolution manifest filter for now (#6443) lzljs3620320
• (paimon) branch release-1.3 updated (05ad2a058a -> 80ac5e2b45) lzljs3620320
  • (paimon) 10/19: [Python] optimize codes related to push_down_utils (#6430) lzljs3620320
  • (paimon) 05/19: [python] Support blob read && write (#6420) lzljs3620320
  • (paimon) 11/19: [flink] disable clustering during writing if incremental clustering enabled (#6432) lzljs3620320
  • (paimon) 14/19: [python] Refactor dicts to static fields to improve performance (#6436) lzljs3620320
  • (paimon) 02/19: [Python] Enable field merge read in row-tracking table (#6399) lzljs3620320
  • (paimon) 03/19: [Python] Introduce incremental-between read by timestamp (#6391) lzljs3620320
  • (paimon) 01/19: [python] support blob type and blob write and read (#6390) lzljs3620320
  • (paimon) 06/19: [python] Blob type more test for descriptor (#6422) lzljs3620320
  • (paimon) 17/19: [Python] Refactor BinaryRow to reuse keys and key fields (#6445) lzljs3620320
  • (paimon) 08/19: [python] Filter manifest files by partition predicate in scan (#6419) lzljs3620320
  • (paimon) 12/19: [python] Drop stats for manifest entries reading (#6429) lzljs3620320
  • (paimon) 18/19: [Python] filter_manifest_entry should not evolution primary keys lzljs3620320
  • (paimon) 09/19: [python] Filter manifest entry by advance to reduce memory (#6428) lzljs3620320
  • (paimon) 07/19: [python] Make FileStoreWrite.max_seq_numbers lazied (#6418) lzljs3620320
  • (paimon) 16/19: [Python] SimpleStats supports BinaryRow (#6444) lzljs3620320
  • (paimon) 19/19: [Python] Remove useless TODO in SimpleStats lzljs3620320
  • (paimon) 13/19: [Python] clean code for pypaimon (#6433) lzljs3620320
  • (paimon) 15/19: [flink] Produce real random id in SourceSplitGenerator (#6441) lzljs3620320
  • (paimon) 04/19: [core]Python: fix blob write when blob_as_descriptor is true (#6404) lzljs3620320
• (paimon) branch master updated (324565f45f -> 8cd4bc0078) lzljs3620320
• (paimon) branch master updated: [rest] Remove useless loadTableToken in RESTCatalog lzljs3620320
• (paimon-website) branch asf-site updated (73d1ff7d -> 54ebe365) github-bot
• (paimon) branch master updated: [Python] Remove useless TODO in SimpleStats lzljs3620320
• (paimon) branch master updated: [Python] filter_manifest_entry should not evolution primary keys lzljs3620320
• (paimon) branch master updated: [hotfix] Fix compile error in AppendOnlyWriterTest lzljs3620320
• (paimon) branch master updated: [Python] Refactor BinaryRow to reuse keys and key fields (#6445) lzljs3620320
• (paimon) branch master updated: [Python] SimpleStats supports BinaryRow (#6444) lzljs3620320
• (paimon) branch master updated (2e7febe4c3 -> de0696d66c) lzljs3620320
• (paimon) branch master updated: [core] Support blob set target size (#6424) lzljs3620320
• (paimon) branch master updated: [core] Disable blob manifest filter for now (#6443) lzljs3620320
• (paimon) branch master updated: [core] Disable blob type force spill yet (#6427) lzljs3620320
• (paimon) branch master updated: [flink] Produce real random id in SourceSplitGenerator (#6441) lzljs3620320
• (paimon) branch master updated: [spark] Introduce a base class for SparkTable to support multi-version APIs (#6421) biyan
• (paimon-website) branch asf-site updated (9593c81c -> 73d1ff7d) github-bot
• (paimon) branch master updated: [python] Refactor dicts to static fields to improve performance (#6436) lzljs3620320
• (paimon) branch master updated: [Python] clean code for pypaimon (#6433) lzljs3620320
• (paimon) branch master updated: [python] Drop stats for manifest entries reading (#6429) lzljs3620320
• (paimon) branch master updated: [flink] disable clustering during writing if incremental clustering enabled (#6432) lzljs3620320
• (paimon) branch master updated: [Python] optimize codes related to push_down_utils (#6430) lzljs3620320
• (paimon) branch master updated (a3e643dd24 -> 8052b82b03) lzljs3620320
• (paimon) branch master updated (428fab989c -> a3e643dd24) lzljs3620320
• (paimon-website) branch asf-site updated (228463c7 -> 9593c81c) github-bot
• (paimon-website) branch asf-site updated (f4397ee8 -> b3fdea1d) github-bot
• (paimon) branch master updated: [spark] Bump Spark 3.5.7 (#6337) zouxxyy
• (paimon-website) branch asf-site updated (5806e77f -> 228463c7) github-bot
• (paimon) branch release-1.3 updated (0a5004c78d -> 5caa6f6fd7) lzljs3620320
  • (paimon) 03/09: [core] Apply 'file-operation-thread-num' to commit (#6339) lzljs3620320
  • (paimon) 02/09: [python] Modify package version to be compatible with python version (#6331) lzljs3620320
  • (paimon) 01/09: [arrow] ArrowBatchConverter support reset the reused VectorSchemaRoot (#6322) lzljs3620320
  • (paimon) 08/09: [core] Support incremental clustering for append unaware table (#6338) lzljs3620320
  • (paimon) 06/09: [spark] Improve error msg for creating a function on an existing tmp function (#6343) lzljs3620320
  • (paimon) 04/09: [spark] Support version-specific default configuration values (#6334) lzljs3620320
  • (paimon) 09/09: [core] Add dv conflict detection during commit (#6303) lzljs3620320
  • (paimon) 05/09: [python] Fix OSSParam to access DLF (#6332) lzljs3620320
  • (paimon) 07/09: [core] Fix comment of paged api (#6348) lzljs3620320
• (paimon) branch master updated: [core] Update deprecated HttpClient 5 API calls (#6311) biyan
• (paimon) branch master updated: [core] Fix that FilesTable cannot output level0 files when dv enabled (#6414) lzljs3620320
• (paimon) branch release-1.3 updated: [hotfix] Disable unstable test CloneActionITCase lzljs3620320
• (paimon) branch master updated: [spark] Support ACCEPT_ANY_SCHEMA for spark v2 write (#6281) biyan
• (paimon) branch master updated: [spark] Fix group by partial partition of a multi partition table (#6375) lzljs3620320
• (paimon-website) branch asf-site updated (7358f400 -> ba82c1c6) github-bot
• (paimon) branch master updated: [flink] Support creating table with blob in flink sql. (#6351) lzljs3620320
• (paimon-website) branch asf-site updated (99dea7d5 -> cc04a5f7) github-bot
• (paimon) branch master updated: [core] Support incremental clustering for append unaware table (#6338) lzljs3620320
• (paimon) branch master updated: [hive] Hive metastore support create table with blob (#6383) lzljs3620320
• (paimon) branch master updated: [core] Support read increment changelog and delta between two tag (#6324) lzljs3620320
• (paimon) branch master updated: [iceberg] Enhance iceberg snapshot metadata. (#6354) lzljs3620320
• (paimon) branch master updated: [Python] Enable field merge read in row-tracking table (#6399) junhao
• (paimon) branch master updated: [spark] Add currentSnapshotId to the description in paimon scan (#6318) biyan
• (paimon) branch master updated: [core] Refactor FieldBunch in DataEvolutionSplitRead lzljs3620320
• (paimon) branch master updated: [hotfix] Fix typo in MergeIntoPaimonTable (#6381) lzljs3620320
• (paimon-website) branch asf-site updated (cc04a5f7 -> 55144735) github-bot
• (paimon) branch master updated: [core] Minor refactor conflicts check for deletion vectors files (#6369) lzljs3620320
• (paimon-website) branch asf-site updated (10f76d7b -> a20fd810) github-bot
• (paimon) branch master updated: [spark] Spark write supports 'full-compaction.delta-commits' (#6364) lzljs3620320
• (paimon) branch master updated: [core] Introduce DataPagedOutputSerializer to limit memory in ManifestEntryCache (#6355) czweng
• (paimon) branch master updated: [core] Fix blob file read with partition (#6423) junhao
• (paimon) branch master updated: [hotfix] Convert to static methods in RollingBlobFileWriter lzljs3620320
• (paimon-website) branch asf-site updated (26ad3d35 -> 299a6d5d) github-bot
• (paimon) branch master updated: [core] Add cache in StatsCollectorFactories lzljs3620320
• (paimon) branch master updated: [test] Disable unstable CloneActionITCase lzljs3620320
• (paimon) branch master updated: [core] Support blob read and write (#6344) lzljs3620320
• (paimon) branch master updated (38e412da32 -> 6d09d4e270) lzljs3620320
• (paimon) branch release-1.3 updated (77078566bd -> 0a5004c78d) lzljs3620320
  • (paimon) 10/20: [core] Fix the commit kind when performing row-level changes on non-pk table (#6025) lzljs3620320
  • (paimon) 04/20: [hotfix] Fix comments in MergeFileSplitRead and style lzljs3620320
  • (paimon) 14/20: [cdc] Fix cannot be cast to float due to precision loss (#6291) lzljs3620320
  • (paimon) 01/20: [core] Modify all row lineage to row tracking in codes (#6262) lzljs3620320
  • (paimon) 15/20: [lance] Remove shade for paimon-lance (#6310) lzljs3620320
  • (paimon) 13/20: [rest] Add tableType parameter support for listing tables (#6295) lzljs3620320
  • (paimon) 12/20: [spark] Resolve function after all args have been resolved (#6292) lzljs3620320
  • (paimon) 08/20: [iceberg] Enhance Iceberg timestamp type compatibility with extended precision support. (#6278) lzljs3620320
  • (paimon) 05/20: [append] Fix error of compaction append table with deletion vectors (#6258) lzljs3620320
  • (paimon) 16/20: [core] nested-update supports limit the input (#6309) lzljs3620320
  • (paimon) 20/20: [python] Support ignore_if_exists param for database and table (#6314) lzljs3620320
  • (paimon) 07/20: [spark] Avoid unnecessary repeated resolve MergeIntoTable (#6275) lzljs3620320
  • (paimon) 02/20: [core][flink] Remove withMemoryPool in TableWriteImpl (#6265) lzljs3620320
  • (paimon) 17/20: [core] Cross partition can work with fixed bucket and postpone bucket (#6307) lzljs3620320
  • (paimon) 09/20: [core] Separate indexIncrement into dataIncrement and compactIncrement (#6285) lzljs3620320

• Earlier messages
• Later messages