commits  

Messages by Thread

• (paimon) branch master updated: [python] Add python directory and README file lzljs3620320
• (paimon-website) branch asf-site updated (c29086d51 -> 8827344c5) github-bot
• (paimon) branch master updated (97ffce0374 -> 26bb291211) lzljs3620320
• (paimon) branch master updated: [spark] Apply partition.sink-strategy to spark write (#5856) lzljs3620320
• (paimon) branch master updated (7f6e5747f2 -> c3cd3dabeb) lzljs3620320
• (paimon-python) branch main updated: #49 Fix: Python native read with PyArrow (#53) yuzelin
• (paimon) branch master updated: [refactor] Minor refactor TagManager for validating auto-tag (#5853) yuzelin
• (paimon-website) branch asf-site updated (fd7831d96 -> c29086d51) github-bot
• (paimon) branch master updated: [core] One snapshot should have only one auto tag (#5832) yuzelin
• (paimon) branch master updated (ee1ce4cd6a -> b9f4d4b68b) yuzelin
• (paimon) branch master updated: [doc] Update overview architecture png lzljs3620320
• (paimon) branch master updated: [core] Paimon core should import the correct package (#5843) lzljs3620320
• (paimon-website) branch asf-site updated (5cda77a83 -> fd7831d96) github-bot
• (paimon) branch master updated: [core] aggregation options are not verified when executing DDL (#5276) lzljs3620320
• (paimon) branch master updated: [spark] Fix CSV Format Table with field-delimiter (#5845) lzljs3620320
• (paimon) branch master updated: [core] fix that batch CompactAction makes no sense with all level-0 files (#5790) lzljs3620320
• (paimon-website) branch asf-site updated (ce1c32840 -> 5cda77a83) github-bot
• (paimon-website) branch asf-site updated (393dfbbb8 -> ce1c32840) github-bot
• (paimon-website) branch asf-site updated (e62cce892 -> 393dfbbb8) github-bot
• (paimon) branch master updated: [flink] ContinuousFileSplitEnumerator supports setting splitMaxPerTask for SplitAssigner. (#5835) lzljs3620320
• (paimon) branch master updated: [flink][core] Flink supports setting job level context to FileIO (#5836) lzljs3620320
• (paimon) branch master updated: [hotfix] Fix typo in obs filesystem (#5839) lzljs3620320
• (paimon) branch master updated: [core] Use correct parameters order when call methods newDescription and newDefaultValue for DataField (#5842) lzljs3620320
• (paimon) branch master updated: [flink] support specify max_pt for partition level (#5831) czweng
• (paimon-python) branch upgrade updated (fa449a4 -> 8be0d6a) yuzelin
• (paimon-python) branch upgrade created (now fa449a4) yuzelin
  • (paimon-python) 01/01: Upgrade paimon java dependency to 1.2.0 yuzelin
• (paimon) branch master updated: [hive] Format table: Support field delimiter in HMS (#5829) lzljs3620320
• (paimon) branch master updated (cd2a4ce5ee -> b14f322efd) lzljs3620320
• (paimon) branch master updated (9db048e58a -> 8d542fb8a9) lzljs3620320
• (paimon) branch master updated (8d542fb8a9 -> cd2a4ce5ee) yuzelin
• (paimon) branch master updated (8fac896822 -> 9db048e58a) lzljs3620320
• (paimon) branch master updated: [core] update test as rest catalog support alter format table (#5822) lzljs3620320
• (paimon-website) branch asf-site updated (febf393d4 -> abadd13e0) github-bot
• (paimon) branch master updated: [flink] Move FlinkSink#createWriteProvider to a common place so CDC sink can also use it (#5824) lzljs3620320
• (paimon) branch master updated: [spark][test] Fix the conflict of parquet dependency in spark test (#5826) lzljs3620320
• (paimon) branch master updated: [cdc] Support computed columns when sync_database (#5816) yuzelin
• (paimon) branch master updated: [hotfix] add detail information for NoPermissionException (#5821) lzljs3620320
• (paimon-website) branch asf-site updated (9ac622e88 -> febf393d4) github-bot
• (paimon) branch master updated: [arrow] Strip paimon-core module and paimon-format module off from paimon-arrow module (#5811) junhao
• (paimon) branch master updated (3f96b2ca69 -> 1422f98d3e) lzljs3620320
• (paimon-website) branch asf-site updated (de2d3c1d7 -> 9ac622e88) github-bot
• (paimon-website) branch asf-site updated (a5dbb3153 -> de2d3c1d7) github-bot
• (paimon-website) branch asf-site updated (5cf927e1f -> a5dbb3153) github-bot
• (paimon-website) branch master updated: feat: update doc config for releasing 1.2 lzljs3620320
• (paimon-website) branch asf-site updated (342d61be3 -> 5cf927e1f) github-bot
• (paimon) branch master updated: [doc] Update doc config for releasing 1.2 lzljs3620320
• (paimon) branch release-1.2 updated: [doc] Update doc config for releasing lzljs3620320
• (paimon-website) branch asf-site updated (ad362cc14 -> 342d61be3) github-bot
• (paimon) branch master updated: [rest] fix base header options in RESTApi (#5810) lzljs3620320
• (paimon) branch master updated: [flink] Fix the document of Fixed Bucket Large Scale Lookup optimization (#5808) lzljs3620320
• (paimon) branch master updated: [core] Support format reader and writer use File IO directly (#5760) lzljs3620320
• (paimon) branch master updated (30c18cf28a -> f0b6a4cfcb) lzljs3620320
• (paimon) branch master updated: [core] Remove 'write-manifest-cache' because new writer-coordinator (#5803) junhao
• (paimon) branch master updated: [core] add checker for rename table operation and drop table operation. (#5806) lzljs3620320
• (paimon) branch master updated: [core] Remove old default value for read side (#5804) junhao
• (paimon-website) branch asf-site updated (1da7fd168 -> ad362cc14) github-bot
• (paimon) branch master updated: [spark] Format table support show partitions (#5798) lzljs3620320
• (paimon) branch master updated: [core][iceberg] fix FileNotFoundException when deleting old metadatas (#5799) lzljs3620320
• (paimon) branch master updated: [flink] Fix deadlock and incorrect order in precommit changelog compaction (#5797) lzljs3620320
• (paimon) branch master updated (bcafd296de -> 359fb2150f) czweng
• (paimon) branch master updated: [flink] All lookup writers should store active buckets in state to make sure changelog can be produced (#5796) lzljs3620320
• (paimon) branch master updated (bd5b88c498 -> a6d2e8376c) lzljs3620320
• (paimon) branch master updated: [hive] Fix clone Hudi for table writen by old Hudi version (#5794) lzljs3620320
• (paimon-website) branch asf-site updated (81b0684f1 -> 1da7fd168) github-bot
• (paimon) branch master updated: [parquet] Fix parquet Vectored read in ParquetFileReader (#5792) junhao
• (paimon) annotated tag release-1.2.0 updated (f4c28643bb -> 94a0835520) yuzelin
• svn commit: r77724 - in /dev/paimon: paimon-1.2.0-rc1/ paimon-1.2.0-rc2/ yuzelin
• svn commit: r77725 - in /release/paimon: paimon-0.4.0-incubating/ paimon-0.5.0-incubating/ paimon-0.6.0-incubating/ paimon-0.6.1-incubating/ paimon-0.7.0-incubating/ paimon-0.8.0/ paimon-0.8.1/ paimon-0.8.2/ paimon-0.9.0/ paimon-1.0.0/ paimon-1.1.0/ yuzelin
• svn commit: r77723 - /dev/paimon/paimon-1.2.0-rc3/ /release/paimon/paimon-1.2.0/ yuzelin
• (paimon-website) branch asf-site updated (1abeab0b3 -> 81b0684f1) github-bot
• (paimon-website) branch asf-site updated (7c7ec5ff9 -> 1abeab0b3) github-bot
• (paimon) branch master updated (563f575f42 -> a8f3cf4576) aitozi
• (paimon) branch master updated: [spark] Fix read with scan.fallback-branch (#5789) lzljs3620320
• (paimon-website) branch asf-site updated (c465c23d7 -> 7c7ec5ff9) github-bot
• (paimon) branch master updated: [hotfix] Remove useless method in AbstractFileStoreWrite lzljs3620320
• (paimon) branch master updated: [hotfix] Adjust maximumSize to 1000 in RESTTokenFileIO lzljs3620320
• (paimon-website) branch asf-site updated (0de33ec23 -> c465c23d7) github-bot
• (paimon-website) branch asf-site updated (3e3c4514c -> 0de33ec23) github-bot
• svn commit: r77666 - in /dev/paimon/paimon-1.2.0-rc3: ./ apache-paimon-1.2.0-src.tgz apache-paimon-1.2.0-src.tgz.asc apache-paimon-1.2.0-src.tgz.sha512 yuzelin
• (paimon) annotated tag release-1.2.0-rc3 deleted (was 6037e4690f) yuzelin
• (paimon) annotated tag release-1.2.0-rc3 updated (f4c28643bb -> b98628a697) yuzelin
• (paimon) branch master updated: [core] Fix streaming read bug in postpone bucket tables when changelog producer is none (#5783) lzljs3620320
• (paimon) annotated tag release-1.2.0-rc3 updated (c6ec1eb75e -> 6037e4690f) yuzelin
• (paimon) branch master updated: [typo] Fix typo in FileIndexFormat (#5782) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove unnecessary override in CommitListenerFactory yuzelin
• (paimon) branch master updated: [core] Optimize commit retry on exception (#5776) czweng
• (paimon) branch master updated: [core] Fix validation messages for comparing retained snapshots & changelog (#5777) lzljs3620320
• (paimon) branch master updated: [doc] remove spaces after backslash which will cause bash command execution fail (#5780) lzljs3620320
• (paimon-website) branch asf-site updated (92bf30321 -> 3e3c4514c) github-bot
• (paimon) branch master updated: [core] support batch size for expire partition (#5766) lzljs3620320
• (paimon) branch master updated: [core] rest: support function paged api (#5774) lzljs3620320
• (paimon-website) branch master updated: feat: update docs sh lzljs3620320
• (paimon-website) branch master updated: fix: exclude paimon-e2e in docs.sh lzljs3620320
• (paimon-website) branch master updated: feat: update build to 1.2 lzljs3620320
• (paimon) branch master updated (b7d289873c -> a3c43d2159) lzljs3620320
• (paimon) branch master updated: [core][spark][flink] Introduce default value when writing (#5754) yuzelin
• (paimon) branch master updated: [flink] fallback to full cache mode when partial-lookup is unavailable. (#5769) lzljs3620320
• (paimon) branch master updated: [hotfix] Rest: optimize return type of ListTablesGlobally & ListViewsGlobally (#5775) lzljs3620320
• (paimon) branch master updated: [flink] Support loading custom CommitListener at runtime (#5763) lzljs3620320
• (paimon) branch master updated: [core] Add Check for retry commit (#5771) czweng
• (paimon) branch master updated: [hotfix] Fix comment in CommitListener lzljs3620320
• (paimon) branch master updated: [core] Rename PartitionListener to CommitListener (#5765) yuzelin
• (paimon) branch master updated: [core] clear bufferQueue when AsyncPositionOutputStream closing. (#5759) lzljs3620320
• (paimon) branch master updated: [spark] Introduce BucketExpression.quote to unify quote lzljs3620320
• (paimon) branch master updated: [spark] Fix the bug that the single bucket_key field name has special characters (#5439) lzljs3620320
• (paimon) branch master updated: [spark] Publish paimon-spark-4.0 and add doc (#5752) lzljs3620320
• (paimon) branch master updated: [core] Support rollback to tag from snapshot id (#5756) lzljs3620320
• (paimon) branch master updated: [flink] Fix paimon-flink-2.0 releasing process (#5739) yuzelin
• (paimon) branch master updated: [tool] Improve create_source_release.sh (#5755) lzljs3620320
• (paimon) annotated tag release-1.2.0-rc2 updated (17140de316 -> f66bbd31af) yuzelin
• svn commit: r77566 - in /dev/paimon/paimon-1.2.0-rc2: ./ apache-paimon-1.2.0-src.tgz apache-paimon-1.2.0-src.tgz.asc apache-paimon-1.2.0-src.tgz.sha512 yuzelin
• svn commit: r77565 - /dev/paimon/paimon-1.2.0-rc2/ yuzelin
• (paimon) annotated tag release-1.2.0-rc2 deleted (was ef0824b9c2) yuzelin
• (paimon) annotated tag release-1.2.0-rc2 updated (2a916fcdc8 -> ef0824b9c2) yuzelin
• svn commit: r77563 - in /dev/paimon/paimon-1.2.0-rc2: ./ apache-paimon-1.2.0-src.tgz apache-paimon-1.2.0-src.tgz.asc apache-paimon-1.2.0-src.tgz.sha512 yuzelin
• (paimon) branch master updated: [rest] add test case for ListPartitionsPaged WithMultiLevel (#5745) lzljs3620320
• (paimon) branch master updated: [core][test] add test case for picking some small files in top level when full compaction (#5753) lzljs3620320
• (paimon-trino) branch main updated: Support incremental snapshots reading (#97) junhao
• (paimon) branch release-1.2 updated (f8d89e67cb -> b99bf0b623) lzljs3620320
  • (paimon) 04/15: [test][spark] Fix the unstable testHiveCatalogOptions (#5738) lzljs3620320
  • (paimon) 06/15: [rest] Adjust writeTimeout of HttpClient to 3 minutes lzljs3620320
  • (paimon) 14/15: [core] Introduce auto-buffer-spill for postpone bucket write (#5744) lzljs3620320
  • (paimon) 01/15: [hive] Hive catalog configuration to get owner for table creation (#5668) lzljs3620320
  • (paimon) 13/15: [flink] Make PostponeBucketSink no state and no intended failure (#5746) lzljs3620320
  • (paimon) 10/15: [fs] Add a requiredOptions method to COSNLoader (#5750) lzljs3620320
  • (paimon) 03/15: [hotfix] Minor refactor for Flink Dedicated Split Gen Source lzljs3620320
  • (paimon) 02/15: [flink] Add 'scan.dedicated-split-generation' to Flink Batch Source (#5715) lzljs3620320
  • (paimon) 12/15: [core] Simplify force rewrite files in Compact Task (#5751) lzljs3620320
  • (paimon) 09/15: [core] Limit max task number in ManifestReadThreadPool (#5737) lzljs3620320
  • (paimon) 11/15: [core] Support dedicated full compact to external paths (#5674) lzljs3620320
  • (paimon) 08/15: [doc] fix docs gcs in filesystem.md (#5747) lzljs3620320
  • (paimon) 05/15: [flink] Add support for AvroType enum for debezium format (#5742) lzljs3620320
  • (paimon) 15/15: [flink] Introduce 'memory' type for 'lookup.cache' to in-memory cache (#5748) lzljs3620320
  • (paimon) 07/15: [flink] Postpone mode should support 'partition.sink-strategy' (#5743) lzljs3620320
• (paimon) branch master updated: [flink] Introduce 'memory' type for 'lookup.cache' to in-memory cache (#5748) lzljs3620320
• (paimon) branch master updated: [core] Introduce auto-buffer-spill for postpone bucket write (#5744) junhao
• (paimon) branch master updated: [flink] Make PostponeBucketSink no state and no intended failure (#5746) junhao
• (paimon) branch master updated: [core] Simplify force rewrite files in Compact Task (#5751) lzljs3620320
• (paimon) branch master updated: [core] Support dedicated full compact to external paths (#5674) lzljs3620320
• (paimon) branch master updated: [fs] Add a requiredOptions method to COSNLoader (#5750) lzljs3620320
• (paimon) branch master updated: [core] Limit max task number in ManifestReadThreadPool (#5737) lzljs3620320
• (paimon) branch master updated: [doc] fix docs gcs in filesystem.md (#5747) lzljs3620320
• (paimon) branch master updated: [flink] Postpone mode should support 'partition.sink-strategy' (#5743) lzljs3620320
• (paimon) branch master updated: [flink] Add support for AvroType enum for debezium format (#5742) lzljs3620320
• (paimon) annotated tag release-1.2.0-rc1 updated (fe63d5be0b -> 0aec39056f) yuzelin
• svn commit: r77507 - in /dev/paimon/paimon-1.2.0-rc1: ./ apache-paimon-1.2.0-src.tgz apache-paimon-1.2.0-src.tgz.asc apache-paimon-1.2.0-src.tgz.sha512 yuzelin
• (paimon) branch master updated: [hive] Hive catalog configuration to get owner for table creation (#5668) lzljs3620320
• (paimon) branch master updated: [core] Negative unix timestamp support (#5710) lzljs3620320
• (paimon) branch master updated: [flink] Add 'scan.dedicated-split-generation' to Flink Batch Source (#5715) lzljs3620320
• (paimon) branch master updated: [release] Update version to 1.3-SNAPSHOT yuzelin
• (paimon) branch master updated: [hotfix] Minor refactor for Flink Dedicated Split Gen Source lzljs3620320
• (paimon) branch master updated: [test][spark] Fix the unstable testHiveCatalogOptions (#5738) lzljs3620320
• (paimon) branch master updated: [doc] Add execution mode specifications for SortCompact. (#5735) lzljs3620320
• (paimon) branch release-1.2 created (now f8d89e67cb) yuzelin
  • (paimon) 02/02: [spark] Upgrade spark version to 4.0.0 (#5711) yuzelin
  • (paimon) 01/02: [core] Negative unix timestamp support (#5710) yuzelin
• (paimon) branch master updated: [spark] Upgrade spark version to 4.0.0 (#5711) zouxxyy
• (paimon) branch master updated: [pom] bump Scala version to 2.13.16 & 2.12.20 (#5505) lzljs3620320
• (paimon) branch master updated: [core] Also remove metadata.stats-mode=none in postpone bucket writers when not using avro (#5736) lzljs3620320
• (paimon) branch master updated: [core] Don't use avro in postpone bucket tables when schema contains unsupported types (#5733) lzljs3620320
• (paimon) branch master updated: [core] Validate create table for format table with primary key (#5732) yuzelin
• (paimon) branch master updated (cd96a4d5b5 -> 4874e68a4c) lzljs3620320
• (paimon) branch master updated (b13100d7ee -> cd96a4d5b5) lzljs3620320
• (paimon) branch master updated: [hotfix] TagPreview utils support DataTable (#5729) yuzelin
• (paimon) branch master updated: [core] Total buckets should remain the same within the same partition when commit (#5725) lzljs3620320
• (paimon) branch master updated: [pom] Update Javadoc plugin. (#5726) lzljs3620320
• (paimon) branch master updated: [rest] Fix hadoop conf passing in RESTCatalog (#5728) junhao
• (paimon) branch master updated: [hotfix] Fix test failure in UpdatedDataFieldsProcessFunctionBase lzljs3620320
• (paimon) branch master updated (116309cdd3 -> 02b42c9f3a) lzljs3620320
• (paimon) branch master updated: [hotfix] Refactor codes to topLevelField name in UpdatedDataFieldsProcessFunctionBase lzljs3620320
• (paimon) branch master updated: [flink-cdc] Added support for nested schema evolution in CDC (#5682) lzljs3620320
• (paimon) branch master updated: [core] Optimize DataFileMeta.keyStats to EMPTY_STATS to reduce memory usage (#5718) lzljs3620320
• (paimon) branch master updated: [hotfix] Refactor code in FileStoreCommitImpl lzljs3620320
• (paimon) branch master updated: [core] Simplify rollback to only clean snapshots (#5712) junhao
• (paimon) branch master updated: [core] fix fallback branch cannot query data in rest catalog (#5714) lzljs3620320
• (paimon) branch master updated: [flink] Writer operator support SlotSharingGroup settings (#5698) lzljs3620320
• (paimon) branch master updated: [core] Don't use snapshotManager.latestSnapshotOfUser in writers to prevent flooding catalog (#5707) lzljs3620320
• (paimon) branch master updated: [refactor] Refactor flink source to get rid of confusing BucketMode argument (#5704) lzljs3620320
• (paimon) branch master updated: [spark] Extract postCommit for both v1 and V2 write (#5705) biyan
• (paimon) branch master updated: [iceberg] Refactored schema ID retrieval to use latest schema (#5701) lzljs3620320
• (paimon) branch master updated: [core] add function name validate to avoid illegal names from Flink SQL (#5702) lzljs3620320
• (paimon) branch master updated: [core] delete all schema external files when drop table in AbstractCatalog (#5688) lzljs3620320
• (paimon) branch master updated: [hive] The Hive connector encounters time offset issues when reading and writing data of the timestamp with local time zone field type (#5571) lzljs3620320
• (paimon) branch master updated: [hive] Add configuration to skip updating Hive stats (#5694) lzljs3620320
• (paimon) branch master updated: [core, api] Add option to disable explicit type casting (#5692) lzljs3620320
• (paimon) branch master updated: [doc] enhancing documentation for partial updates during multi-stream updates (#5699) lzljs3620320
• (paimon) branch master updated: [core] rest catalog options uri schema should start with http (#5695) lzljs3620320
• (paimon) branch master updated: [hive] Update columns when committing Iceberg metadata (#5691) lzljs3620320
• (paimon) branch master updated: [jindo] Bump jindo version to 6.9.1 (latest) (#5689) lzljs3620320
• (paimon) branch master updated: [doc] Introduce Iceberg Metadata pages lzljs3620320
• (paimon) branch master updated: [core] Call Iceberg callback on replace_tag procedure (#5666) lzljs3620320
• (paimon) branch master updated: [core] Add support for map value type and array element type evolution (#5673) lzljs3620320
• (paimon) branch master updated: [core] refactor: delete snapshot commit factory (#5686) lzljs3620320
• (paimon) branch master updated: [pom] disable paimon-iceberg module by default under jdk 8 (#5685) lzljs3620320
• (paimon) branch master updated: [spark] Throw exception when creating partitioned table via CTAS (#5684) lzljs3620320
• (paimon) branch master updated: [core] Don't use snapshotManager.latestSnapshot in AbstractFileStoreWrite to prevent flooding catalog (#5680) lzljs3620320
• (paimon) branch master updated: [core][rest] Add tableId to commit snapshot to avoid wrong commit (#5679) lzljs3620320
• (paimon) branch master updated: [hotfix] fix FallbackDataSplit checkstyle yuzelin
• (paimon) branch master updated: [hotfix] Make FallbackDataSplit public for developer to judge the DataSplit type yuzelin

• Earlier messages
• Later messages