commits  

Messages by Thread

• (paimon) branch master updated: [core] Overwrite commit should never be conflicted by delete files (#6687) lzljs3620320
• (paimon) branch master updated (985b733e7d -> 53ef1f27de) czweng
• (paimon) branch master updated: [core] Add retry for reading snapshot when encountering MismatchedInputException (#6678) lzljs3620320
• (paimon-website) branch asf-site updated (054703aa -> ddc9ffe0) github-bot
• (paimon) branch release-1.3 updated: Update to 1.3.1 lzljs3620320
• (paimon) branch master updated: [core] Pass file ser version to LookupSerializerFactory to let it deserialize from old version (#6677) lzljs3620320
• (paimon) branch master updated: [test] Add non-overwrite with append test for strict mode (#6676) lzljs3620320
• (paimon) branch master updated (9eb6305b79 -> de8c14fa4f) lzljs3620320
• (paimon) branch master updated: [core] Strict-mode for OVERWRITE check APPEND snapshot with fixed bucket files (#6670) lzljs3620320
• (paimon) branch master updated: [core] Introduce RowToColumnConverter (#6673) lzljs3620320
• (paimon-website) branch asf-site updated (9aadb7fa -> 054703aa) github-bot
• (paimon) branch master updated: [core] Introduce 'deletion-vectors.modifiable' to limit dv alter (#6666) yuzelin
• (paimon) branch master updated: [core] Refactor distinct in FieldListaggAgg lzljs3620320
• (paimon) branch master updated: [core] Adjust distinct option behavior in FieldListaggAgg operator (#6582) lzljs3620320
• (paimon) branch master updated: [flink] Don't reopen the dim table if the scanned partitions are not overwritten (#6596) lzljs3620320
• (paimon-website) branch asf-site updated (c96dcad6 -> 9aadb7fa) github-bot
• (paimon) branch master updated: [core] filter irrelevant column files in DataEvolutionFileStoreScan (#6647) lzljs3620320
• (paimon) branch master updated: [core] Fix sequence.field parsing to trim spaces like primary-key (#6651) lzljs3620320
• (paimon) branch master updated: [hotfix] Refactor ShardGlobalIndexScanner and GlobalIndexEvaluator lzljs3620320
• (paimon) branch master updated (18f93bea77 -> 657205a17e) lzljs3620320
• (paimon) branch master updated: [core] Improve partition display format for partitions table (#6633) lzljs3620320
• (paimon) branch master updated: [variant] Introduce assemble shredded variant struct function (#6652) lzljs3620320
• (paimon) branch master updated: [iceberg] Use latest schema when creating and updating Hive table (#6655) lzljs3620320
• (paimon) branch master updated (716a9cff90 -> 3dc8d4fad2) czweng
• (paimon) branch master updated: [core] Introduce minRowId and maxRowId to ManifestList file (#6661) lzljs3620320
• (paimon-website) branch asf-site updated (f03cd37a -> c96dcad6) github-bot
• (paimon-website) branch asf-site updated (37269b89 -> f03cd37a) github-bot
• (paimon) branch master updated: [core] format table: fix hms sync partition (#6634) lzljs3620320
• (paimon-website) branch asf-site updated (5fdf51d1 -> 37269b89) github-bot
• (paimon) branch master updated: [spark] Support CopyFilesProcedure in spark (#6625) lzljs3620320
• (paimon) branch master updated: [core] RemoteLookupFileManager#tryToDownload should return false when faced with exceptions (#6646) lzljs3620320
• (paimon) branch master updated: [core] Change commit.callbacks order (#6636) lzljs3620320
• (paimon) branch master updated: [flink] Add procedure to remove un-existing manifest file (#6643) lzljs3620320
• (paimon) branch master updated: [core] Fix rename tag err msg (#6645) lzljs3620320
• (paimon-website) branch asf-site updated (6cebfdf7 -> 5fdf51d1) github-bot
• (paimon) branch master-janino deleted (was 8634e6ab1f) biyan
• (paimon) branch master_typo deleted (was d7a5e01735) biyan
• (paimon) branch master updated: [spark] fix dropView typo (#6644) zouxxyy
• (paimon) branch master-hive updated (678a137336 -> 8a1f076fd7) biyan
• (paimon) branch master_typo created (now d7a5e01735) biyan
  • (paimon) 01/01: [spark] fix dropView typo biyan
• (paimon) branch master updated: [core] Expire after access 10 hours in RESTTokenFileIO lzljs3620320
• (paimon) branch master updated: [core] Let short streaming job execute partition expire (#6642) lzljs3620320
• (paimon) branch master updated: [core] Custom Partition expire factory should be invoked first (#6641) lzljs3620320
• (paimon) branch master updated: [spark] Add partition filter for incremental clustering procedure (#6640) lzljs3620320
• (paimon) branch master updated: [flink] slightly refactor IncrementalClusterActionITCase (#6639) lzljs3620320
• (paimon) branch master updated: [python] use str to replace pathlib.Path to avoid scheme missing in pypaimon (#6604) lzljs3620320
• (paimon) branch master updated: [flink] Extract IncrementalClusterCompact from CompactAction (#6638) lzljs3620320
• (paimon) branch master updated: Revert "[flink] support infer parallelism for incremental clustering (#6624)" (#6637) lzljs3620320
• (paimon) annotated tag release-1.3.1 updated (28dfdfed24 -> 9127e60a3f) yuzelin
• svn commit: r80867 - dev/paimon/pypaimon-1.3.1-rc1 release/paimon/pypaimon-1.3.1 yuzelin
• svn commit: r80866 - dev/paimon/paimon-1.3.1-rc1 release/paimon/paimon-1.3.1 yuzelin
• (paimon-website) branch asf-site updated (e591c10d -> 6cebfdf7) github-bot
• (paimon) branch master updated: [jindo] Add listFilesIterative implementation in HadoopCompliantFileIO lzljs3620320
• (paimon) branch master updated: [spark] support rescale procedure in spark (#6612) lzljs3620320
• (paimon) branch master updated: [flink] Set forceStartFlinkJob default to true for CompactAction (#6631) lzljs3620320
• (paimon) branch master updated: [core] Introduce basic structure for global index write (#6628) lzljs3620320
• (paimon) branch master updated (4f18ec50ed -> a50cdefe77) lzljs3620320
• (paimon) branch master updated: [rest] Merge RESTToken with catalog options (#6629) lzljs3620320
• (paimon) branch master updated: [flink] Verify Read & Write Shredding Variant (#6623) yunfengzhou
• (paimon-website) branch asf-site updated (82e7f7c8 -> e591c10d) github-bot
• (paimon) branch master updated: [core] Add snapshot cache for latest snapshot from file system (#6622) lzljs3620320
• (paimon) branch master updated: [core] Add file size to the name of remote sst (#6615) czweng
• (paimon) branch master updated: [core] Introduce basic structure for global index read (#6626) junhao
• (paimon) branch master updated: [flink] support infer parallelism for incremental clustering (#6624) lzljs3620320
• (paimon) branch master updated (4901361d8a -> c58de0bd4f) lzljs3620320
• (paimon) branch master updated: [core] Lookup supports Variant type (#6618) lzljs3620320
• (paimon-website) branch asf-site updated (bf9048f2 -> 82e7f7c8) github-bot
• (paimon) branch master updated: [core] Introduce 'lookup.remote-file.level-threshold' to let high levels use remote only (#6614) czweng
• (paimon) branch master-hive updated (0c30bb869d -> 678a137336) biyan
• (paimon) branch master updated: [core] format table: fix two phase stream flush bug (#6620) lzljs3620320
• (paimon) branch master updated: [flink] forward parallelism of ReadOperator for clustering (#6619) lzljs3620320
• (paimon) branch master updated: [core] format table: insert data after commit sync partitions to hms (#6584) lzljs3620320
• (paimon) branch master updated: [spark] Refactor PaimonScan hierarchy to support flexible runtime filtering implementations (#6616) biyan
• (paimon) branch master updated (2798fb2dd3 -> f43ae8eca8) biyan
• (paimon) branch master updated: [core] Fix the serialization of JindoMultiPartUploadCommitter (#6613) lzljs3620320
• (paimon) branch master updated: [core] Postpone mode should not mark done when still has compaction (#6561) lzljs3620320
• (paimon-website) branch asf-site updated (332431e9 -> bf9048f2) github-bot
• (paimon) branch master updated: [spark] Wrap the corresponding table to ensure it guarantees its capabilities (#6607) lzljs3620320
• (paimon-website) branch asf-site updated (895160c1 -> 332431e9) github-bot
• (paimon) branch master-janino created (now 8634e6ab1f) biyan
  • (paimon) 01/01: [common] Bump janino version to 3.1.12 biyan
• (paimon-website) branch asf-site updated (6caf1423 -> 895160c1) github-bot
• (paimon) branch master updated: [fileio] Delegate create()/getDefault() in HadoopSecuredFileSystem (#6602) lzljs3620320
• (paimon) branch master updated: [core] Add tests for schema evolution in RemoteLookupFileManager lzljs3620320
• (paimon) branch master updated: [core] Also check row type if schema id not match in RemoteLookupFileManager (#6597) lzljs3620320
• (paimon) branch master updated: [core] rest catalog: support default create table options (#6598) lzljs3620320
• (paimon) branch master updated: [docs] Update CDC ingestion related documents (#6601) yunfengzhou
• (paimon-website) branch asf-site updated (0be22868 -> 6caf1423) github-bot
• (paimon) branch dev/create-format-table deleted (was 6fc891f345) zouxxyy
• (paimon) branch master updated: [core] Make CompactAction fields and methods protected for better extensibility (#6600) yuzelin
• (paimon) branch master updated: [core] format table: fix partition key not in the end write error (#6595) lzljs3620320
• (paimon-website) branch asf-site updated (269edf97 -> 0be22868) github-bot
• (paimon) branch master updated: [core] Async snapshot expire fallback to sync mode in batch commit (#6593) lzljs3620320
• (paimon) branch master-hive created (now 0c30bb869d) biyan
  • (paimon) 01/01: [hive] fix splitting for bucket tables biyan
• (paimon) branch master updated: [spark] Enable dynamic options for format table (#6592) lzljs3620320
• (paimon) annotated tag release-1.3.1-rc1 updated (28dfdfed24 -> 1320bc4527) yuzelin
• svn commit: r80652 - dev/paimon/pypaimon-1.3.1-rc1 yuzelin
• svn commit: r80651 - dev/paimon/paimon-1.3.1-rc1 yuzelin
• (paimon) branch release-1.3 updated (1390842f9b -> cafcf4e511) yuzelin
  • (paimon) 01/04: [spark] Fix write multiple cols with key dynamic table (#6585) yuzelin
  • (paimon) 02/04: [core] Fix spillToBinary in KeyValueBuffer (#6586) yuzelin
  • (paimon) 04/04: [arrow] Fix that complex writers didn't reset inner writer state (#6591) yuzelin
  • (paimon) 03/04: [core] Optimize IndexFileMetaSerializer#rowArrayDataToDvMetas (#6589) yuzelin
• (paimon) branch master updated: [arrow] Fix that complex writers didn't reset inner writer state (#6591) yuzelin
• (paimon) branch master updated: [rest] Fix the checker of create format table with engine impl and path (#6588) lzljs3620320
• (paimon) branch master updated: [core] Optimize IndexFileMetaSerializer#rowArrayDataToDvMetas (#6589) lzljs3620320
• (paimon) branch dev/create-format-table created (now 6fc891f345) zouxxyy
  • (paimon) 01/01: [rest] Fix the checker of create format table with engine impl and path zouxxyy
• (paimon) branch master updated: [core] Fix spillToBinary in KeyValueBuffer (#6586) yuzelin
• (paimon) branch master updated: [python] support rolling for blob write when blob-as-descriptor (#6578) jerryjing
• (paimon-website) branch asf-site updated (4f5f41dc -> 269edf97) github-bot
• (paimon) branch master updated: [core] format table: insert overwrite when data is empty need init partition path (#6583) lzljs3620320
• (paimon) branch master updated: [spark] Fix write multiple cols with key dynamic table (#6585) lzljs3620320
• (paimon) branch release-1.3 updated (26dfce04e3 -> 1390842f9b) lzljs3620320
  • (paimon) 10/18: [doc] fix postpone.default-bucket-num default value (#6554) lzljs3620320
  • (paimon) 08/18: [core] Fix that cannot get partition info if all files are in level-0 when enable dv. (#6531) lzljs3620320
  • (paimon) 15/18: [Python] License added in test (#6572) lzljs3620320
  • (paimon) 01/18: [core] Support non null column with write type (#6513) lzljs3620320
  • (paimon) 04/18: [Python] Keep the variable names of Identifier consistent with Java (#6520) lzljs3620320
  • (paimon) 05/18: [Python] Suppport multi prepare commit in the same TableWrite (#6526) lzljs3620320
  • (paimon) 11/18: [Python] Remove the use of reference types in DATA_FILE_META_SCHEMA (#6549) lzljs3620320
  • (paimon) 18/18: [Python] Add Mixed read and write test between Java and Python. (#6579) lzljs3620320
  • (paimon) 12/18: [common] Remove token expire time (#6544) lzljs3620320
  • (paimon) 09/18: [python] add test case for reading blob by to_iterator (#6536) lzljs3620320
  • (paimon) 16/18: [core] support incremental clustering in dv mode (#6559) lzljs3620320
  • (paimon) 06/18: [Python] Rename to BATCH_COMMIT_IDENTIFIER in snapshot.py lzljs3620320
  • (paimon) 03/18: [hotfix] Print partition spec and type when error in InternalRowPartitionComputer lzljs3620320
  • (paimon) 14/18: [python] Fix File Source type in data file meta (#6571) lzljs3620320
  • (paimon) 02/18: [hotfix] Add more informat to check partition spec in InternalRowPartitionComputer lzljs3620320
  • (paimon) 07/18: [python] support custom source split target size and split open file cost (#6527) lzljs3620320
  • (paimon) 17/18: [core] Refactor deletion vectors support for incremental cluster lzljs3620320
  • (paimon) 13/18: [python] Fix AtomicType.to_dict() inconsistency with java (#6548) lzljs3620320
• (paimon) branch master updated: [Python] Add Mixed read and write test between Java and Python. (#6579) lzljs3620320
• (paimon) branch master updated: [core][spark] Introduce cast transform (#6581) lzljs3620320
• (paimon) branch master updated: [core] format table: add validate format-table.implementation when create table (#6545) lzljs3620320
• (paimon) branch master updated: [core] format table: support file compression and custom default for diff format (#6500) lzljs3620320
• (paimon) branch master updated: [core] format table: support init jindo by hadoop conf (#6552) zouxxyy
• (paimon-website) branch asf-site updated (a74e4641 -> 4f5f41dc) github-bot
• (paimon) branch master updated (10b9c74989 -> f76bace9bc) lzljs3620320
  • (paimon) 01/02: [format] Refactor split in FormatTableScan lzljs3620320
  • (paimon) 02/02: [core] Refactor deletion vectors support for incremental cluster lzljs3620320
• (paimon) branch master updated: [core] format table: support file split (#6556) lzljs3620320
• (paimon) branch master updated (8d1404ca30 -> 750722f5ec) lzljs3620320
• (paimon) branch master updated: [core] Fix offset bug in StandardLineReader (#6577) lzljs3620320
• (paimon-website) branch asf-site updated (d35e81c0 -> a74e4641) github-bot
• (paimon) branch release-1.3 updated: [doc] Fix error link in views page lzljs3620320
• (paimon-website) branch master updated: feat: update header to 1.3 lzljs3620320
• (paimon-website) branch asf-site updated (a486c9e5 -> d35e81c0) github-bot
• (paimon-website) branch master updated: feat: update to 1.3 lzljs3620320
• (paimon) branch release-1.3 updated: [doc] Update config.toml lzljs3620320
• (paimon) branch master updated: [doc] Update config.toml lzljs3620320
• (paimon) branch master updated: [doc] Fix error link in views page lzljs3620320
• (paimon) branch master updated: [text] Text formats support split file to read by offset and len (#6568) jerryjing
• (paimon) branch master updated: [Python] License added in test (#6572) jerryjing
• (paimon) branch master updated: [python] Fix File Source type in data file meta (#6571) lzljs3620320
• (paimon) branch dependabot/maven/paimon-hive/paimon-hive-connector-3.1/org.apache.hive-hive-exec-4.0.1 deleted (was d5c4c642dd) github-bot
• (paimon) branch dependabot/maven/paimon-iceberg/org.apache.commons-commons-compress-1.26.0 created (now 5c739e62c4) github-bot
• (paimon) branch dependabot/maven/paimon-hive/paimon-hive-connector-3.1/org.apache.hive-hive-exec-4.0.1 created (now d5c4c642dd) github-bot
• (paimon) branch dependabot/maven/paimon-iceberg/org.apache.commons-commons-compress-1.26.0 deleted (was 5c739e62c4) github-bot
• (paimon) branch master updated: [python] Fix AtomicType.to_dict() inconsistency with java (#6548) lzljs3620320
• (paimon) branch master updated: [core] Add distinct parameter support to FieldListaggAgg operator (#6566) lzljs3620320
• (paimon) branch master updated (a4aa458403 -> a7d2e9f1d6) lzljs3620320
• (paimon) branch master updated: [core] Cache outputBytes in SingleFileWriter lzljs3620320
• (paimon) branch master updated: [core] File size should be extract from path if it is zero (#6541) lzljs3620320
• (paimon) branch master updated (79331c7ebb -> 2c3fc6c2a4) lzljs3620320
• (paimon) branch master updated: [core] format table: fix two-phase commit in FileIO for which use multi-part upload (#6525) lzljs3620320
• (paimon) branch master updated (71f26a0700 -> 9997866c3f) lzljs3620320
• (paimon) branch master updated: [doc] fix postpone.default-bucket-num default value (#6554) lzljs3620320
• (paimon) annotated tag release-1.3.0 updated (0e64d8f637 -> 1a44db3aaf) yuzelin
• svn commit: r80556 - in dev/paimon: paimon-1.3.0-rc2 pypaimon-1.3.0-rc1 pypaimon-1.3.0-rc2 yuzelin
• svn commit: r80555 - dev/paimon/paimon-1.3.0-rc1 yuzelin
• svn commit: r80554 - dev/paimon/pypaimon-1.3.0-rc3 release/paimon/pypaimon-1.3.0 yuzelin
• svn commit: r80553 - dev/paimon/paimon-1.3.0-rc3 release/paimon/paimon-1.3.0 yuzelin
• (paimon) branch master updated: [core] [fix] Fix row id push down, blob bunch check failed (#6553) junhao
• (paimon) branch master updated: [core] Fix row id push down: blob file may not continous (#6550) lzljs3620320
• (paimon) branch master updated: [python] add test case for reading blob by to_iterator (#6536) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'lookup.remote-file.enabled' to optimize lookup (#6533) lzljs3620320
• (paimon) branch revert-6538-fix-compile created (now 4970f2184f) yuzelin
  • (paimon) 01/01: Revert "[hotfix] Fix compile problem of StandardLineReader (#6538)" yuzelin
• (paimon) branch master updated: [hotfix] Fix compile problem of StandardLineReader (#6538) yuzelin
• (paimon) branch master updated: [text] Introduce TextLineReader to abstract implementations lzljs3620320
• (paimon) branch master updated: [core] format table: support line delimiter for csv and json (#6517) lzljs3620320
• (paimon) branch master updated: [python] support custom source split target size and split open file cost (#6527) lzljs3620320
• (paimon) branch master updated: [core] Fix that cannot get partition info if all files are in level-0 when enable dv. (#6531) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove BatchWriteBuilder.copyWithNewTable from public APIs lzljs3620320
• (paimon) branch master updated: [spark] Postpone bucket table supports to batch write fixed bucket (#6534) lzljs3620320
• (paimon) branch master updated (3a36fe011a -> e9a972ad73) lzljs3620320
• (paimon) branch master updated: [Python] Suppport multi prepare commit in the same TableWrite (#6526) lzljs3620320
• (paimon) branch master updated: [core] skip validate main branch before orphan files cleaning (#6524) jerryjing
• (paimon) branch master updated: [core][spark] Introduce upper transform (#6521) zouxxyy
• (paimon) branch master updated: [Python] Keep the variable names of Identifier consistent with Java (#6520) lzljs3620320
• (paimon) branch master updated (f889cad694 -> f664efddab) lzljs3620320
• (paimon) branch master updated: [core][format] Format Table plan partitions should ignore hidden & illegal dirs (#6522) jerryjing
• (paimon) branch master updated: [hotfix] Print partition spec and type when error in InternalRowPartitionComputer lzljs3620320
• (paimon) branch master updated: [hotfix] Add more informat to check partition spec in InternalRowPartitionComputer lzljs3620320
• (paimon) branch master updated: [hotfix] Use deleteDirectoryQuietly in TempFileCommitter.clean lzljs3620320
• (paimon) branch master updated (4bcd867e0f -> 3fd6c2916c) lzljs3620320
• (paimon) branch master updated: [core] Support non null column with write type (#6513) lzljs3620320

• Earlier messages
• Later messages