commits  

Messages by Thread

• • (paimon) 05/06: [spark] Support partitioned format table (#5502) lzljs3620320
  • (paimon) 04/06: [flink] Fix IllegalArgumentException when setting scan.partitions to max_pt() in older Flink versions (#5491) lzljs3620320
• (paimon) branch master updated: Revert "[doc] alter streaming write to paimon table grammar (#5499)" (#5507) lzljs3620320
• (paimon) branch master updated: [core] fix refresh token to earlier refresh and log refresh (#5504) lzljs3620320
• (paimon) branch revert-5499-qingwei/alterSparkSqlWriteDoc created (now c68a6b14a5) zouxxyy
  • (paimon) 01/01: Revert "[doc] alter streaming write to paimon table grammar (#5499)" zouxxyy
• (paimon) branch master updated: [core] Improve performance of PartialUpdateMergeFunction with sequence group (#5481) junhao
• (paimon) branch master updated: [spark] Support partitioned format table (#5502) lzljs3620320
• (paimon) branch master updated (1cf009aab4 -> d8ae7652b9) lzljs3620320
• (paimon) branch master updated: [doc] alter streaming write to paimon table grammar (#5499) lzljs3620320
• (paimon) branch master updated: [test] Fix failure tests in SparkCatalogWithHiveTest lzljs3620320
• (paimon) branch master updated: [hive][clone] check whether source catalog is HiveCatalog (#5496) lzljs3620320
• (paimon) branch master updated: [format] Bump parquet from 1.13.1 to 1.15.1 (#5421) lzljs3620320
• (paimon) branch master updated (2ba3839068 -> a7770e22f9) lzljs3620320
  • (paimon) 02/02: [parquet] Apply Parquet 1.15 changes lzljs3620320
  • (paimon) 01/02: [test] Refactor SparkCatalogWithHiveTest and add partition tests lzljs3620320
• (paimon) branch master updated: [hotfix] Extract some common codes of clone hive and migrate hive (#5497) lzljs3620320
• (paimon) branch master updated: [test] Refactor SchemaManagerTest to use parameterized tests for move operations (#5424) lzljs3620320
• (paimon-trino) branch old_version_master created (now 17582aa) junhao
  • (paimon-trino) 02/03: Update version to 1.2-SNAPSHOT junhao
  • (paimon-trino) 01/03: Old version compitable junhao
  • (paimon-trino) 03/03: Fix test for 1.2-SNAPSHOT junhao
• (paimon) branch release-1.1 updated: [core] Reduce the file size per append table compaction task (#5493) lzljs3620320
• (paimon) branch master updated: [doc] fix clone hive database doc (#5494) lzljs3620320
• (paimon) branch master updated: [hotfix] Rename CloneHiveUtilsTest to ListHiveFilesFunctionTest (#5495) lzljs3620320
• (paimon-website) branch pypaimon_0.2.0 deleted (was 16abf41aca) yuzelin
• (paimon) branch master updated: [doc] fix docs in filesystem.md (#5477) lzljs3620320
• (paimon) branch master updated: [log] Add detailed failure log and test for query metadata columns (#5479) lzljs3620320
• (paimon) branch release-1.1 updated: [doc] Add download for Flink 2.0 lzljs3620320
• (paimon) branch master updated: [doc] Add download for Flink 2.0 lzljs3620320
• (paimon) branch master updated: [doc] Add doc for where in clone from hive lzljs3620320
• (paimon) branch master updated: [flink] Fix IllegalArgumentException when setting scan.partitions to max_pt() in older Flink versions (#5491) lzljs3620320
• (paimon) branch master updated: [flink] Make clone hive tables production-ready (#5490) lzljs3620320
• (paimon-website) branch master updated: feat: add label 1.1 lzljs3620320
• (paimon) branch master updated (e5ac69337b -> b44824452e) zouxxyy
• (paimon) branch release-1.1 updated: [doc] Update config.toml lzljs3620320
  • (paimon) branch release-1.1 updated: [doc] Update config.toml lzljs3620320
  • (paimon) branch release-1.1 updated: [doc] Update config.toml lzljs3620320
• (paimon) branch master updated: [flink] Support custom lookup shuffle for fixed bucket table (#5478) lzljs3620320
• (paimon) branch master updated: [core] Use write null for uncompact decimal and timestamp in InternalRowSerialize (#5483) lzljs3620320
• svn commit: r76338 - /dev/paimon/paimon-1.1.0-rc1/ /release/paimon/paimon-1.1.0/ yuzelin
• svn commit: r76339 - in /dev/paimon: paimon-1.0.0-rc1/ paimon-1.0.0-rc2/ pypaimon-0.2.0-rc1/ pypaimon-0.2.0-rc2/ yuzelin
• (paimon) tag release-1.1.0 created (now b9b9e218f9) yuzelin
• (paimon) branch master updated: [test][dv] fix wrong test for Bitmap64DeletionVector (#5487) yuzelin
• (paimon) branch master updated: [fs] JindoFileIO supports OSS additional meta information (#5459) lzljs3620320
• (paimon) branch master updated (e3e7899cf8 -> f9088ede27) lzljs3620320
• (paimon) branch master updated: [core] Extract generateTableSchema method to optimize code structure (#5482) lzljs3620320
• (paimon) branch master updated: [core] introduce v2 deletion vector (#5475) lzljs3620320
• (paimon) branch master updated: [build] Speed up tests execution (#5473) lzljs3620320
• (paimon) branch master updated: [hotfix] fix markdown heading level (#5474) lzljs3620320
• (paimon) branch master updated: [core] Support configurable Iceberg metadata path independent of storage type (#5471) lzljs3620320
• (paimon) branch master updated: [doc] Exclude deprecated `branch` option (#5460) lzljs3620320
• (paimon) branch master updated (f201bbf4d6 -> cc67e93594) lzljs3620320
• (paimon) annotated tag release-1.1.0-rc1 deleted (was 695f18695a) yuzelin
• (paimon) branch master updated: [core] Should not close channelManager in BinaryExternalSortBuffer (#5466) lzljs3620320
• (paimon) branch master updated: [core][doc] Document options for 'incremental-to-auto-tag' (#5465) lzljs3620320
• (paimon) branch master updated: [doc] Refactor CDC type mapping doc and add missing options (#5429) lzljs3620320
• (paimon) tag list created (now 2c45ac0d66) yuzelin
• (paimon) branch master updated: [doc] not recommended to use asynchronous expiration in batch mode (#5464) junhao
• (paimon) annotated tag release-1.1.0-rc1 updated (b9b9e218f9 -> 5e7bb73b2e) yuzelin
• (paimon) branch release-1.1 updated: [hotfix] Add flink1 profile to deploy and publish process (#5461) yuzelin
• (paimon) annotated tag release-1.1.0-rc1 updated (4bdb016e09 -> 695f18695a) yuzelin
• svn commit: r76241 - in /dev/paimon/paimon-1.1.0-rc1: ./ apache-paimon-1.1.0-src.tgz apache-paimon-1.1.0-src.tgz.asc apache-paimon-1.1.0-src.tgz.sha512 yuzelin
• (paimon) branch master updated (905232d008 -> 1b91735d3e) yuzelin
• (paimon) branch master updated: [doc] Modify master to 1.1-SNAPSHOT yuzelin
• (paimon) branch release-1.1 created (now cc08efb847) yuzelin
  • (paimon) 01/01: [release] Update config.toml yuzelin
• (paimon) branch master updated: [hotfix] Fix paimon-flinkx-common version yuzelin
• (paimon) branch master updated: [release] Update version to 1.2-SNAPSHOT yuzelin
• (paimon) branch master updated: [flink] NoopStoreSinkWriteState should do nothing instead of throwing UnsupportedOperationException (#5458) lzljs3620320
• (paimon) branch master updated: [core] Remove useless 'compaction.max.file-num' (#5455) junhao
• (paimon) branch master updated: [core] Introduce specific options for changelog files (#5451) lzljs3620320
• (paimon) branch master updated: [test] Fix incorrect test in StoreCompactOperatorTest (#5453) lzljs3620320
• (paimon) branch master updated (f5c7e14914 -> de141e8862) lzljs3620320
• (paimon) branch master updated (e65a9e1ac5 -> f5c7e14914) lzljs3620320
• (paimon) branch master updated: [fs] Add filesystem support for Huawei OBS Storage (#5417) lzljs3620320
• (paimon) branch master updated: [core] Purge files use Table API and no dry run (#5448) lzljs3620320
• (paimon) branch master updated: [core][test] Test that snapshot deletion stops when throwing exception for skipping set (#5438) lzljs3620320
• (paimon) branch master updated: [spark][hive] Spark & Hive support writing to postpone bucket (#5441) czweng
• (paimon) branch master updated: [hotfix] Fix test WithPartialUpdateMergeFunctionTest (#5425) lzljs3620320
• (paimon) branch master updated: [hive] Fix `sync-all-properties` related tests (#5435) lzljs3620320
• (paimon) branch master updated (6d844c2519 -> 5c496a1082) lzljs3620320
• (paimon) branch master updated: [flink] Set IOManager to TableRead in Flink source (#5443) lzljs3620320
• (paimon) branch master updated: [flink] Support Flink 2.0 (#5408) lzljs3620320
• (paimon) branch master updated (2cb9acc3da -> 9422995a3d) lzljs3620320
• (paimon) branch master updated: [core] Add option to always select level 0 files when compacting (#5428) lzljs3620320
• (paimon) branch master updated (20657050fb -> 28c21c2cb9) czweng
• (paimon) branch master updated: [rest] add requestId into errorMsg (#5426) lzljs3620320
• (paimon) branch master updated (9d55aaea9e -> 9d94bcba48) junhao
• (paimon) branch master updated (6bf7ddccac -> 9d55aaea9e) lzljs3620320
• (paimon) branch master updated: [core] Throw exception when travel to timestamp before the earliest snapshot (#5423) lzljs3620320
• (paimon) branch master updated: [spark] Add bucket function and write benchmark (#5418) biyan
• (paimon) branch master updated: [core] Validate fast-forward from the current branch (#5413) lzljs3620320
• (paimon) branch master updated: [core] Upgrade json-smart and resolve CVE-2024-57699 (#5415) lzljs3620320
• (paimon) branch master updated: [flink] Flink batch delete supports aggregation.remove-record-on-delete option (#5402) junhao
• (paimon) branch master updated: [core] Fix aggregate delete bug and refactor SortBufferWriteBufferTestBase (#5414) junhao
• (paimon) branch master updated: [core] Add withLevel method in SnapshotReader to optimize RO table scanning (#5412) lzljs3620320
• (paimon) branch master updated: [cdc] Fix database sync performance issue of schema evolution (#5382) lzljs3620320
• (paimon) branch master updated: [docs] add more docs about record-level expire (#5410) lzljs3620320
• (paimon) branch master updated: [core] Unify the order of procedure loading properties (#4657) lzljs3620320
• (paimon) branch master updated (1c438ee9d5 -> e56ebb5180) lzljs3620320
• (paimon) branch master updated: [core] Fix FileMonitorTable with Deletion Vectors Enabled (#5406) lzljs3620320
• (paimon) branch master updated: [core] Make the default version of bitmap index to 2 (#5405) lzljs3620320
• (paimon) branch master updated: [flink] Copy bytes with multiple threads when preforming precommit compact for changelogs (#4907) lzljs3620320
• (paimon) branch master updated: [flink] Bump flink version to 1.20.1 (#5400) lzljs3620320
• (paimon) branch master updated: [doc] Sync rest-catalog-open-api and remove git-commit-id-plugin lzljs3620320
• (paimon) branch master updated: [core] Add bucket & level statistics in ManifestFileMeta (#5345) lzljs3620320
• (paimon) branch master updated: [rest] Remove useless CreateDatabaseResponse (#5318) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove CreateDatabaseResponse class lzljs3620320
• (paimon) branch master updated: [doc] Make rest api a separate page lzljs3620320
• (paimon) branch master updated: [rest] Fix content-security-policy violation issue on RestCatalog API (#5340) lzljs3620320
• (paimon) branch master updated (1266c36b42 -> 9ae1994f61) lzljs3620320
• (paimon) branch master updated (26c2bd4dac -> c84e501f3c) lzljs3620320
• (paimon) branch master updated: [hotfix] RestCatalog: fix alterDatabase/alterCatalog request mapping definition (#5397) lzljs3620320
• (paimon) branch master updated: [cdc] Fix float precision handling in TypeUtils (#5269) lzljs3620320
• (paimon) branch master updated: [core] RESTCatalog: fix NotImplementedException handle when create and alter table (#5274) lzljs3620320
• (paimon) branch master updated (a5dc3ef83b -> 1266c36b42) zouxxyy
• (paimon) branch master updated (fefbaf60c7 -> caa2730b4c) lzljs3620320
• (paimon) branch master updated: [spark] support to push down min/max aggregation (#5270) lzljs3620320
• (paimon) branch master updated: [core] RESTCatalog: update parse region from dlf endpoint (#5404) lzljs3620320
• (paimon) branch master updated: [rest] Add path and other options to Table Options (#5325) lzljs3620320
• (paimon) branch master updated: [core] RestCatalog: fix unit case annotation typo (#5398) lzljs3620320
• (paimon) branch master updated (87d4f528dc -> 626e338c55) junhao
• (paimon) branch master updated: [core] Fix typos in DeletionVector (#5403) lzljs3620320
• (paimon) branch master updated: [core] make rowType not nullable for KeyValue and AppendOnlyFileStore (#5394) lzljs3620320
• (paimon) branch master updated: [core] Postpone bucket writing job should not expire snapshots (#5391) lzljs3620320
• (paimon) branch master updated: [core] Fix listFilesIterative bug and avoid using Files.walk in SimpleTableTestBase (#5389) lzljs3620320
• (paimon) branch master updated (edcc83c342 -> 46ba041a78) lzljs3620320
• (paimon) branch master updated: [iceberg] Make Iceberg partition a required field, as specified in Iceberg spec (#5386) lzljs3620320
• (paimon) branch master updated: [core] Not throw exception for fallback reading (#5383) lzljs3620320
• (paimon) branch master updated: [fs] Correct azure FileIO services lzljs3620320
• (paimon) branch master updated: [fs] Add filesystem support for Microsoft Azure Storage (#5379) lzljs3620320
• (paimon) branch master updated: [core] fix rest api doc charset and tab's icon and title (#5380) lzljs3620320
• (paimon) branch master updated: [core] Optimize equals and hashCode implementation in Snapshot (#5375) lzljs3620320
• (paimon) branch master updated: [core] Do not throw exception of fall back branch is not exist (#5376) lzljs3620320
• (paimon) branch master updated (b9ff23d52b -> d99f481506) lzljs3620320
• (paimon) branch master updated: [spark] Correct the warning message when missing paimon extension (#5372) lzljs3620320
• (paimon) branch master updated: [filesystems] Listing OSS objects with metadata (#5046) lzljs3620320
• (paimon) branch master updated (ee08d83286 -> da304d5257) lzljs3620320
• (paimon) branch master updated: [core] RESTCatalog: update http code 500 response is ErrorResponse (#5359) lzljs3620320
• (paimon-python) branch dependabot/maven/hadoop-deps/org.apache.hadoop-hadoop-common-3.4.0 created (now c9ce9df) github-bot
• (paimon) branch master updated: [core] Incremental delta scan should be in stream mode, not mergeing (#5361) yuzelin
• (paimon) branch master updated: [doc] Add manage partition introduction page (#5357) lzljs3620320
• (paimon) branch master updated: [rest] Fix ambiguous mapping between listViewDetails and listViews method (#5369) lzljs3620320
• (paimon) branch master updated: [flink][action] rename some argument for avoiding ambiguity (#5368) lzljs3620320
• (paimon) branch master updated (183f9b8f66 -> fa411a095a) yuzelin
• (paimon) branch master updated: [doc] Add more examples of insert overwrite partition (#5366) lzljs3620320
• (paimon) branch master updated: [core] RestCatalog: add status in GetCatalogResponse (#5365) lzljs3620320
• (paimon) branch master updated: [rest] Fix content-security-policy violation on RestCatalog API yaml (#5355) lzljs3620320
• (paimon) branch master updated: [doc] Add spark dataframe read and write (#5363) lzljs3620320
• (paimon) branch master updated: [core] Reduce get partition requests in migrating hive table (#5364) lzljs3620320
• (paimon) branch master updated: [core] RestCatalog: add getCatalogById in rest yaml (#5362) lzljs3620320
• (paimon) branch master updated: [core] Add dry_run parameters to purge_files Procedure and display the list of deleted directories (#5342) lzljs3620320
• (paimon) branch master updated: [doc] Document Google Cloud Storage lzljs3620320
• (paimon) branch master updated: [fs] Add filesystem support for Google Cloud Storage (#5238) lzljs3620320
• (paimon) branch master updated: [doc] Update rest-catalog-open-api in doc lzljs3620320
• (paimon) branch master updated: [rest] Separate rest management api yaml (#5356) lzljs3620320
• (paimon) branch master updated: [core] Add totalBuckets to CommitMessage and DataSplit (#5343) lzljs3620320
• (paimon) branch master updated (add377cc00 -> b9d09ccebc) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove invalid declarations from the code (#5348) kerwin
• (paimon) branch master updated: [core] support alter view and alter view's dialect procedure (#5335) lzljs3620320
• (paimon) branch master updated: [core] Fix one record cannot fit into a single page in ParallelExecution (#5353) lzljs3620320
• (paimon-trino) branch main updated: Add dependency of guava into plugin junhao
• (paimon) branch master updated: [core] RESTCatalog: Optimize ErrorResponse to support more ResourceType (#5347) lzljs3620320
• (paimon) branch bucket-stats deleted (was 4772101a86) czweng
• (paimon) branch bucket-stats created (now 4772101a86) czweng
  • (paimon) 01/01: [fix] Fix comments czweng
• (paimon) branch master updated: [rest] Introduce `redocPage` variable to support customizable parameters on pages using `Redoc` (#5346) lzljs3620320
• (paimon) branch master updated: [test] Static import of assertion classes (#5338) lzljs3620320
• (paimon) branch master updated: [core] Support watermark partition markdone mode (#5284) lzljs3620320
• (paimon) branch master updated (a5aeaa267d -> 3831ca5263) lzljs3620320
• (paimon) branch master updated: [test] Enhance inheritance and visibility for ITCase support (#5341) lzljs3620320
• (paimon-website) branch dependabot/npm_and_yarn/prismjs-1.30.0 deleted (was 6063ed92ab) github-bot
• (paimon) branch master updated: [core] Incremental query should return empty result for some corner cases (#5339) lzljs3620320
• (paimon) branch master updated: [doc] Add license to rest-api.md lzljs3620320
• (paimon) branch master updated: [rest] Introduce `Redoc` to visualize Rest API (#5336) lzljs3620320
• (paimon) branch master updated: [doc][rest] Minor fix for mark done partition lzljs3620320
• (paimon) branch master updated: [core] RESTCatalog: add table test and fix branch (#5313) lzljs3620320
• (paimon) branch master updated: [test] Rename to RESTSimpleTableTest and RESTCatalogTest lzljs3620320
• (paimon) branch master updated: [core] Remove incorrect comment in CoreOptions.PATH lzljs3620320
• (paimon) branch master updated: [test] Fixed incorrect use of FileIO in CloneActionITCase (#5332) lzljs3620320
• (paimon) branch master updated: [test] Rename to SimpleTableTestBase and refactor overwrite tests (#5334) lzljs3620320
• (paimon) branch master updated: [test] refactor test in RESTCatalogTestBase#testListPartitionsWhenMetastorePartitionedIsTrue (#5333) lzljs3620320
• (paimon) branch master updated: [spark] Add checker for PaimonSparkSessionExtensions (#5327) lzljs3620320
• (paimon) branch master updated: [spark] Deduplicate partitions for markDone (#5328) lzljs3620320
• (paimon) branch master updated: [core] Add supportsVersionManagement to Catalog (#5326) lzljs3620320
• (paimon) branch master updated: [rest] Add audit options to view options lzljs3620320
• (paimon) branch master updated: [core] Support diff scan mode in incremental query (#5321) lzljs3620320
• (paimon) branch master updated: [doc] fix typo link in compaction doc (#5323) lzljs3620320
• (paimon) branch master updated: [core][flink] introduce changelog expire procedure and action (#5319) lzljs3620320
• (paimon) branch master updated (87d3ee48b1 -> bbf91ad7f5) lzljs3620320
• (paimon-python) branch main updated: #40 Provide Optional Built-in Hadoop Dependencies (#41) yuzelin
• (paimon) branch master updated: [flink] Fix mixed FileIO in CloneAction (#5320) lzljs3620320
• (paimon-python) branch main updated: #46 Improve Readability of TableRead Impletation (#47) yuzelin
• (paimon-python) branch main updated: #42 Simplify Import Paths by Exposing Core Classes at Package Root (#43) yuzelin
• (paimon-python) branch main updated: #44 Make Split and Predicate Serializable (#45) yuzelin
• (paimon) branch master updated: [core] RestCatalog: add catalog api into rest open api yaml (#5317) lzljs3620320
• (paimon) branch master updated: [cdc] Provide the document for computed columns with kafka_sync_database (#5314) lzljs3620320
• (paimon) branch master updated: [core] Optimize Flink Orphan Files to do more works in distributed (#5257) lzljs3620320
• (paimon) branch master updated (18bd8a4fb6 -> 176a4aa47b) lzljs3620320

• Earlier messages
• Later messages