commits  

Messages by Thread

• (paimon) branch master updated: [python] light refactor datasource modules to decouple optional dependencies (#7086) lzljs3620320
• (paimon-website) branch asf-site updated (680fe366 -> 21bf4712) github-bot
• (paimon) branch master updated (54e3332e2a -> 0525bc0ec7) lzljs3620320
• (paimon) branch master updated: [python] add error handling to abort pending commits and serialization support for ray sink (#7022) lzljs3620320
• (paimon) branch master updated: [core] Refactor getParquetReader with options (#7080) lzljs3620320
• (paimon) branch master updated: [arrow] Support arrow variant/shredding writer. (#7082) lzljs3620320
• (paimon-website) branch asf-site updated (f60fff59 -> 680fe366) github-bot
• (paimon) branch master updated: [core] Introduce withBlobConsumer in TableWrite (#7074) lzljs3620320
• (paimon) branch master updated (7af4d42c26 -> 68d4838a02) lzljs3620320
• (paimon) branch master updated (84a552b5eb -> 7af4d42c26) lzljs3620320
• (paimon) branch master updated: [core] Support re-overwrite by spark for chain table (#7038) lzljs3620320
• (paimon) branch master updated: [hotfix] Correct AVRO TIMESTAMP_LOCAL_ZONE mapping lzljs3620320
• (paimon-website) branch asf-site updated (5f019787 -> f60fff59) github-bot
• (paimon) branch master updated: [core] Rollback 'COMPACT' commit for row-level operations (#6968) lzljs3620320
• (paimon-website) branch asf-site updated (d1cb6583 -> 5f019787) github-bot
• (paimon) branch master updated: [core] Validate merge function creation in SchemaValidation lzljs3620320
• (paimon) branch master updated: [core] Fix the issue where aggregate function columns without defining sequenceGroup cause the table to be unavailable (#7046) lzljs3620320
• (paimon) branch master updated: [python] support rest token refresh (#7007) lzljs3620320
• (paimon) branch master updated: [core] Rename to forceKeepDelete in MergeTreeCompactManager lzljs3620320
• (paimon) branch master updated: [core] keep delete record for chain table when perform compact (#7057) lzljs3620320
• (paimon) branch master updated: [test] Remove print test name in spark test (#7071) lzljs3620320
• (paimon) branch master updated: [ci] Add no-transfer-progress maven option to reduce verbose download log (#7070) lzljs3620320
• (paimon) branch master updated (6dde7851da -> 80e812bc10) lzljs3620320
• (paimon) branch master updated: [test] Move auth test cases to RESTCatalogTest (#7069) lzljs3620320
• (paimon) branch master updated: [spark] Fix wrong argument in procedure (#7067) lzljs3620320
• (paimon-website) branch asf-site updated (f45275cc -> d1cb6583) github-bot
• (paimon) branch master updated: [spark] Correct the assignment of null to currentResult in PaimonRecordReaderIterator#close (#7066) lzljs3620320
• (paimon) branch master updated (1123560e3a -> f56894d9d9) lzljs3620320
• (paimon) branch master updated (c554d9dc4e -> 1123560e3a) lzljs3620320
• (paimon) branch master updated: [core] Refactor limit pushdown in KeyValueFileStoreScan lzljs3620320
• (paimon) branch master updated: [Core] support limit pushdown with pk table (#6914) lzljs3620320
• (paimon) branch master updated: [spark] Exclude dependence in paimon-spark-ut (#7065) lzljs3620320
• (paimon) branch master updated: [core] Refactor MergeFunctionFactory to use read rowType (#7059) lzljs3620320
• (paimon-website) branch master updated: feat: download github avatars (#28) lzljs3620320
• (paimon) branch master updated: [spark] use repartition instead of repartitionByRange to reduce the cost (#7061) lzljs3620320
• (paimon) branch master updated: [doc] Improve `BY NAME` statement doc (#7062) lzljs3620320
• (paimon-website) branch asf-site updated (49925e28 -> f45275cc) github-bot
• (paimon) branch master updated: [python] refactor file_io to support polymorphism (#7040) lzljs3620320
• (paimon) branch master updated: [spark] optimize data-evolution performance (#7054) lzljs3620320
• (paimon) branch master updated: [python] support read.batch-size and fix default value (#7051) lzljs3620320
• (paimon) branch master updated (5e1129ab7c -> ae3936385f) lzljs3620320
• (paimon-website) branch asf-site updated (ffc855dc -> 49925e28) github-bot
• (paimon) branch master updated: [python] Refactor SplitBase to Split lzljs3620320
• (paimon) branch master updated: [core] PartitionStatistics support totalBuckets (#6964) lzljs3620320
• (paimon) branch master updated: [hotfix] publich snapshot ignore faiss lib (#7039) lzljs3620320
• (paimon) branch master updated: [python] refactor FullStartingScanner to append and pk split generator (#7042) lzljs3620320
• (paimon) branch master updated: [core] Refactor row filter and column masking to AbstractDataTableRead lzljs3620320
• (paimon) branch master updated: [spark] Remove unused import from spark module (#7044) lzljs3620320
• (paimon) branch master updated: [core] Add row filter & column masking support for table read (#7034) lzljs3620320
• (paimon) branch master updated: [variant] Copy the added row in InferVariantShreddingWriter (#7041) lzljs3620320
• (paimon) branch master updated (1a0e9e4230 -> 049e1e65ae) lzljs3620320
• (paimon) branch master updated (27e479dd54 -> 1a0e9e4230) lzljs3620320
• (paimon) branch master updated (4ccd244519 -> 27e479dd54) lzljs3620320
• (paimon-website) branch asf-site updated (740f9a80 -> ffc855dc) github-bot
• (paimon) branch master updated: [rest] add column masking rules in authTableQuery response (#7024) lzljs3620320
• (paimon) branch master updated (1d23d67718 -> 06d791c8f1) lzljs3620320
• (paimon) branch master updated (395c70648a -> 1d23d67718) lzljs3620320
• (paimon) branch master updated (c7877ecb18 -> 395c70648a) lzljs3620320
• (paimon) branch master updated: [variant] Introduce InferVariantShreddingSchema (#7017) lzljs3620320
• (paimon) branch master updated: [core] Unify TransformPredicate and LeafPredicate to one class (#7015) lzljs3620320
• (paimon) branch master updated: [core] Enable global index external path (#6994) lzljs3620320
• (paimon) branch master updated: [hotfix] fix faiss public snapshot as mac os jdk not exit in temurin jerryjing
  • (paimon) branch master updated: [hotfix] fix faiss public snapshot as mac os jdk not exit in temurin jerryjing
• (paimon-website) branch asf-site updated (8132c357 -> 740f9a80) github-bot
• (paimon) branch master updated: [core] Fix the ArrayIndexOutOfBoundsException when use data evolution with avro (#7013) lzljs3620320
• (paimon) branch master updated: [python] fix rest file io and blob-as-descriptor file io token merge issue and add rest catalog blob-as-descriptor sample (#7009) lzljs3620320
• (paimon) branch master updated: [flink] Add descriptive operator names and enable parallel file listing in orphan files cleanup (#6958) lzljs3620320
• (paimon) branch master updated: [flink] Optimize lookup table refresh with full load for snapshot backlog. (#6966) lzljs3620320
• (paimon) branch master updated (6aeee5fa37 -> d5275c534e) lzljs3620320
• (paimon) branch master updated (5e246dd8a6 -> 6aeee5fa37) lzljs3620320
• (paimon) branch master updated (7d9d301857 -> 5e246dd8a6) lzljs3620320
• (paimon) branch master updated: [python] fix cramjam version define and introduce dependency check in CI (#7005) lzljs3620320
• (paimon) branch master updated: [core] Introduce truncatedString for representations of large collections (#7000) lzljs3620320
• (paimon) branch master updated (339aff648a -> 38b0838098) lzljs3620320
• (paimon) branch master updated: [hive] Use the FileIO obtained from the path in HiveCatalog (#6992) lzljs3620320
• (paimon) branch master updated: [deploy] Fix the publish of snapshot jdk17 (#7002) zouxxyy
• (paimon) branch master updated (b3b59fa3cc -> 80358f061d) yuzelin
• (paimon) branch master updated: [hotfix] fix faiss public snapshot as mac os jdk not exit in temurin (#7004) lzljs3620320
• (paimon-website) branch asf-site updated (9e1a2d3d -> 8132c357) github-bot
• (paimon-website) branch asf-site updated (5e2fa3f1 -> 9e1a2d3d) github-bot
• (paimon) branch master updated: [python] Fix default file compression and support file compression when writing avro file (#6996) lzljs3620320
• (paimon-website) branch asf-site updated (c0981d71 -> 5e2fa3f1) github-bot
• (paimon) branch master updated: [python] Support read paimon table as pytorch dataset (#6987) lzljs3620320
• (paimon) branch master updated: [core] Remove useless bucketMode in TableWriteImpl lzljs3620320
• (paimon) branch master updated: [blob] Extract BlobFileMeta from BlobFormatReader lzljs3620320
• (paimon) branch master updated: [format] read blobs as bytes when blob-as-descriptor is false (#6989) lzljs3620320
• (paimon) branch master updated: [python] Fix zstd manifest decompression error on Python 3.6 (#6982) lzljs3620320
• (paimon) branch master updated: [core] Fix convert null row to column row vector (#6990) lzljs3620320
• (paimon) branch master updated: [core] add data-evolution info to Files System Table. (#6986) lzljs3620320
• (paimon-website) branch asf-site updated (6d287528 -> c0981d71) github-bot
• (paimon) branch master updated: [python] Remove all redundant changes in pr 6969 (#6977) lzljs3620320
• (paimon) branch master updated (a107ac4964 -> caedc9f993) lzljs3620320
• (paimon) branch master updated: [core] Vector search add offset back (#6984) lzljs3620320
• (paimon) branch master updated: [core] add more tests for clustering bucketed append table (#6981) lzljs3620320
• (paimon) branch master updated: [test] Fix unstable case in PaimonFormatTableTest (#6979) lzljs3620320
• (paimon) branch master updated: [core] Support incremental clustering for append bucketed table (#6961) lzljs3620320
• (paimon) branch master updated: [flink] Fixed an issue with field type matching errors during lookup. (#6972) (#6974) lzljs3620320
• (paimon) branch master updated: [core] Fix field ID mismatch in AllTablesTable, AllPartitionsTable and AllTableOptionsTable (#6973) lzljs3620320
• (paimon) branch revert-6969-commitTest created (now 6e35a4eee0) junhao
  • (paimon) 01/01: Revert "[python] Fix tryCommit failed. (#6969)" junhao
• (paimon) branch master updated: [python] Fix tryCommit failed. (#6969) junhao
• (paimon) branch master updated: [clone] support meta only in clone action (#6967) lzljs3620320
• (paimon) branch master updated: [python] Add ForbiddenException handling in REST catalog (#6970) lzljs3620320
• (paimon-website) branch asf-site updated (a3b93748 -> 6d287528) github-bot
• (paimon) branch master updated: [core] Introduce RetryWaiter to simplify FileStoreCommitImpl lzljs3620320
• (paimon) branch master updated: [test] Reduce the number of tests triggered by each CI lzljs3620320
• (paimon-python) branch main updated: Update README to indicate repository is abandoned lzljs3620320
• (paimon) branch master updated: [test] Fix Spark 4.0 CreateGlobalVectorIndexProcedureTest lzljs3620320
• (paimon) branch master updated (5b9999a050 -> 8c4d8795e6) lzljs3620320
• (paimon) branch master updated: [spark] Make RowIdIndexFieldsExtractor Serializable lzljs3620320
• (paimon) branch master updated (22bc3abc86 -> 1072934f54) lzljs3620320
• (paimon) branch master updated: [spark] support building BTree index through procedure (#6956) lzljs3620320
• (paimon) branch master updated: [doc] update paimon-iceberg dependency link (#6963) lzljs3620320
• (paimon) branch master updated: [pypaimon] Add filestorecommit may skip middle snapshots while committing (#6960) lzljs3620320
• (paimon-website) branch asf-site updated (6f202693 -> a3b93748) github-bot
• (paimon) branch master updated (708ea8fc75 -> 20b4a3b6f3) lzljs3620320
• (paimon) branch master updated: [spark] Spark support vector search (#6950) lzljs3620320
• (paimon) branch master updated: [doc] update Apache Doris document with DLF 3.0 (#6954) lzljs3620320
• (paimon-website) branch asf-site updated (b90ecc16 -> 6f202693) github-bot
• (paimon) branch master updated: [variant] Fix reading empty shredded variant via variantAccess (#6953) lzljs3620320
• (paimon) branch master updated: [python] support alterTable (#6952) lzljs3620320
• (paimon) branch master updated: [python] support ray data sink to paimon (#6883) lzljs3620320
• (paimon) branch master updated: [python] Rename to TableScan.withSlice to specific start_pos and end_pos lzljs3620320
• (paimon-website) branch asf-site updated (9a40c4a5 -> b90ecc16) github-bot
• (paimon) branch master updated: [python] sync to_ray method args with ray data api (#6948) lzljs3620320
• (paimon) branch master updated: [python] light refactor for stats collect (#6941) lzljs3620320
• (paimon) branch master updated (d538997b6f -> 7e21bdab22) lzljs3620320
• (paimon) branch master updated: [rest] Add tagNamePrefix definition for listTagsPaged (#6947) lzljs3620320
• (paimon) branch master updated (7bfa946c82 -> 9ed304b08b) lzljs3620320
• (paimon) branch master updated: [spark] Fix EqualNullSafe is not correct when column has null value. (#6943) lzljs3620320
• (paimon-website) branch asf-site updated (81185c68 -> 9a40c4a5) github-bot
• (paimon) branch master updated: [python] fix value_stats containing system fields for primary key tables (#6945) lzljs3620320
• (paimon-website) branch asf-site updated (f03c463d -> 81185c68) github-bot
• (paimon) branch master updated: [test][rest] add test case for two sessions with cache for rest commitTable (#6438) lzljs3620320
• (paimon-website) branch asf-site updated (6d11d23d -> f03c463d) github-bot
• (paimon) branch master updated: [python] do not retry for connect exception in rest (#6942) lzljs3620320
• (paimon-website) branch asf-site updated (45dc1eee -> 6d11d23d) github-bot
• (paimon) branch master updated: [spark] Fix read shredded and unshredded variant both (#6936) lzljs3620320
• (paimon) branch master updated: [python] Let Python write file without value stats by default (#6940) lzljs3620320
• (paimon) branch master updated: [python] ray version compatible (#6937) lzljs3620320
• (paimon) branch master updated (633199de53 -> e1cbeedcc1) czweng
• (paimon) branch master updated: [test] Fix unstable case in CompactActionITCase lzljs3620320
• (paimon-website) branch asf-site updated (d4a661ff -> 45dc1eee) github-bot
• (paimon) branch master updated (3503b6f2a9 -> 3136296796) lzljs3620320
  • (paimon) 02/02: [core] Add compactIndexFiles to ManifestEntryChanges.changedPartitions lzljs3620320
  • (paimon) 01/02: [core] Extract StrictModeChecker from ConflictDetection in Commit lzljs3620320
• (paimon) branch master updated: [spark] Introduce drop global index procedure (#6930) lzljs3620320
• (paimon) branch master updated: [core] Extract RowTrackingCommitUtils from FileStoreCommitImpl lzljs3620320
• (paimon) branch master updated: [core] Add min/max row id for manifest table (#6929) lzljs3620320
• (paimon) branch master updated: [core] Introduce a lazy reader for BTreeIndexReader to filter out files by predicate (#6927) lzljs3620320
• (paimon) branch master updated: [python] optimize file io retry for OSS and S3 (#6919) lzljs3620320
• (paimon-website) branch asf-site updated (6b47bfcf7 -> d4a661ffe) github-bot
• (paimon) branch master updated: [flink] Remove useless classloader in FlinkCatalog lzljs3620320
• (paimon) branch master updated: [flink][spark] Introduce Built-in functions for flink and spark (#6891) lzljs3620320
• (paimon) branch master updated: [python] Implement optimized path for split generation with raw_convertible (#6918) lzljs3620320
• (paimon) branch master updated: [core] RowId field by default is not null lzljs3620320
• (paimon) branch master updated: [spark] Merge into clause should not write 'null' row id to file (#6925) lzljs3620320
• (paimon) branch master updated (6876bb94c8 -> b2c7a876c9) lzljs3620320
• (paimon) branch master updated: [python] Update PyPaimon Snapshot fields to not null (#6926) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'nested_partial_update' agg func (#6924) yuzelin
• (paimon) branch master updated (d7959fbb2e -> 3082e5d512) lzljs3620320
• (paimon) branch master updated (bce56bf270 -> d7959fbb2e) lzljs3620320
• (paimon-website) branch asf-site updated (703ea33d3 -> 6b47bfcf7) github-bot
• (paimon) branch master updated: [test] Fix unstable test: handle MiniCluster shutdown gracefully in collect method (#6913) lzljs3620320
• (paimon) branch master updated: [python] fix ray dataset not lazy loading issue when parallelism = 1 (#6916) lzljs3620320
• (paimon) branch master updated: [core] Refactor ExternalPathProviders abstraction lzljs3620320
• (paimon) branch master updated: [spark] fix Merge Into unstable tests (#6912) lzljs3620320
• (paimon) branch master updated: [core] Enable Entropy Inject for data file path to prevent being throttled by object storage (#6832) lzljs3620320
• (paimon) branch master updated: [iceberg] support millisecond timestamps in iceberg compatibility mode (#6352) lzljs3620320
• (paimon) branch master updated: [spark] Handle NPE for pushdown aggregate when a datasplit has a null max/min value (#6611) lzljs3620320
• (paimon-website) branch asf-site updated (0cd7c83d1 -> 703ea33d3) github-bot
• (paimon) branch master updated: [test] Fix unstable case testLimitPushDown lzljs3620320
• (paimon) branch master updated: [core] Refactor row id pushdown to DataEvolutionFileStoreScan lzljs3620320
• (paimon) branch master updated: [spark] paimon-spark supports row id push down (#6697) lzljs3620320
• (paimon) branch master updated: [spark] Support compact_database procedure (#6328) (#6910) lzljs3620320
• (paimon) branch master updated: [lucene] Fix row count in IndexManifestEntry lzljs3620320
• (paimon) branch master updated: [test] Remove unstable test: AppendTableITCase.testFlinkMemoryPool lzljs3620320
• (paimon) branch master updated: [core] Refactor Global index writer and reader for Btree lzljs3620320
• (paimon) branch master updated: [core] Minor refactor to magic number into footer lzljs3620320
• (paimon) branch master updated: [core] Support btree global index in paimon-common (#6869) lzljs3620320
• (paimon) branch master updated: [spark] Optimize compact for data-evolution table, commit multiple times to avoid out of memory (#6907) lzljs3620320
• (paimon) branch master updated: [rest] Add fromSnapshot to rollback (#6905) lzljs3620320
• (paimon) branch master updated (0a4603aae2 -> 3daff8f740) lzljs3620320
• (paimon) branch master updated (5ce14f670a -> 0a4603aae2) lzljs3620320
• (paimon-trino) branch main updated: Fix timestamp with local time zone (#117) junhao
• (paimon) branch master updated: [core] fix image desc in the chain table doc (#6903) lzljs3620320
• (paimon) branch master updated: [refactor] Make subclass of FallbackSplit public (#6901) lzljs3620320
• (paimon) branch master updated: [test] Disable unstable test: BitSliceIndexRoaringBitmapTest.testCompareUsingMinMax lzljs3620320
• (paimon-website) branch asf-site updated (7adfe22c2 -> 6fcdd14eb) github-bot
• (paimon) branch master updated: [core] fix in predict when value is empty (#6900) lzljs3620320
• (paimon) branch master updated (06cfebcb7c -> ebad722b1f) lzljs3620320
• (paimon) branch master updated: [Core] Correct identifer information in catalog enviroment when using switch branch (#6898) lzljs3620320
• (paimon) branch master updated: [core] Remove useless close in SstFileWriter lzljs3620320
• (paimon) branch master updated: [core] Refactor footer of lookup sst file to SortLookupStoreFooter lzljs3620320
• (paimon) branch master updated: [doc] Add options supported by the python API lzljs3620320
• (paimon) branch master updated (64481a16b2 -> 82cac0e3a9) lzljs3620320
• (paimon) branch master updated (a420f9f740 -> 64481a16b2) lzljs3620320
• (paimon) branch master updated (a3a336e723 -> a420f9f740) lzljs3620320
• (paimon) branch master updated (ee33ba93e1 -> a3a336e723) lzljs3620320
• (paimon) branch master updated (b1e074b8e6 -> ee33ba93e1) lzljs3620320

• Earlier messages
• Later messages