[GitHub] [hudi] hudi-bot commented on pull request #7868: [HUDI-1593] Add support for "show restores" and "show restore" commands in hudi-cli

2023-02-15 Thread via GitHub
hudi-bot commented on PR #7868: URL: https://github.com/apache/hudi/pull/7868#issuecomment-1432648625 ## CI report: * 943c91a266397e07f0aa10289ed78ef277ce42f9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7860: [HUDI-5673] Support multi writer for bucket index with guarded lock

2023-02-15 Thread via GitHub
hudi-bot commented on PR #7860: URL: https://github.com/apache/hudi/pull/7860#issuecomment-1432648562 ## CI report: * 59c8e8aa9c62dca8876efd045b014fdb395240f8 Azure:

[jira] [Closed] (HUDI-5750) 0.13.0 release note part 8

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5750. --- Resolution: Fixed > 0.13.0 release note part 8 > -- > > Key:

[jira] [Closed] (HUDI-4887) Use Avro as the persisted cdc data format instead of Json

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4887. --- Resolution: Fixed > Use Avro as the persisted cdc data format instead of Json >

[jira] [Updated] (HUDI-4887) Use Avro as the persisted cdc data format instead of Json

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4887: Fix Version/s: 0.13.0 > Use Avro as the persisted cdc data format instead of Json >

[jira] [Updated] (HUDI-4904) Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4904: Fix Version/s: 0.13.0 > Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider >

[jira] [Updated] (HUDI-3478) RFC-51: Change Data Capture for Hudi

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3478: Fix Version/s: 0.13.0 (was: 0.14.0) > RFC-51: Change Data Capture for Hudi >

[jira] [Closed] (HUDI-4904) Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4904. --- Resolution: Fixed > Handle Recursive Proto Schemas in ProtoClassBasedSchemaProvider >

[jira] [Closed] (HUDI-3478) RFC-51: Change Data Capture for Hudi

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3478. --- Resolution: Fixed > RFC-51: Change Data Capture for Hudi > > >

[jira] [Updated] (HUDI-4962) Move cloud dependencies to cloud modules

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4962: Fix Version/s: 0.13.0 (was: 0.13.1) > Move cloud dependencies to cloud modules >

[jira] [Closed] (HUDI-4962) Move cloud dependencies to cloud modules

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4962. --- Resolution: Fixed > Move cloud dependencies to cloud modules > > >

[jira] [Closed] (HUDI-4905) Protobuf type handling improvements

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4905. --- Resolution: Fixed > Protobuf type handling improvements > --- > >

[jira] [Updated] (HUDI-4905) Protobuf type handling improvements

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4905: Fix Version/s: 0.13.0 > Protobuf type handling improvements > --- > >

[jira] [Updated] (HUDI-3900) Support log compacted blocks

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3900: Fix Version/s: 0.13.0 (was: 0.13.1) > Support log compacted blocks >

[jira] [Closed] (HUDI-3900) Support log compacted blocks

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3900. --- Resolution: Fixed > Support log compacted blocks > > > Key:

[jira] [Updated] (HUDI-5070) Fix Flaky TestCleaner test : testInsertAndCleanByCommits

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5070: Fix Version/s: 0.13.0 (was: 0.12.2) > Fix Flaky TestCleaner test :

[jira] [Updated] (HUDI-5070) Fix Flaky TestCleaner test : testInsertAndCleanByCommits

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5070: Fix Version/s: 0.12.0 (was: 0.13.0) > Fix Flaky TestCleaner test :

[jira] [Updated] (HUDI-5070) Fix Flaky TestCleaner test : testInsertAndCleanByCommits

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5070: Fix Version/s: 0.13.0 > Fix Flaky TestCleaner test : testInsertAndCleanByCommits >

[jira] [Updated] (HUDI-5070) Fix Flaky TestCleaner test : testInsertAndCleanByCommits

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5070: Fix Version/s: 0.12.2 (was: 0.12.0) > Fix Flaky TestCleaner test :

[jira] [Updated] (HUDI-4898) for mor table, presto/hive shoud respect payload class during merge parquet file and log file

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4898: Fix Version/s: 0.13.0 (was: 0.12.2) > for mor table, presto/hive shoud respect

[jira] [Updated] (HUDI-5057) Fix msck repair hudi table

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5057: Fix Version/s: 0.13.0 (was: 0.12.2) > Fix msck repair hudi table >

[jira] [Updated] (HUDI-4071) Better Spark Datasource default configs

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4071: Fix Version/s: 0.13.0 > Better Spark Datasource default configs > --- >

[jira] [Closed] (HUDI-5154) Improve hudi-spark-client Lambada writing

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5154. --- Resolution: Fixed > Improve hudi-spark-client Lambada writing > - > >

[jira] [Updated] (HUDI-5184) Remove export PYSPARK_SUBMIT_ARGS="--master local[*]" from HoodiePySparkQuickstart.py

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5184: Fix Version/s: 0.13.0 (was: 0.12.2) > Remove export PYSPARK_SUBMIT_ARGS="--master

[jira] [Updated] (HUDI-5154) Improve hudi-spark-client Lambada writing

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5154: Fix Version/s: 0.13.0 > Improve hudi-spark-client Lambada writing >

[jira] [Updated] (HUDI-5200) Resources are not cleaned up in UT

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5200: Fix Version/s: 0.13.0 (was: 0.13.1) > Resources are not cleaned up in UT >

[jira] [Updated] (HUDI-5201) add totalRecordsDeleted metric

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5201: Fix Version/s: 0.13.0 > add totalRecordsDeleted metric > -- > >

[jira] [Closed] (HUDI-5200) Resources are not cleaned up in UT

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5200. --- Resolution: Fixed > Resources are not cleaned up in UT > -- > >

[jira] [Updated] (HUDI-5286) UnsupportedOperationException throws when enabling filesystem retry

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5286: Fix Version/s: 0.13.0 (was: 0.12.2) > UnsupportedOperationException throws when

[jira] [Closed] (HUDI-5278) support more conf to cluster procedure

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5278. --- Resolution: Fixed > support more conf to cluster procedure > -- > >

[jira] [Updated] (HUDI-5278) support more conf to cluster procedure

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5278: Fix Version/s: 0.13.0 > support more conf to cluster procedure > -- > >

[jira] [Closed] (HUDI-5279) move logic for deleting active instant to HoodieActiveTimeline

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5279. --- Resolution: Fixed > move logic for deleting active instant to HoodieActiveTimeline >

[jira] [Updated] (HUDI-5279) move logic for deleting active instant to HoodieActiveTimeline

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5279: Fix Version/s: 0.13.0 > move logic for deleting active instant to HoodieActiveTimeline >

[jira] [Closed] (HUDI-5302) Can't insert into table with bucket index type if record key value contains ","

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5302. --- Resolution: Fixed > Can't insert into table with bucket index type if record key value contains > "," >

[jira] [Closed] (HUDI-5179) Optimized release guide document

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5179. --- Resolution: Fixed > Optimized release guide document > > >

[jira] [Updated] (HUDI-5302) Can't insert into table with bucket index type if record key value contains ","

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5302: Fix Version/s: 0.13.0 > Can't insert into table with bucket index type if record key value contains > ","

[jira] [Updated] (HUDI-5179) Optimized release guide document

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5179: Fix Version/s: 0.13.0 (was: 0.13.1) > Optimized release guide document >

[jira] [Closed] (HUDI-5314) add call help procedure

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5314. --- Resolution: Fixed > add call help procedure > --- > > Key: HUDI-5314 >

[jira] [Closed] (HUDI-5331) Add schema settings with stream api

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5331. --- Resolution: Fixed > Add schema settings with stream api > --- > >

[jira] [Updated] (HUDI-5334) Get checkpoint from non-completed instant

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5334: Fix Version/s: 0.13.0 (was: 0.13.1) > Get checkpoint from non-completed instant >

[jira] [Closed] (HUDI-5334) Get checkpoint from non-completed instant

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5334. --- Resolution: Fixed > Get checkpoint from non-completed instant > - > >

[jira] [Updated] (HUDI-5314) add call help procedure

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5314: Fix Version/s: 0.13.0 > add call help procedure > --- > > Key:

[jira] [Updated] (HUDI-5331) Add schema settings with stream api

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5331: Fix Version/s: 0.13.0 > Add schema settings with stream api > --- > >

[jira] [Updated] (HUDI-5356) Call close on SparkRDDWriteClient several places

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5356: Fix Version/s: 0.13.0 > Call close on SparkRDDWriteClient several places >

[jira] [Updated] (HUDI-4881) Push down filters if possible when syncing partitions to Hive

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4881: Fix Version/s: 0.13.0 (was: 0.13.1) > Push down filters if possible when syncing

[jira] [Updated] (HUDI-5340) Spark SQL supports Table-Valued Function to extend more query syntax

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5340: Fix Version/s: 0.13.0 (was: 0.13.1) > Spark SQL supports Table-Valued Function to

[jira] [Closed] (HUDI-4881) Push down filters if possible when syncing partitions to Hive

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4881. --- Resolution: Fixed > Push down filters if possible when syncing partitions to Hive >

[jira] [Closed] (HUDI-5340) Spark SQL supports Table-Valued Function to extend more query syntax

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5340. --- Resolution: Fixed > Spark SQL supports Table-Valued Function to extend more query syntax >

[jira] [Updated] (HUDI-5347) Fix Merge Into performance traps

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5347: Fix Version/s: (was: 0.13.0) > Fix Merge Into performance traps > > >

[jira] [Updated] (HUDI-5347) Fix Merge Into performance traps

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5347: Fix Version/s: 0.13.0 > Fix Merge Into performance traps > > >

[jira] [Updated] (HUDI-4917) Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4917: Fix Version/s: 0.13.0 (was: 0.13.1) > Optimized the way to get HoodieBaseFile of

[jira] [Closed] (HUDI-4917) Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4917. --- Resolution: Fixed > Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom > Index >

[jira] [Updated] (HUDI-5351) Handle meta fields being disabled in Bulk Insert Partitioners

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5351: Fix Version/s: 0.13.0 (was: 0.12.2) > Handle meta fields being disabled in Bulk

[jira] [Updated] (HUDI-4113) Cannot parse schema when use spark delete sql

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4113: Fix Version/s: 0.13.0 > Cannot parse schema when use spark delete sql >

[jira] [Closed] (HUDI-4113) Cannot parse schema when use spark delete sql

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4113. --- Resolution: Fixed > Cannot parse schema when use spark delete sql >

[jira] [Closed] (HUDI-4432) Checkpoint management for muti-writer scenario

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4432. --- Resolution: Fixed > Checkpoint management for muti-writer scenario >

[jira] [Closed] (HUDI-5377) Write call stack information to lock file

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5377. --- Resolution: Fixed > Write call stack information to lock file > - > >

[jira] [Updated] (HUDI-5414) No need to guard the table initialization by lock for HoodieFlinkWriteClient

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5414: Fix Version/s: 0.13.0 (was: 0.13.1) > No need to guard the table initialization by

[jira] [Updated] (HUDI-5377) Write call stack information to lock file

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5377: Fix Version/s: 0.13.0 > Write call stack information to lock file >

[jira] [Updated] (HUDI-4432) Checkpoint management for muti-writer scenario

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4432: Fix Version/s: 0.13.0 (was: 0.13.1) > Checkpoint management for muti-writer scenario

[jira] [Closed] (HUDI-5414) No need to guard the table initialization by lock for HoodieFlinkWriteClient

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5414. --- Resolution: Fixed > No need to guard the table initialization by lock for HoodieFlinkWriteClient >

[jira] [Closed] (HUDI-5400) Fix read errors when implicit schema changes is performed when schema-evolution is disabled

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5400. --- Resolution: Fixed > Fix read errors when implicit schema changes is performed when > schema-evolution is

[jira] [Closed] (HUDI-5378) Remove minlog.Log

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5378. --- Resolution: Fixed > Remove minlog.Log > - > > Key: HUDI-5378 >

[jira] [Updated] (HUDI-5400) Fix read errors when implicit schema changes is performed when schema-evolution is disabled

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5400: Fix Version/s: 0.13.0 (was: 0.13.1) > Fix read errors when implicit schema changes

[jira] [Updated] (HUDI-5378) Remove minlog.Log

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5378: Fix Version/s: 0.13.0 > Remove minlog.Log > - > > Key: HUDI-5378 >

[GitHub] [hudi] vinothchandar commented on pull request #7889: [HUDI-5727] Close stable PRs

2023-02-15 Thread via GitHub
vinothchandar commented on PR #7889: URL: https://github.com/apache/hudi/pull/7889#issuecomment-1432623597 thanks for this @jackwener . We are trying to spend some efforts combing through the entire backlog now. Once its in some manageable state in a few weeks, we can consider this and may

[jira] [Closed] (HUDI-5343) HoodieFlinkStreamer supports async clustering for append mode

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5343. --- Resolution: Fixed > HoodieFlinkStreamer supports async clustering for append mode >

[jira] [Closed] (HUDI-5332) HiveSyncTool can avoid initializing all permanent custom functions of Hive

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5332. --- Resolution: Fixed > HiveSyncTool can avoid initializing all permanent custom functions of Hive >

[jira] [Updated] (HUDI-5343) HoodieFlinkStreamer supports async clustering for append mode

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5343: Fix Version/s: 0.13.0 (was: 0.13.1) > HoodieFlinkStreamer supports async clustering

[jira] [Updated] (HUDI-3572) support DAY_ROLLING strategy in ClusteringPlanPartitionFilterMode

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3572: Fix Version/s: 0.13.0 > support DAY_ROLLING strategy in ClusteringPlanPartitionFilterMode >

[jira] [Updated] (HUDI-5332) HiveSyncTool can avoid initializing all permanent custom functions of Hive

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5332: Fix Version/s: 0.13.0 > HiveSyncTool can avoid initializing all permanent custom functions of Hive >

[jira] [Closed] (HUDI-3572) support DAY_ROLLING strategy in ClusteringPlanPartitionFilterMode

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3572. --- Resolution: Fixed > support DAY_ROLLING strategy in ClusteringPlanPartitionFilterMode >

[jira] [Closed] (HUDI-5492) spark call command show_compaction doesn't return the completed compaction

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5492. --- Resolution: Fixed > spark call command show_compaction doesn't return the completed compaction >

[jira] [Closed] (HUDI-5483) Make RetryHelper more suitable for common use

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5483. --- Resolution: Fixed > Make RetryHelper more suitable for common use >

[jira] [Updated] (HUDI-5483) Make RetryHelper more suitable for common use

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5483: Fix Version/s: 0.13.0 (was: 0.13.1) > Make RetryHelper more suitable for common use

[jira] [Updated] (HUDI-5492) spark call command show_compaction doesn't return the completed compaction

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5492: Fix Version/s: 0.13.0 (was: 0.13.1) > spark call command show_compaction doesn't

[jira] [Closed] (HUDI-5192) GH actions and azure ci tests run even for trivial fixes

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5192. --- Resolution: Fixed > GH actions and azure ci tests run even for trivial fixes >

[jira] [Updated] (HUDI-5341) Incremental cleaning should consider later completed clustering instant

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5341: Fix Version/s: 0.13.0 (was: 0.13.1) > Incremental cleaning should consider later

[jira] [Closed] (HUDI-5341) Incremental cleaning should consider later completed clustering instant

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5341. --- Resolution: Fixed > Incremental cleaning should consider later completed clustering instant >

[jira] [Updated] (HUDI-5231) Address checkstyle warnings while building hudi

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5231: Fix Version/s: 0.13.0 > Address checkstyle warnings while building hudi >

[jira] [Updated] (HUDI-5192) GH actions and azure ci tests run even for trivial fixes

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5192: Fix Version/s: 0.13.0 > GH actions and azure ci tests run even for trivial fixes >

[GitHub] [hudi] xushiyan commented on a diff in pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-15 Thread via GitHub
xushiyan commented on code in PR #7914: URL: https://github.com/apache/hudi/pull/7914#discussion_r1108085302 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/common/HoodieSparkEngineContext.java: ## @@ -180,4 +184,24 @@ public Option

[jira] [Closed] (HUDI-5519) LogFileComparator does not compare CDC suffix

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5519. --- Resolution: Fixed > LogFileComparator does not compare CDC suffix >

[jira] [Closed] (HUDI-5231) Address checkstyle warnings while building hudi

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5231. --- Resolution: Fixed > Address checkstyle warnings while building hudi >

[jira] [Closed] (HUDI-5326) Incorrect cluster grouping in SparkSizeBasedClusteringPlanStrategy

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5326. --- Resolution: Fixed > Incorrect cluster grouping in SparkSizeBasedClusteringPlanStrategy >

[jira] [Updated] (HUDI-5519) LogFileComparator does not compare CDC suffix

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5519: Fix Version/s: 0.13.0 > LogFileComparator does not compare CDC suffix >

[jira] [Updated] (HUDI-5394) RowCustomColumnsSortPartitioner should not use sortWithinPartitions

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5394: Fix Version/s: 0.13.0 > RowCustomColumnsSortPartitioner should not use sortWithinPartitions >

[jira] [Closed] (HUDI-5394) RowCustomColumnsSortPartitioner should not use sortWithinPartitions

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5394. --- Resolution: Fixed > RowCustomColumnsSortPartitioner should not use sortWithinPartitions >

[jira] [Updated] (HUDI-5326) Incorrect cluster grouping in SparkSizeBasedClusteringPlanStrategy

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5326: Fix Version/s: 0.13.0 > Incorrect cluster grouping in SparkSizeBasedClusteringPlanStrategy >

[jira] [Updated] (HUDI-5514) Add support for auto generation of record keys for Hudi

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5514: Fix Version/s: 0.14.0 > Add support for auto generation of record keys for Hudi >

[jira] [Updated] (HUDI-5528) HiveSyncProcedure & HiveSyncTool also needs to add HIVE_SYNC_TABLE_STRATEGY

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5528: Fix Version/s: 0.13.0 > HiveSyncProcedure & HiveSyncTool also needs to add HIVE_SYNC_TABLE_STRATEGY >

[jira] [Updated] (HUDI-5543) Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5543: Fix Version/s: 0.13.0 (was: 0.13.1) > Description of

[jira] [Updated] (HUDI-5545) Extending support to other special characters for S3EventsMetaSelector

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5545: Fix Version/s: 0.13.0 (was: 0.13.1) > Extending support to other special characters

[jira] [Closed] (HUDI-5543) Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5543. --- Resolution: Fixed > Description of clustering.plan.partition.filter.mode supports DAY_ROLLING > strategy >

[jira] [Closed] (HUDI-5545) Extending support to other special characters for S3EventsMetaSelector

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5545. --- Resolution: Fixed > Extending support to other special characters for S3EventsMetaSelector >

[jira] [Updated] (HUDI-5512) spark call procedure run_bootstrap missing params cause job fail

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5512: Priority: Critical (was: Major) > spark call procedure run_bootstrap missing params cause job fail >

[jira] [Updated] (HUDI-5391) Modify the default value of parameter `hoodie.write.lock.client`

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5391: Fix Version/s: 0.13.0 > Modify the default value of parameter `hoodie.write.lock.client` >

[jira] [Closed] (HUDI-5512) spark call procedure run_bootstrap missing params cause job fail

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5512. --- Resolution: Fixed > spark call procedure run_bootstrap missing params cause job fail >

[jira] [Closed] (HUDI-5391) Modify the default value of parameter `hoodie.write.lock.client`

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5391. --- Resolution: Fixed > Modify the default value of parameter `hoodie.write.lock.client` >

[jira] [Closed] (HUDI-5554) Add UT TestHiveSyncTool#testSyncMergeOnReadWithStrategy for parameter HIVE_SYNC_TABLE_STRATEGY

2023-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5554. --- Resolution: Fixed > Add UT TestHiveSyncTool#testSyncMergeOnReadWithStrategy for parameter >

  1   2   3   4   5   >