[GitHub] [hudi] danny0405 commented on issue #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond

2022-06-12 Thread GitBox
danny0405 commented on issue #5833: URL: https://github.com/apache/hudi/issues/5833#issuecomment-1153535207 See the `NetworkUtils` the ip address seems can not work correctly for you local env. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] xicm commented on pull request #5790: [HUDI-3682] testReaderFilterRowKeys fails in TestHoodieOrcReaderWriter

2022-06-12 Thread GitBox
xicm commented on PR #5790: URL: https://github.com/apache/hudi/pull/5790#issuecomment-1153528483 hi @nsivabalan , I ran testUpsertsContinuousModeWithMultipleWritersForConflicts several times locally, but I didn't reproduce it, can we create a new issue to track this? -- This is an autom

[GitHub] [hudi] Run-Lin commented on issue #143: Tracking ticket for folks to be added to slack group

2022-06-12 Thread GitBox
Run-Lin commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-1153501025 Please add me to slack group [runlin...@gmail.com](mailto:runlin...@gmail.com) Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Closed] (HUDI-4048) Upgrade Hudi version in presto-hive

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-4048. - Resolution: Done > Upgrade Hudi version in presto-hive > --- > >

[jira] [Updated] (HUDI-4105) Identify out of the box performance config flips for spark-ds

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4105: -- Status: In Progress (was: Open) > Identify out of the box performance config flips for spark-ds > -

[jira] [Updated] (HUDI-4105) Identify out of the box performance config flips for spark-ds

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4105: -- Status: Patch Available (was: In Progress) > Identify out of the box performance config flips for spark

[jira] [Updated] (HUDI-3730) Improve hive/meta sync class design and hierachies

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3730: -- Status: Patch Available (was: In Progress) > Improve hive/meta sync class design and hierachies > -

[jira] [Updated] (HUDI-4070) Better Spark SQL default configs

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4070: -- Status: In Progress (was: Open) > Better Spark SQL default configs > >

[jira] [Updated] (HUDI-4071) Better Spark Datasource default configs

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4071: -- Status: Patch Available (was: In Progress) > Better Spark Datasource default configs >

[jira] [Updated] (HUDI-3730) Improve hive/meta sync class design and hierachies

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3730: -- Status: In Progress (was: Open) > Improve hive/meta sync class design and hierachies >

[jira] [Assigned] (HUDI-3884) Adding support to let archival proceed beyond savepointed commits

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-3884: - Assignee: Sagar Sumit (was: sivabalan narayanan) > Adding support to let archival proceed beyond

[jira] [Updated] (HUDI-4071) Better Spark Datasource default configs

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4071: -- Status: In Progress (was: Open) > Better Spark Datasource default configs > ---

[jira] [Updated] (HUDI-3884) Adding support to let archival proceed beyond savepointed commits

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3884: -- Sprint: Hudi-Sprint-Apr-12, Hudi-Sprint-Apr-19, Hudi-Sprint-Apr-25, 2022/05/31 (was: Hudi-Sprint-Apr-12

[jira] [Updated] (HUDI-2174) Simplify the amount of configs that need to be passed in for Spark Datasource writer

2022-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2174: -- Status: Patch Available (was: In Progress) > Simplify the amount of configs that need to be passed in f

[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`

2022-06-12 Thread GitBox
wulei0302 commented on code in PR #5627: URL: https://github.com/apache/hudi/pull/5627#discussion_r895332836 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java: ## @@ -234,6 +235,12 @@ public class HoodieCompactionConfig extends Ho

[GitHub] [hudi] wzx140 opened a new pull request, #5846: [Draft][WIP][HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-06-12 Thread GitBox
wzx140 opened a new pull request, #5846: URL: https://github.com/apache/hudi/pull/5846 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[GitHub] [hudi] a0x commented on issue #5792: [SUPPORT] Update hudi table(using SparkSQL) failed when the column contains `null` value in other records

2022-06-12 Thread GitBox
a0x commented on issue #5792: URL: https://github.com/apache/hudi/issues/5792#issuecomment-1153434879 > yes, "note" field did not have the proper default value set and hence the issue. Sorry whats your question now? before inserting to hudi, you might have to ensure the respective fields ha

[GitHub] [hudi] wzx140 closed pull request #5845: [Draft][WIP][HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-06-12 Thread GitBox
wzx140 closed pull request #5845: [Draft][WIP][HUDI-3384][HUDI-3385] Spark specific file reader/writer. URL: https://github.com/apache/hudi/pull/5845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] xushiyan commented on a diff in pull request #5754: [HUDI-3730] Improve meta sync class design and hierarchies

2022-06-12 Thread GitBox
xushiyan commented on code in PR #5754: URL: https://github.com/apache/hudi/pull/5754#discussion_r895303808 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java: ## @@ -24,79 +24,14 @@ import com.beust.jcommander.Parameter; +import java.io.Seri

[GitHub] [hudi] Chosen123Wang commented on issue #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond

2022-06-12 Thread GitBox
Chosen123Wang commented on issue #5833: URL: https://github.com/apache/hudi/issues/5833#issuecomment-1153426853 > > Did you try the 0.10.1 already ? not yet, just used 0.11.0 -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hudi] danny0405 commented on a diff in pull request #5754: [HUDI-3730] Improve meta sync class design and hierarchies

2022-06-12 Thread GitBox
danny0405 commented on code in PR #5754: URL: https://github.com/apache/hudi/pull/5754#discussion_r895295348 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java: ## @@ -24,79 +24,14 @@ import com.beust.jcommander.Parameter; +import java.io.Ser

[hudi] branch master updated (5aaac21d1d -> c82e3462e3)

2022-06-12 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 5aaac21d1d [HUDI-4224] Fix CI issues (#5842) add c82e3462e3 [MINOR] fix AvroSchemaConverter duplicate branch in

[GitHub] [hudi] danny0405 merged pull request #5813: [MINOR] fix AvroSchemaConverter duplicate branch in 'switch'

2022-06-12 Thread GitBox
danny0405 merged PR #5813: URL: https://github.com/apache/hudi/pull/5813 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] INRIX-Trang-Nguyen commented on issue #5211: [SUPPORT] Glob pattern to pick specific subfolders not working while reading in Spark

2022-06-12 Thread GitBox
INRIX-Trang-Nguyen commented on issue #5211: URL: https://github.com/apache/hudi/issues/5211#issuecomment-1153397563 Why would support for wildcards be dropped from 0.90 to 0.10? We partition data by different providers and need the ability to quickly fetch to the relevant data based on que

[jira] [Updated] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

2022-06-12 Thread du.junling (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] du.junling updated HUDI-4237: - Description: Create a non-partition hudi table in Spark,it will store spark.sql.sources.schema.partCol.0

[jira] [Updated] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

2022-06-12 Thread du.junling (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] du.junling updated HUDI-4237: - Description: Create a non-partition hudi table in Spark,it will store hoodie.table.partition.fields with

[jira] [Updated] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

2022-06-12 Thread du.junling (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] du.junling updated HUDI-4237: - Description: Create a non-partition hudi table in Spark,it will store hoodie.table.partition.fields with

[jira] [Created] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

2022-06-12 Thread du.junling (Jira)
du.junling created HUDI-4237: Summary: spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark Key: HUDI-4237 URL: https://issues.apache.org/jira/browse/HUDI-4237

[GitHub] [hudi] hudi-bot commented on pull request #5813: [MINOR] fix AvroSchemaConverter duplicate branch in 'switch'

2022-06-12 Thread GitBox
hudi-bot commented on PR #5813: URL: https://github.com/apache/hudi/pull/5813#issuecomment-1153387144 ## CI report: * ad7645769de50d5b8245f52bfb0c83671c102d4f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9180

[GitHub] [hudi] hudi-bot commented on pull request #5813: [MINOR] fix AvroSchemaConverter duplicate branch in 'switch'

2022-06-12 Thread GitBox
hudi-bot commented on PR #5813: URL: https://github.com/apache/hudi/pull/5813#issuecomment-1153384998 ## CI report: * ad7645769de50d5b8245f52bfb0c83671c102d4f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9180

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153384946 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[GitHub] [hudi] sandyfog commented on pull request #5813: [MINOR] fix AvroSchemaConverter duplicate branch in 'switch'

2022-06-12 Thread GitBox
sandyfog commented on PR #5813: URL: https://github.com/apache/hudi/pull/5813#issuecomment-1153372529 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] sandyfog commented on pull request #5813: [MINOR] fix AvroSchemaConverter duplicate branch in 'switch'

2022-06-12 Thread GitBox
sandyfog commented on PR #5813: URL: https://github.com/apache/hudi/pull/5813#issuecomment-1153372261 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] felixYyu commented on issue #5779: [SUPPORT]Spark session operation hudi table via HoodieCatalog[Table or view not found]

2022-06-12 Thread GitBox
felixYyu commented on issue #5779: URL: https://github.com/apache/hudi/issues/5779#issuecomment-1153372252 Only in local memory store. Could store metadata locally for unit testing? @leesf -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153358539 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[jira] [Updated] (HUDI-4236) Revisit Disabled ITTestHoodieSanity#testRunHoodieJavaAppOnMultiPartitionKeysMORTable

2022-06-12 Thread Rahil Chertara (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahil Chertara updated HUDI-4236: - Summary: Revisit Disabled ITTestHoodieSanity#testRunHoodieJavaAppOnMultiPartitionKeysMORTable (wa

[jira] [Created] (HUDI-4236) Revisit Disabled testRunHoodieJavaAppOnMultiPartitionKeysMORTable

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4236: Summary: Revisit Disabled testRunHoodieJavaAppOnMultiPartitionKeysMORTable Key: HUDI-4236 URL: https://issues.apache.org/jira/browse/HUDI-4236 Project: Apache Hudi

[jira] [Created] (HUDI-4235) Revisit Disabled testSyncCOWTableWithProperties,testSyncMORTableWithProperties

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4235: Summary: Revisit Disabled testSyncCOWTableWithProperties,testSyncMORTableWithProperties Key: HUDI-4235 URL: https://issues.apache.org/jira/browse/HUDI-4235 Project: A

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153351970 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[jira] [Updated] (HUDI-4232) Revisit disabled tests TestHoodieDeltaStreamer,TestHoodieMultiTableDeltaStreamer,TestMultiFS#readLocalWriteHDFS, TestMergeOnReadRollbackActionExecutor#testRollbackForCanIn

2022-06-12 Thread Rahil Chertara (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahil Chertara updated HUDI-4232: - Summary: Revisit disabled tests TestHoodieDeltaStreamer,TestHoodieMultiTableDeltaStreamer,TestMult

[jira] [Created] (HUDI-4234) Revisit Disabled ITTestHoodieDataSource

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4234: Summary: Revisit Disabled ITTestHoodieDataSource Key: HUDI-4234 URL: https://issues.apache.org/jira/browse/HUDI-4234 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-4233) Revisit Disabled testMergeOnReadSnapshotRelationWithDeltaLogsFallback

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4233: Summary: Revisit Disabled testMergeOnReadSnapshotRelationWithDeltaLogsFallback Key: HUDI-4233 URL: https://issues.apache.org/jira/browse/HUDI-4233 Project: Apache Hu

[jira] [Updated] (HUDI-4232) Revisit disabled tests TestMultiFS#readLocalWriteHDFS, TestMergeOnReadRollbackActionExecutor#testRollbackForCanIndexLogFile,TestSparkHoodieHBaseIndex

2022-06-12 Thread Rahil Chertara (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahil Chertara updated HUDI-4232: - Summary: Revisit disabled tests TestMultiFS#readLocalWriteHDFS, TestMergeOnReadRollbackActionExecu

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153303479 ## CI report: * 8b8d82df5a4c39b0ec2e8e2b3ef3e49fc76a29c0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9235

[jira] [Created] (HUDI-4232) Revisit disabled tests TestMultiFS#readLocalWriteHDFS, TestMergeOnReadRollbackActionExecutor#testRollbackForCanIndexLogFile

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4232: Summary: Revisit disabled tests TestMultiFS#readLocalWriteHDFS, TestMergeOnReadRollbackActionExecutor#testRollbackForCanIndexLogFile Key: HUDI-4232 URL: https://issues.apache.org/

[jira] [Created] (HUDI-4231) Revisit Disabled testHoodieFlinkQuickstart

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4231: Summary: Revisit Disabled testHoodieFlinkQuickstart Key: HUDI-4231 URL: https://issues.apache.org/jira/browse/HUDI-4231 Project: Apache Hudi Issue Type: Task

[hudi] branch release-0.11.1-rc2-prep-3 created (now 33c33787c1)

2022-06-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.11.1-rc2-prep-3 in repository https://gitbox.apache.org/repos/asf/hudi.git at 33c33787c1 Fix azure pipeline No new revisions were added by this update.

[hudi] branch release-0.11.1-rc2-prep-2 updated: Fix azure pipeline

2022-06-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.11.1-rc2-prep-2 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.11.1-rc2-prep-2 by this push: new 33c33787c1 F

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153295619 ## CI report: * f6b737f243344c7dee1a4327992fa19e04ba4804 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9248

[jira] [Created] (HUDI-4230) Revisit Disabled Tests in TestHiveIncrementalPuller

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4230: Summary: Revisit Disabled Tests in TestHiveIncrementalPuller Key: HUDI-4230 URL: https://issues.apache.org/jira/browse/HUDI-4230 Project: Apache Hudi Issue T

[jira] [Created] (HUDI-4229) Revisit Disabled tests in TestOrcBootstrap

2022-06-12 Thread Rahil Chertara (Jira)
Rahil Chertara created HUDI-4229: Summary: Revisit Disabled tests in TestOrcBootstrap Key: HUDI-4229 URL: https://issues.apache.org/jira/browse/HUDI-4229 Project: Apache Hudi Issue Type: Tas

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153291701 ## CI report: * f6b737f243344c7dee1a4327992fa19e04ba4804 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9248

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153291644 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153280656 ## CI report: * Unknown: [CANCELED](TBD) * f6b737f243344c7dee1a4327992fa19e04ba4804 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153279471 ## CI report: * f6b737f243344c7dee1a4327992fa19e04ba4804 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands:

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153278817 ## CI report: * f6b737f243344c7dee1a4327992fa19e04ba4804 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[hudi] branch release-0.11.1-rc2-prep-2 created (now f6b737f243)

2022-06-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.11.1-rc2-prep-2 in repository https://gitbox.apache.org/repos/asf/hudi.git at f6b737f243 [HUDI-4224] Fix CI issues (#5842) No new revisions were added by this update.

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153265310 ## CI report: * 8b8d82df5a4c39b0ec2e8e2b3ef3e49fc76a29c0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9235

[GitHub] [hudi] yihua commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
yihua commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153264700 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153264070 ## CI report: * 8b8d82df5a4c39b0ec2e8e2b3ef3e49fc76a29c0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9235

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153264022 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153262768 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * b7

[GitHub] [hudi] hudi-bot commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
hudi-bot commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153261705 ## CI report: * 8b8d82df5a4c39b0ec2e8e2b3ef3e49fc76a29c0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9235

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153261663 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN * U

[GitHub] [hudi] yihua commented on pull request #5844: [DO NOT MERGE][CI] Release 0.11.1 RC2 prep

2022-06-12 Thread GitBox
yihua commented on PR #5844: URL: https://github.com/apache/hudi/pull/5844#issuecomment-1153261500 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[hudi] branch release-0.11.1-rc2-prep updated (8b8d82df5a -> f6b737f243)

2022-06-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.11.1-rc2-prep in repository https://gitbox.apache.org/repos/asf/hudi.git discard 8b8d82df5a [HUDI-4205] Fix NullPointerException in HFile reader creation add b3c77338bf [HUDI-4205

[hudi] branch master updated: [HUDI-4224] Fix CI issues (#5842)

2022-06-12 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5aaac21d1d [HUDI-4224] Fix CI issues (#5842) 5aaac2

[GitHub] [hudi] yihua merged pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
yihua merged PR #5842: URL: https://github.com/apache/hudi/pull/5842 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] yihua commented on a diff in pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
yihua commented on code in PR #5842: URL: https://github.com/apache/hudi/pull/5842#discussion_r895218478 ## hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java: ## @@ -148,7 +148,7 @@ public static void main(String[] args) throws Exception { }

[jira] [Created] (HUDI-4228) Clean up literal usage in Hudi CLI argument check

2022-06-12 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-4228: --- Summary: Clean up literal usage in Hudi CLI argument check Key: HUDI-4228 URL: https://issues.apache.org/jira/browse/HUDI-4228 Project: Apache Hudi Issue Type: Improve

[GitHub] [hudi] rahil-c commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
rahil-c commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153256852 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] yihua commented on a diff in pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
yihua commented on code in PR #5842: URL: https://github.com/apache/hudi/pull/5842#discussion_r895217750 ## azure-pipelines.yml: ## @@ -21,12 +21,68 @@ trigger: pool: vmImage: 'ubuntu-18.04' +parameters: + - name: job1Modules +type: object +default: + - 'hudi

[GitHub] [hudi] yihua commented on a diff in pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
yihua commented on code in PR #5842: URL: https://github.com/apache/hudi/pull/5842#discussion_r895216804 ## azure-pipelines.yml: ## @@ -21,12 +21,68 @@ trigger: pool: vmImage: 'ubuntu-18.04' +parameters: + - name: job1Modules +type: object +default: + - 'hudi

[GitHub] [hudi] yihua commented on a diff in pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
yihua commented on code in PR #5842: URL: https://github.com/apache/hudi/pull/5842#discussion_r895216454 ## hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java: ## @@ -148,7 +148,7 @@ public static void main(String[] args) throws Exception { }

[GitHub] [hudi] xushiyan commented on a diff in pull request #5754: [HUDI-3730] Improve meta sync class design and hierarchies

2022-06-12 Thread GitBox
xushiyan commented on code in PR #5754: URL: https://github.com/apache/hudi/pull/5754#discussion_r895216045 ## hudi-sync/hudi-sync-common/src/main/java/org/apache/hudi/sync/common/operation/CatalogSync.java: ## @@ -0,0 +1,32 @@ +package org.apache.hudi.sync.common.operation; Re

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153251107 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 2a317e74498d868bbe374d074a4c4e160edd2368 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-12 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1153249934 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 2a317e74498d868bbe374d074a4c4e160edd2368 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] xushiyan merged pull request #5754: [HUDI-3730] Improve hive/meta sync class design and hierarchies

2022-06-12 Thread GitBox
xushiyan merged PR #5754: URL: https://github.com/apache/hudi/pull/5754 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153214345 ## CI report: * be707698a61e491bf3377f7b651c89960b4654ab Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9241

[jira] [Created] (HUDI-4227) Strip extra spaces when creating new configuration

2022-06-12 Thread chao he (Jira)
chao he created HUDI-4227: - Summary: Strip extra spaces when creating new configuration Key: HUDI-4227 URL: https://issues.apache.org/jira/browse/HUDI-4227 Project: Apache Hudi Issue Type: Improvemen

[hudi] branch release-feature-rfc55 created (now fd8f7c5f6c)

2022-06-12 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch release-feature-rfc55 in repository https://gitbox.apache.org/repos/asf/hudi.git at fd8f7c5f6c [HUDI-4205] Fix NullPointerException in HFile reader creation (#5841) No new revisions wer

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153180241 ## CI report: * 98b777f713dc94501c1a6508bd9120b8f794d3e9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9240

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153176431 ## CI report: * 98b777f713dc94501c1a6508bd9120b8f794d3e9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9240

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153175272 ## CI report: * 98b777f713dc94501c1a6508bd9120b8f794d3e9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9240

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153161187 ## CI report: * 42c842215101d35d34def8bc45d18204c9f697fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9239

[GitHub] [hudi] hudi-bot commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
hudi-bot commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153159716 ## CI report: * 42c842215101d35d34def8bc45d18204c9f697fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9239

[jira] [Updated] (HUDI-4226) CLI unable to rollback complete instants

2022-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4226: - Description: Need to reproduce: write 3 commits to COW table and execute CLI to rollback last 2 commits:

[jira] [Created] (HUDI-4226) CLI unable to rollback complete instants

2022-06-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4226: Summary: CLI unable to rollback complete instants Key: HUDI-4226 URL: https://issues.apache.org/jira/browse/HUDI-4226 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] XuQianJin-Stars commented on pull request #5761: [HUDI-4165] Support Create/Drop/Show/Refresh Index Syntax for Spark SQL

2022-06-12 Thread GitBox
XuQianJin-Stars commented on PR #5761: URL: https://github.com/apache/hudi/pull/5761#issuecomment-1153117671 This PR looks good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #5761: [HUDI-4165] Support Create/Drop/Show/Refresh Index Syntax for Spark SQL

2022-06-12 Thread GitBox
XuQianJin-Stars commented on code in PR #5761: URL: https://github.com/apache/hudi/pull/5761#discussion_r895144439 ## hudi-common/src/main/java/org/apache/hudi/common/index/HoodieIndexType.java: ## @@ -0,0 +1,54 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [hudi] zhangyue19921010 commented on pull request #5842: [HUDI-4224] Fix CI issues

2022-06-12 Thread GitBox
zhangyue19921010 commented on PR #5842: URL: https://github.com/apache/hudi/pull/5842#issuecomment-1153101201 Working on these failed tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Updated] (HUDI-4139) [HUDI-4139] improvement for flink sink operators so we can easily identify the table which write to hudi

2022-06-12 Thread yanenze (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanenze updated HUDI-4139: -- Description: for save resources sometimes we may use one solt to run a few tables like this !image-2022-05-23-1

[jira] [Updated] (HUDI-4139) [HUDI-4139] improvement for flink sink operators so we can easily identify the table which write to hudi

2022-06-12 Thread yanenze (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanenze updated HUDI-4139: -- Attachment: image-2022-06-12-15-30-00-734.png > [HUDI-4139] improvement for flink sink operators so we can easil

[jira] [Updated] (HUDI-4139) [HUDI-4139] improvement for flink sink operators so we can easily identify the table which write to hudi

2022-06-12 Thread yanenze (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanenze updated HUDI-4139: -- Attachment: image-2022-06-12-15-29-19-574.png > [HUDI-4139] improvement for flink sink operators so we can easil