[GitHub] [hudi] danny0405 commented on a diff in pull request #7151: [MINOR] Performance improvement of flink ITs with reused miniCluster

danny0405 commented on code in PR #7151: URL: https://github.com/apache/hudi/pull/7151#discussion_r1016252288 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/AbstractHoodieTestBase.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #7151: [MINOR] Performance improvement of flink ITs with reused miniCluster

danny0405 commented on code in PR #7151: URL: https://github.com/apache/hudi/pull/7151#discussion_r1016252288 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/AbstractHoodieTestBase.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] hudi-bot commented on pull request #7160: [HUDI-5176] Fix incremental source to consider inflight commits before completed commits

hudi-bot commented on PR #7160: URL: https://github.com/apache/hudi/pull/7160#issuecomment-1306775579 ## CI report: * e533073bcad6f6a5a56faf36ee427063bc6d388a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6419: [HUDI-2057] CTAS Generate An External Table When Create Managed Table

hudi-bot commented on PR #6419: URL: https://github.com/apache/hudi/pull/6419#issuecomment-1306774436 ## CI report: * 5c1cb2151993df9a20cf4f98d56178cf5825b00c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7160: [HUDI-5176] Fix incremental source to consider inflight commits before completed commits

hudi-bot commented on PR #7160: URL: https://github.com/apache/hudi/pull/7160#issuecomment-1306769748 ## CI report: * e533073bcad6f6a5a56faf36ee427063bc6d388a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table management service

hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1306769066 ## CI report: * 4ed7915b066588e620163ecd0abafc6c61fd587a UNKNOWN * 0da5a658baa0616cfb0666fe6a1d0d916191d274 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6419: [HUDI-2057] CTAS Generate An External Table When Create Managed Table

hudi-bot commented on PR #6419: URL: https://github.com/apache/hudi/pull/6419#issuecomment-1306768740 ## CI report: * 5c1cb2151993df9a20cf4f98d56178cf5825b00c Azure:

[GitHub] [hudi] danny0405 commented on issue #7115: [SUPPORT]flink insert hudi cow table ,but hive query is null。

danny0405 commented on issue #7115: URL: https://github.com/apache/hudi/issues/7115#issuecomment-1306767752 Make sure you open the checkpoint of the write process. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #7129: [MINOR] Support column type evolution for Hive

hudi-bot commented on PR #7129: URL: https://github.com/apache/hudi/pull/7129#issuecomment-1306764604 ## CI report: * 90b1fef27ef225881814748e9d5eb9a323d35b6c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

hudi-bot commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1306763537 ## CI report: * 1d4477334ee7d158111a01559641015379597fc0 Azure:

[GitHub] [hudi] XuQianJin-Stars commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

XuQianJin-Stars commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1306752083 hi @nsivabalan i adressed this minor comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] zhangyue19921010 commented on pull request #7143: [HUDI-5157]Improving FileIndex load performance in PARALLELISM mode

zhangyue19921010 commented on PR #7143: URL: https://github.com/apache/hudi/pull/7143#issuecomment-1306743584 Hi @nsivabalan Thanks a lot for your attention here! I believe this pr is ready for review. Please take a look at your convenient! Thanks :) -- This is an automated message

[GitHub] [hudi] xiarixiaoyao commented on pull request #7129: [MINOR] Support column type evolution for Hive

xiarixiaoyao commented on PR #7129: URL: https://github.com/apache/hudi/pull/7129#issuecomment-1306735546 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5176: - Labels: pull-request-available (was: ) > Incremental source may miss commits if there are

[GitHub] [hudi] yihua opened a new pull request, #7160: [HUDI-5176] Fix incremental source to consider inflight commits before completed commits

yihua opened a new pull request, #7160: URL: https://github.com/apache/hudi/pull/7160 ### Change Logs When multiple writers are writing to the same Hudi table under optimistic concurrency control, one writer may start later and finish the write transaction earlier than the other

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Description: HUDI-5176 We have fixed the Hudi incremental source when there are inflight commits before

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Description: HUDI-5176 We have fixed the Hudi incremental source when there are inflight commits before

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Description: HUDI-5176 We have fixed  > Revisit HiveIncrPullSource and JdbcSource for interleaved

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Description: HUDI-5176 We have fixed the Hudi incremental source when there are inflight commits before

[GitHub] [hudi] hudi-bot commented on pull request #6868: [Hudi-4882] Multiple ordering fields for partial update to handle out-of-order events

hudi-bot commented on PR #6868: URL: https://github.com/apache/hudi/pull/6868#issuecomment-1306710945 ## CI report: * 4ccf55800622ece41deb28de8c0e59989638171d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table management service

hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1306710784 ## CI report: * 4ed7915b066588e620163ecd0abafc6c61fd587a UNKNOWN * 0da5a658baa0616cfb0666fe6a1d0d916191d274 Azure:

[jira] [Created] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

Ethan Guo created HUDI-5177: --- Summary: Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits Key: HUDI-5177 URL: https://issues.apache.org/jira/browse/HUDI-5177 Project: Apache Hudi

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Fix Version/s: 0.12.2 > Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits >

[jira] [Updated] (HUDI-5177) Revisit HiveIncrPullSource and JdbcSource for interleaved inflight commits

[ https://issues.apache.org/jira/browse/HUDI-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5177: Priority: Critical (was: Major) > Revisit HiveIncrPullSource and JdbcSource for interleaved inflight

[GitHub] [hudi] nsivabalan commented on issue #7154: [SUPPORT] Hudi 0.12.2 release (Unknown versionCode:5)

nsivabalan commented on issue #7154: URL: https://github.com/apache/hudi/issues/7154#issuecomment-1306710504 yes. we also have this functionality w/ hudi cli. you should be able to downgrade the table to any version. -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] XuQianJin-Stars commented on pull request #6868: [Hudi-4882] Multiple ordering fields for partial update to handle out-of-order events

XuQianJin-Stars commented on PR #6868: URL: https://github.com/apache/hudi/pull/6868#issuecomment-1306709675 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #6939: [HUDI-5025] Rollback failed with log file not found when rollOver in rollback process

hudi-bot commented on PR #6939: URL: https://github.com/apache/hudi/pull/6939#issuecomment-1306707167 ## CI report: * b46f2d69debcc6144dd0c27a990cd4298d65675f Azure:

[GitHub] [hudi] nsivabalan commented on issue #7115: [SUPPORT]flink insert hudi cow table ,but hive query is null。

nsivabalan commented on issue #7115: URL: https://github.com/apache/hudi/issues/7115#issuecomment-1306706264 CC @yuzhaojing @danny0405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] nsivabalan commented on issue #7133: lazyReading affect

nsivabalan commented on issue #7133: URL: https://github.com/apache/hudi/issues/7133#issuecomment-1306703796 yes, its mainly for memory pressure and favoring I/O. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #6939: [HUDI-5025] Rollback failed with log file not found when rollOver in rollback process

hudi-bot commented on PR #6939: URL: https://github.com/apache/hudi/pull/6939#issuecomment-1306703223 ## CI report: * b46f2d69debcc6144dd0c27a990cd4298d65675f Azure:

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Story Points: 2 > Incremental source may miss commits if there are inflight commits before > completed

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Status: In Progress (was: Open) > Incremental source may miss commits if there are inflight commits before

[GitHub] [hudi] hudi-bot commented on pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

hudi-bot commented on PR #7159: URL: https://github.com/apache/hudi/pull/7159#issuecomment-1306699365 ## CI report: * d7c9c9be091de7d45af4a05b7a01366301193785 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7127: [HUDI-5154] Improve hudi-spark-client Lambada writing

hudi-bot commented on PR #7127: URL: https://github.com/apache/hudi/pull/7127#issuecomment-1306699230 ## CI report: * b3b13256c140e004fda7e617a9f6233ffe6869ae Azure:

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Sprint: 2022/11/01 > Incremental source may miss commits if there are inflight commits before > completed

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Labels: incremen (was: ) > Incremental source may miss commits if there are inflight commits before >

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Priority: Blocker (was: Major) > Incremental source may miss commits if there are inflight commits before

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Description: Consider the following scenario of concurrent writers. Writer 1 starts a commit at t1 and

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Component/s: incremental-query > Incremental source may miss commits if there are inflight commits before

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Fix Version/s: 0.12.2 > Incremental source may miss commits if there are inflight commits before >

[jira] [Assigned] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-5176: --- Assignee: Ethan Guo > Incremental source may miss commits if there are inflight commits before >

[jira] [Updated] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

[ https://issues.apache.org/jira/browse/HUDI-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5176: Labels: (was: incremen) > Incremental source may miss commits if there are inflight commits before >

[jira] [Created] (HUDI-5176) Incremental source may miss commits if there are inflight commits before completed commits

Ethan Guo created HUDI-5176: --- Summary: Incremental source may miss commits if there are inflight commits before completed commits Key: HUDI-5176 URL: https://issues.apache.org/jira/browse/HUDI-5176

[GitHub] [hudi] devanshguptatrepp commented on issue #7135: [SUPPORT] Issues with Spark3_3Adapter while using spark to write to hudi

devanshguptatrepp commented on issue #7135: URL: https://github.com/apache/hudi/issues/7135#issuecomment-1306695004 Here are the spark-submit commands that I have tried: 1. `spark-submit --deploy-mode client --jars s3a://bucketName/binaries/hudi/etl/hudi-spark-bundle_2.12-0.11.0.jar

[jira] [Updated] (HUDI-5148) Write RFC for index on functions and logical partitioning

[ https://issues.apache.org/jira/browse/HUDI-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5148: Status: In Progress (was: Open) > Write RFC for index on functions and logical partitioning >

[jira] [Comment Edited] (HUDI-5159) Support write a success file to partition when it finished in flink streaming append writer

[ https://issues.apache.org/jira/browse/HUDI-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630183#comment-17630183 ] KevinyhZou edited comment on HUDI-5159 at 11/8/22 5:17 AM: --- OK,  I have made  a

[GitHub] [hudi] hudi-bot commented on pull request #7143: [HUDI-5157]Improving FileIndex load performance in PARALLELISM mode

hudi-bot commented on PR #7143: URL: https://github.com/apache/hudi/pull/7143#issuecomment-1306649528 ## CI report: * db7c99a27bbc67525761ccde790dccead1c64611 Azure:

[jira] [Commented] (HUDI-5159) Support write a success file to partition when it finished in flink streaming append writer

[ https://issues.apache.org/jira/browse/HUDI-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630183#comment-17630183 ] KevinyhZou commented on HUDI-5159: -- OK,  I have made  a implement of  this feature, and will submit a pr

[jira] [Updated] (HUDI-5157) Duplicate partition path for chained hudi tables.

[ https://issues.apache.org/jira/browse/HUDI-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5157: - Labels: pull-request-available (was: ) > Duplicate partition path for chained hudi tables. >

[GitHub] [hudi] hudi-bot commented on pull request #7143: [HUDI-5157]Improving FileIndex load performance in PARALLELISM mode

hudi-bot commented on PR #7143: URL: https://github.com/apache/hudi/pull/7143#issuecomment-1306642927 ## CI report: * db7c99a27bbc67525761ccde790dccead1c64611 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7142: [HUDI-5056] Allow wildcards in partition paths for DELETE_PARTITIONS

hudi-bot commented on PR #7142: URL: https://github.com/apache/hudi/pull/7142#issuecomment-1306638128 ## CI report: * 50ab8834e6dad68dfb679216e7b3096254588dfc Azure:

[jira] [Closed] (HUDI-2673) Add integration/e2e test for kafka-connect functionality

[ https://issues.apache.org/jira/browse/HUDI-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2673. Reviewers: Ethan Guo (was: Sagar Sumit) Resolution: Done > Add integration/e2e test for kafka-connect

[jira] [Assigned] (HUDI-5175) Improving FileIndex load performance in PARALLELISM mode

[ https://issues.apache.org/jira/browse/HUDI-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang reassigned HUDI-5175: --- Assignee: Yue Zhang > Improving FileIndex load performance in PARALLELISM mode >

[jira] [Created] (HUDI-5175) Improving FileIndex load performance in PARALLELISM mode

Yue Zhang created HUDI-5175: --- Summary: Improving FileIndex load performance in PARALLELISM mode Key: HUDI-5175 URL: https://issues.apache.org/jira/browse/HUDI-5175 Project: Apache Hudi Issue Type:

[GitHub] [hudi] trushev commented on a diff in pull request #7151: [MINOR] Performance improvement of flink ITs with reused miniCluster

trushev commented on code in PR #7151: URL: https://github.com/apache/hudi/pull/7151#discussion_r1016121267 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/AbstractHoodieTestBase.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] trushev commented on a diff in pull request #7151: [MINOR] Performance improvement of flink ITs with reused miniCluster

trushev commented on code in PR #7151: URL: https://github.com/apache/hudi/pull/7151#discussion_r1016121267 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/AbstractHoodieTestBase.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #6939: [HUDI-5025] Rollback failed with log file not found when rollOver in rollback process

danny0405 commented on code in PR #6939: URL: https://github.com/apache/hudi/pull/6939#discussion_r1016121108 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatWriter.java: ## @@ -220,6 +220,7 @@ private void rolloverIfNeeded() throws IOException {

[GitHub] [hudi] hudi-bot commented on pull request #7042: [HUDI-5082] Improve the cdc log file name format

hudi-bot commented on PR #7042: URL: https://github.com/apache/hudi/pull/7042#issuecomment-1306594170 ## CI report: * 6ad211f90e9d94467ca6888e11bc28903b79ad15 Azure:

[GitHub] [hudi] fengjian428 commented on issue #7154: [SUPPORT] Hudi 0.12.2 release (Unknown versionCode:5)

fengjian428 commented on issue #7154: URL: https://github.com/apache/hudi/issues/7154#issuecomment-1306593374 have you tried the `downgrade_table` procedure in spark sql? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot commented on pull request #7042: [HUDI-5082] Improve the cdc log file name format

hudi-bot commented on PR #7042: URL: https://github.com/apache/hudi/pull/7042#issuecomment-1306591308 ## CI report: * 6ad211f90e9d94467ca6888e11bc28903b79ad15 Azure:

[GitHub] [hudi] danny0405 commented on pull request #6939: [HUDI-5025] Rollback failed with log file not found when rollOver in rollback process

danny0405 commented on PR #6939: URL: https://github.com/apache/hudi/pull/6939#issuecomment-1306588951 Nice catch ~, i have reviewed and applied a patch: [5025.patch.zip](https://github.com/apache/hudi/files/9957426/5025.patch.zip) Can you rebase with the latest master and force-push

[GitHub] [hudi] TengHuo commented on issue #7106: [PROPOSE] Add column prune support for other payload class

TengHuo commented on issue #7106: URL: https://github.com/apache/hudi/issues/7106#issuecomment-1306584539 Thanks @alexeykudinkin for your reply. Got it, I saw there are 2 tickets in JIRA about this new API `RecordMerge`, [HUDI-4380](https://issues.apache.org/jira/browse/HUDI-4380),

[GitHub] [hudi] danny0405 commented on a diff in pull request #7156: [HUDI-5161] add TIMESTAMP_LTZ

danny0405 commented on code in PR #7156: URL: https://github.com/apache/hudi/pull/7156#discussion_r1016096005 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/catalog/TypeInfoLogicalTypeVisitor.java: ## @@ -144,6 +145,16 @@ public TypeInfo

[GitHub] [hudi] waywtdcc commented on pull request #5830: [HUDI-3981][RFC-33] Flink engine support for comprehensive schema evolution

waywtdcc commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1306553527 Is there any progress in this pr? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] waywtdcc commented on pull request #5830: [HUDI-3981][RFC-33] Flink engine support for comprehensive schema evolution

waywtdcc commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1306552952 Is there any progress in this pr? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] danny0405 closed issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase

danny0405 closed issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase URL: https://github.com/apache/hudi/issues/5724 -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] danny0405 commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase

danny0405 commented on issue #5724: URL: https://github.com/apache/hudi/issues/5724#issuecomment-1306552715 Close because of chronic inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 commented on issue #5690: [SUPPORT] Flink stream write hudi, failed to checkpoint

danny0405 commented on issue #5690: URL: https://github.com/apache/hudi/issues/5690#issuecomment-1306552212 Close because of chronic inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #5690: [SUPPORT] Flink stream write hudi, failed to checkpoint

danny0405 closed issue #5690: [SUPPORT] Flink stream write hudi, failed to checkpoint URL: https://github.com/apache/hudi/issues/5690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] danny0405 closed issue #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond

danny0405 closed issue #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond URL: https://github.com/apache/hudi/issues/5833 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] danny0405 commented on issue #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond

danny0405 commented on issue #5833: URL: https://github.com/apache/hudi/issues/5833#issuecomment-1306550477 Try the new option `hoodie.filesystem.view.remote.retry.enable` which is introduced in release 0.12.1. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] danny0405 closed issue #5870: [SUPPORT] Issues when querying data partitioned by year with Flink

danny0405 closed issue #5870: [SUPPORT] Issues when querying data partitioned by year with Flink URL: https://github.com/apache/hudi/issues/5870 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] danny0405 commented on issue #5870: [SUPPORT] Issues when querying data partitioned by year with Flink

danny0405 commented on issue #5870: URL: https://github.com/apache/hudi/issues/5870#issuecomment-1306549833 0.12.1 should have solved this problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] hudi-bot commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

hudi-bot commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1306545134 ## CI report: * 1d4477334ee7d158111a01559641015379597fc0 Azure:

[GitHub] [hudi] danny0405 commented on issue #5871: [SUPPORT] NPE when writing metadata with Flink

danny0405 commented on issue #5871: URL: https://github.com/apache/hudi/issues/5871#issuecomment-1306544476 Close because of prolonged inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #5871: [SUPPORT] NPE when writing metadata with Flink

danny0405 closed issue #5871: [SUPPORT] NPE when writing metadata with Flink URL: https://github.com/apache/hudi/issues/5871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] danny0405 commented on issue #5547: [SUPPORT] Read Hudi data with flink-1.13.6 and report java.lang.NoSuchMethodError

danny0405 commented on issue #5547: URL: https://github.com/apache/hudi/issues/5547#issuecomment-1306543982 We removed the parquet shade pattern since 0.11.0 for `hudi-flink-bundle`, maybe we should add it back :) -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] danny0405 closed issue #5547: [SUPPORT] Read Hudi data with flink-1.13.6 and report java.lang.NoSuchMethodError

danny0405 closed issue #5547: [SUPPORT] Read Hudi data with flink-1.13.6 and report java.lang.NoSuchMethodError URL: https://github.com/apache/hudi/issues/5547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] XuQianJin-Stars commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

XuQianJin-Stars commented on PR #6284: URL: https://github.com/apache/hudi/pull/6284#issuecomment-1306543690 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] danny0405 closed issue #5979: [SUPPORT]the hudi's table of join can not handle delete operation.But simple table is ok.why?

danny0405 closed issue #5979: [SUPPORT]the hudi's table of join can not handle delete operation.But simple table is ok.why? URL: https://github.com/apache/hudi/issues/5979 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] danny0405 commented on issue #6034: [SUPPORT] Flink Bucket Index Can't Update Records Using 0.11.1

danny0405 commented on issue #6034: URL: https://github.com/apache/hudi/issues/6034#issuecomment-1306541144 Close because of prolonged inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #6034: [SUPPORT] Flink Bucket Index Can't Update Records Using 0.11.1

danny0405 closed issue #6034: [SUPPORT] Flink Bucket Index Can't Update Records Using 0.11.1 URL: https://github.com/apache/hudi/issues/6034 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] danny0405 closed issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

danny0405 closed issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table URL: https://github.com/apache/hudi/issues/6052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] danny0405 commented on issue #6052: [SUPPORT] HoodieRollbackException when starting Flink Job on existing Hudi Table

danny0405 commented on issue #6052: URL: https://github.com/apache/hudi/issues/6052#issuecomment-1306539970 Close because of prolonged inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #6102: [SUPPORT]Missing data problem，exigency！！！

danny0405 closed issue #6102: [SUPPORT]Missing data problem，exigency！！！ URL: https://github.com/apache/hudi/issues/6102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] danny0405 commented on issue #6102: [SUPPORT]Missing data problem，exigency！！！

danny0405 commented on issue #6102: URL: https://github.com/apache/hudi/issues/6102#issuecomment-1306539496 0.12.1 expects to solve the problem, feel free to re-open it if the problem still exists. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] danny0405 closed issue #6126: [SUPPORT] Hudi Table(MOR) not getting created from Flink Sql Client Shell

danny0405 closed issue #6126: [SUPPORT] Hudi Table(MOR) not getting created from Flink Sql Client Shell URL: https://github.com/apache/hudi/issues/6126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] danny0405 commented on issue #6126: [SUPPORT] Hudi Table(MOR) not getting created from Flink Sql Client Shell

danny0405 commented on issue #6126: URL: https://github.com/apache/hudi/issues/6126#issuecomment-1306538262 Close because of prolonged inactivity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 commented on issue #6131: Exception file does not exist .hoodie/.aux/view_storage_conf.properties

danny0405 commented on issue #6131: URL: https://github.com/apache/hudi/issues/6131#issuecomment-1306537414 Close because it is inactive. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] danny0405 closed issue #6131: Exception file does not exist .hoodie/.aux/view_storage_conf.properties

danny0405 closed issue #6131: Exception file does not exist .hoodie/.aux/view_storage_conf.properties URL: https://github.com/apache/hudi/issues/6131 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #6260: [SUPPORT]Caused by: java.util.NoSuchElementException: No value present in Option

danny0405 closed issue #6260: [SUPPORT]Caused by: java.util.NoSuchElementException: No value present in Option URL: https://github.com/apache/hudi/issues/6260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] danny0405 commented on issue #6260: [SUPPORT]Caused by: java.util.NoSuchElementException: No value present in Option

danny0405 commented on issue #6260: URL: https://github.com/apache/hudi/issues/6260#issuecomment-1306536625 Close because it is a known fixed bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 closed issue #6297: [SUPPORT] Flink SQL client cow table query error "org/apache/parquet/column/ColumnDescriptor" (but mor table query normal)

danny0405 closed issue #6297: [SUPPORT] Flink SQL client cow table query error "org/apache/parquet/column/ColumnDescriptor" (but mor table query normal) URL: https://github.com/apache/hudi/issues/6297 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] danny0405 commented on issue #6297: [SUPPORT] Flink SQL client cow table query error "org/apache/parquet/column/ColumnDescriptor" (but mor table query normal)

danny0405 commented on issue #6297: URL: https://github.com/apache/hudi/issues/6297#issuecomment-1306536197 Close for inactivility. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] danny0405 commented on issue #6460: [SUPPORT] java.lang.NoSuchMethodError: 'org.apache.flink.table.data.ColumnarRowData org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRo

danny0405 commented on issue #6460: URL: https://github.com/apache/hudi/issues/6460#issuecomment-1306535506 Fix https://github.com/apache/hudi/pull/6481 should have solved your problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] danny0405 closed issue #6460: [SUPPORT] java.lang.NoSuchMethodError: 'org.apache.flink.table.data.ColumnarRowData org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplit

danny0405 closed issue #6460: [SUPPORT] java.lang.NoSuchMethodError: 'org.apache.flink.table.data.ColumnarRowData org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.nextRecord()' URL: https://github.com/apache/hudi/issues/6460 -- This is an automated message from

[GitHub] [hudi] danny0405 closed issue #6529: [SUPPORT] jar conflicts about org.apache.hudi.execution.FlinkLazyInsertIterable.getTransformFunction

danny0405 closed issue #6529: [SUPPORT] jar conflicts about org.apache.hudi.execution.FlinkLazyInsertIterable.getTransformFunction URL: https://github.com/apache/hudi/issues/6529 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] danny0405 commented on issue #6529: [SUPPORT] jar conflicts about org.apache.hudi.execution.FlinkLazyInsertIterable.getTransformFunction

danny0405 commented on issue #6529: URL: https://github.com/apache/hudi/issues/6529#issuecomment-1306534618 Seems it is already solved, close it here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot commented on pull request #7156: [HUDI-5161] add TIMESTAMP_LTZ

hudi-bot commented on PR #7156: URL: https://github.com/apache/hudi/pull/7156#issuecomment-1306533357 ## CI report: * 5452f62be22a3f1b88f42d2273e0addefccbfe5e Azure:

[GitHub] [hudi] danny0405 commented on issue #6618: Caused by: org.apache.http.NoHttpResponseException: xxxxxx:34812 failed to respond[SUPPORT]

danny0405 commented on issue #6618: URL: https://github.com/apache/hudi/issues/6618#issuecomment-1306533233 Try the option `hoodie.filesystem.view.remote.retry.enable` which is introduced in 0.12.1, it expects to solve the problem. Feel free to reopen it if the problem still exists. --

  1   2   3   >