Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-16 Thread via GitHub
danny0405 merged PR #10090: URL: https://github.com/apache/hudi/pull/10090 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-16 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395358414 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java: ## @@ -410,10 +410,11 @@ public static DataStream hoodieStreamWrite(Confi

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-16 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1814020502 ## CI report: * 36d5e48d7b41740a2f94be92dd0fb45cbe4806de Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-16 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395347340 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java: ## @@ -410,10 +410,11 @@ public static DataStream hoodieStreamWrite(Confi

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
danny0405 commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395276883 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java: ## @@ -410,10 +410,11 @@ public static DataStream hoodieStreamWrite(Confi

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1813884740 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1813877522 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1813750327 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1813745573 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395108190 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSource.java: ## @@ -207,6 +207,7 @@ public DataStream produceDataStream(StreamExecu

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395108190 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSource.java: ## @@ -207,6 +207,7 @@ public DataStream produceDataStream(StreamExecu

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1813732678 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
danny0405 commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1395092204 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSource.java: ## @@ -207,6 +207,7 @@ public DataStream produceDataStream(StreamExecu

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1393827565 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java: ## @@ -348,7 +348,8 @@ private void cluster() throws E

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1393827565 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java: ## @@ -348,7 +348,8 @@ private void cluster() throws E

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
zhangyue19921010 commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1393819628 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java: ## @@ -348,7 +348,8 @@ private void cluster() t

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-15 Thread via GitHub
hehuiyuan commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811991136 Hi @danny0405 @zhangyue19921010 , ping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811965371 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811956986 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hehuiyuan commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811931479 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811903747 ## CI report: * 35219c2180342faea6e09987e69271508a3f0096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811770606 ## CI report: * 174ef08839274f360fecd7919a9d753634a901cc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1811766000 ## CI report: * 174ef08839274f360fecd7919a9d753634a901cc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
danny0405 commented on code in PR #10090: URL: https://github.com/apache/hudi/pull/10090#discussion_r1393518998 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java: ## @@ -348,7 +348,8 @@ private void cluster() throws E

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1810693200 ## CI report: * 174ef08839274f360fecd7919a9d753634a901cc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1810250031 ## CI report: * 174ef08839274f360fecd7919a9d753634a901cc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hudi-bot commented on PR #10090: URL: https://github.com/apache/hudi/pull/10090#issuecomment-1810236718 ## CI report: * 174ef08839274f360fecd7919a9d753634a901cc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hehuiyuan opened a new pull request, #10090: URL: https://github.com/apache/hudi/pull/10090 ### Change Logs The parallelism of singleton operator should be strictly controlled, which can avoid some problems caused by modifying parallelism through other means. For example:

Re: [PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hehuiyuan closed pull request #10089: [HUDI-7090]Set the maxParallelism for singleton operator URL: https://github.com/apache/hudi/pull/10089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[PR] [HUDI-7090]Set the maxParallelism for singleton operator [hudi]

2023-11-14 Thread via GitHub
hehuiyuan opened a new pull request, #10089: URL: https://github.com/apache/hudi/pull/10089 ### Change Logs The parallelism of singleton operator should be strictly controlled, which can avoid some problems caused by modifying parallelism through other means. For example: