[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114967#comment-17114967 ] Yanjia Gary Li commented on HUDI-494: - [~shivnarayan] this is still under review.

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108204#comment-17108204 ] sivabalan narayanan commented on HUDI-494: -- Assigning the ticket to lamber ken. But Gary Li : feel

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105240#comment-17105240 ] lamber-ken commented on HUDI-494: - Seems a bug, we can discuss these in depth. > [DEBUGGING] Huge amount

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101207#comment-17101207 ] Yanjia Gary Li commented on HUDI-494: -   Commit 1: {code:java} "partitionToWriteStats" : {

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101055#comment-17101055 ] Yanjia Gary Li commented on HUDI-494: - Ok, I see what happened here. Root cause is 

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100967#comment-17100967 ] Yanjia Gary Li commented on HUDI-494: - Hi folks, this issue seems coming back again...

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010909#comment-17010909 ] Vinoth Chandar commented on HUDI-494: - > path 

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010031#comment-17010031 ] Yanjia Gary Li commented on HUDI-494: - [~vinoth] Thanks for the feedback. The code snippets were

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009181#comment-17009181 ] Vinoth Chandar commented on HUDI-494: - Can you please (atleast) partial listing of

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009180#comment-17009180 ] Vinoth Chandar commented on HUDI-494: - [~garyli1019] Thanks for reporting this.  if you notice, the

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008199#comment-17008199 ] Yanjia Gary Li commented on HUDI-494: - Hello [~lamber-ken], Thanks for trying this out. This behavior

[jira] [Commented] (HUDI-494) [DEBUGGING] Huge amount of tasks when writing files into HDFS

[ https://issues.apache.org/jira/browse/HUDI-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008189#comment-17008189 ] lamber-ken commented on HUDI-494: - hi [~garyli1019], I guess your dataset contains many partitions, you can