[jira] [Comment Edited] (SPARK-20415) SPARK job hangs while writing DataFrame to HDFS

2021-08-02 Thread Yu Gan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391259#comment-17391259 ] Yu Gan edited comment on SPARK-20415 at 8/2/21, 6:01 AM: - Did you find the root

[jira] [Commented] (SPARK-20415) SPARK job hangs while writing DataFrame to HDFS

2021-08-01 Thread Yu Gan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391259#comment-17391259 ] Yu Gan commented on SPARK-20415: Did you find the root cause? I came across the same issue in our azure

[jira] [Comment Edited] (SPARK-12741) DataFrame count method return wrong size.

2020-08-06 Thread Yu Gan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172226#comment-17172226 ] Yu Gan edited comment on SPARK-12741 at 8/6/20, 10:38 AM: -- Aha, I came across

[jira] [Comment Edited] (SPARK-12741) DataFrame count method return wrong size.

2020-08-06 Thread Yu Gan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172226#comment-17172226 ] Yu Gan edited comment on SPARK-12741 at 8/6/20, 10:38 AM: -- Aha, I came across

[jira] [Commented] (SPARK-12741) DataFrame count method return wrong size.

2020-08-06 Thread Yu Gan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172226#comment-17172226 ] Yu Gan commented on SPARK-12741: Aha, I came across the similar issue. My sql isĀ  select