[jira] [Commented] (SPARK-39752) Spark job failed with 10M rows data with Broken pipe error

2022-09-05 Thread Iqbal Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600543#comment-17600543 ] Iqbal Singh commented on SPARK-39752: - [~sshukla05] , Could you please provide the stack trace for

[jira] [Commented] (SPARK-39671) insert overwrite table java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.loadPartition .This problem occurred when we installed Apache Spark3.0.

2022-09-05 Thread Iqbal Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600541#comment-17600541 ] Iqbal Singh commented on SPARK-39671: - Is there a way to reproduce it, or is this something specific

[jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2019-03-01 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781879#comment-16781879 ] Iqbal Singh commented on SPARK-24295: - Agree, [~kabhwan]. It's very tricky to purge metadata as it

[jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-10-04 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638635#comment-16638635 ] Iqbal Singh commented on SPARK-24295: - hey [~XuanYuan],  DO we have any plans of pulling this one

[jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-07-16 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545577#comment-16545577 ] Iqbal Singh commented on SPARK-24295: - Hey [~XuanYuan], We are processing 3000 files every 5

[jira] [Updated] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-06-19 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iqbal Singh updated SPARK-24295: Priority: Major (was: Minor) > Purge Structured streaming FileStreamSinkLog metadata compact

[jira] [Updated] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-06-19 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iqbal Singh updated SPARK-24295: Issue Type: Bug (was: Wish) > Purge Structured streaming FileStreamSinkLog metadata compact file

[jira] [Updated] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-05-16 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iqbal Singh updated SPARK-24295: Priority: Minor (was: Major) > Purge Structured streaming FileStreamSinkLog metadata compact file

[jira] [Updated] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-05-16 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iqbal Singh updated SPARK-24295: Issue Type: Wish (was: Bug) > Purge Structured streaming FileStreamSinkLog metadata compact file

[jira] [Created] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-05-16 Thread Iqbal Singh (JIRA)
Iqbal Singh created SPARK-24295: --- Summary: Purge Structured streaming FileStreamSinkLog metadata compact file data. Key: SPARK-24295 URL: https://issues.apache.org/jira/browse/SPARK-24295 Project: