[jira] [Resolved] (SPARK-30119) Support pagination for spark streaming tab

2020-06-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-30119. Fix Version/s: 3.1.0 Resolution: Fixed This issue is resolved in 

[jira] [Assigned] (SPARK-30119) Support pagination for spark streaming tab

2020-06-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-30119: -- Assignee: Rakesh Raushan > Support pagination for spark streaming tab >

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127444#comment-17127444 ] Apache Spark commented on SPARK-31923: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127443#comment-17127443 ] Apache Spark commented on SPARK-31923: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31923: Assignee: Apache Spark > Event log cannot be generated when some internal accumulators

[jira] [Assigned] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31923: Assignee: (was: Apache Spark) > Event log cannot be generated when some internal

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Description: A user may use internal accumulators by adding the "internal.metrics." prefix to

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Description: A user may use internal accumulators by adding the "internal.metrics." prefix to

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Description: A user may use internal accumulators by adding the "internal.metrics." prefix to

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Description: A user may use internal accumulators by adding the "internal.metrics." prefix to

[jira] [Created] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

2020-06-06 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-31923: Summary: Event log cannot be generated when some internal accumulators use unexpected types Key: SPARK-31923 URL: https://issues.apache.org/jira/browse/SPARK-31923

[jira] [Created] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0

2020-06-06 Thread Shivaram Venkataraman (Jira)
Shivaram Venkataraman created SPARK-31918: - Summary: SparkR CRAN check gives a warning with R 4.0.0 Key: SPARK-31918 URL: https://issues.apache.org/jira/browse/SPARK-31918 Project: Spark

[jira] [Updated] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

2020-06-06 Thread Shivaram Venkataraman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-31918: -- Summary: SparkR CRAN check gives a warning with R 4.0.0 on OSX (was: SparkR

[jira] [Created] (SPARK-31919) Push down more predicates through Join

2020-06-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-31919: -- Summary: Push down more predicates through Join Key: SPARK-31919 URL: https://issues.apache.org/jira/browse/SPARK-31919 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

2020-06-06 Thread Shuai Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127119#comment-17127119 ] Shuai Lu commented on SPARK-28594: -- Hi, [~kabhwan], are we planning to support this feature in Spark

[jira] [Updated] (SPARK-31922) TransportRequestHandler Error when exit spark-shell with local-cluster mode

2020-06-06 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31922: - Affects Version/s: 2.4.6 > TransportRequestHandler Error when exit spark-shell with local-cluster mode >

[jira] [Created] (SPARK-31920) Failure in converting pandas DataFrames with columns via Arrow

2020-06-06 Thread Stephen Caraher (Jira)
Stephen Caraher created SPARK-31920: --- Summary: Failure in converting pandas DataFrames with columns via Arrow Key: SPARK-31920 URL: https://issues.apache.org/jira/browse/SPARK-31920 Project: Spark

[jira] [Commented] (SPARK-29640) [K8S] Intermittent "java.net.UnknownHostException: kubernetes.default.svc" in Spark driver

2020-06-06 Thread Prabhakar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127234#comment-17127234 ] Prabhakar commented on SPARK-29640: --- Is there a way to explicitly configure the Kube API server Url?

[jira] [Updated] (SPARK-31920) Failure in converting pandas DataFrames with Arrow when columns implement __arrow_array__

2020-06-06 Thread Stephen Caraher (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Caraher updated SPARK-31920: Summary: Failure in converting pandas DataFrames with Arrow when columns implement

[jira] [Created] (SPARK-31922) TransportRequestHandler Error when exit spark-shell with local-cluster mode

2020-06-06 Thread wuyi (Jira)
wuyi created SPARK-31922: Summary: TransportRequestHandler Error when exit spark-shell with local-cluster mode Key: SPARK-31922 URL: https://issues.apache.org/jira/browse/SPARK-31922 Project: Spark

[jira] [Commented] (SPARK-31922) TransportRequestHandler Error when exit spark-shell with local-cluster mode

2020-06-06 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127370#comment-17127370 ] wuyi commented on SPARK-31922: -- I am working on this. > TransportRequestHandler Error when exit

[jira] [Resolved] (SPARK-31904) Char and varchar partition columns throw MetaException

2020-06-06 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31904. -- Fix Version/s: 3.0.0 Assignee: Lantao Jin Resolution: Fixed Resolved

[jira] [Commented] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127358#comment-17127358 ] Apache Spark commented on SPARK-31921: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31920) Failure in converting pandas DataFrames with Arrow when columns implement __arrow_array__

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31920: Assignee: Apache Spark > Failure in converting pandas DataFrames with Arrow when columns

[jira] [Commented] (SPARK-31920) Failure in converting pandas DataFrames with Arrow when columns implement __arrow_array__

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127366#comment-17127366 ] Apache Spark commented on SPARK-31920: -- User 'moskvax' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31920) Failure in converting pandas DataFrames with Arrow when columns implement __arrow_array__

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31920: Assignee: (was: Apache Spark) > Failure in converting pandas DataFrames with Arrow

[jira] [Commented] (SPARK-31920) Failure in converting pandas DataFrames with Arrow when columns implement __arrow_array__

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127365#comment-17127365 ] Apache Spark commented on SPARK-31920: -- User 'moskvax' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31921: Assignee: Apache Spark > Wrong warning of "WARN Master: App app-xxx requires more

[jira] [Assigned] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31921: Assignee: (was: Apache Spark) > Wrong warning of "WARN Master: App app-xxx requires

[jira] [Commented] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127357#comment-17127357 ] Apache Spark commented on SPARK-31921: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Updated] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31921: - Description: When starting spark-shell using local cluster mode, e.g. ./bin/spark-shell --master

[jira] [Created] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

2020-06-06 Thread wuyi (Jira)
wuyi created SPARK-31921: Summary: Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have." Key: SPARK-31921 URL: https://issues.apache.org/jira/browse/SPARK-31921

[jira] [Updated] (SPARK-31903) toPandas with Arrow enabled doesn't show metrics in Query UI.

2020-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31903: - Fix Version/s: 2.4.7 > toPandas with Arrow enabled doesn't show metrics in Query UI. >

[jira] [Assigned] (SPARK-31919) Push down more predicates through Join

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31919: Assignee: Apache Spark (was: Gengliang Wang) > Push down more predicates through Join >

[jira] [Commented] (SPARK-31919) Push down more predicates through Join

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127263#comment-17127263 ] Apache Spark commented on SPARK-31919: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-31919) Push down more predicates through Join

2020-06-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31919: Assignee: Gengliang Wang (was: Apache Spark) > Push down more predicates through Join >