[jira] [Created] (SPARK-30364) The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le

2019-12-27 Thread AK97 (Jira)
AK97 created SPARK-30364: Summary: The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le Key: SPARK-30364 URL: https://issues.apache.org/jira/browse/SPARK-30364 Project: Spark Issue

[jira] [Updated] (SPARK-30364) The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le

2019-12-27 Thread AK97 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AK97 updated SPARK-30364: - Description: I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the spark-streaming-kaf

[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2019-12-27 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004146#comment-17004146 ] Izek Greenfield commented on SPARK-30332: - The task failed, do not get any resul

[jira] [Created] (SPARK-30365) When deploy mode is a client, why doesn't it support remote "spark.files" download?

2019-12-27 Thread wangzhun (Jira)
wangzhun created SPARK-30365: Summary: When deploy mode is a client, why doesn't it support remote "spark.files" download? Key: SPARK-30365 URL: https://issues.apache.org/jira/browse/SPARK-30365 Project:

[jira] [Assigned] (SPARK-30356) Codegen support for the function str_to_map

2019-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30356: --- Assignee: Kent Yao > Codegen support for the function str_to_map >

[jira] [Resolved] (SPARK-30356) Codegen support for the function str_to_map

2019-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30356. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27013 [https://gith

[jira] [Resolved] (SPARK-30304) When the specified shufflemanager is incorrect, print the prompt.

2019-12-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30304. -- Resolution: Won't Fix > When the specified shufflemanager is incorrect, print the prompt. > --

[jira] [Commented] (SPARK-29596) Task duration not updating for running tasks

2019-12-27 Thread daile (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004261#comment-17004261 ] daile commented on SPARK-29596: --- [~hyukjin.kwon]  I checked the problem and reproduced in

[jira] [Created] (SPARK-30366) Remove Redundant Information for InMemoryTableScan in SQL UI

2019-12-27 Thread Max Thompson (Jira)
Max Thompson created SPARK-30366: Summary: Remove Redundant Information for InMemoryTableScan in SQL UI Key: SPARK-30366 URL: https://issues.apache.org/jira/browse/SPARK-30366 Project: Spark

[jira] [Created] (SPARK-30367) De-duplicate InMemoryTableScan cached plans in SQL UI

2019-12-27 Thread Max Thompson (Jira)
Max Thompson created SPARK-30367: Summary: De-duplicate InMemoryTableScan cached plans in SQL UI Key: SPARK-30367 URL: https://issues.apache.org/jira/browse/SPARK-30367 Project: Spark Issue T

[jira] [Updated] (SPARK-30367) De-duplicate InMemoryTableScan cached plans in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30367: - Attachment: duplicated-imr.png > De-duplicate InMemoryTableScan cached plans in SQL UI > ---

[jira] [Updated] (SPARK-30367) De-duplicate InMemoryTableScan cached plans in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30367: - Description: This is a follow-up JIRA for: https://issues.apache.org/jira/browse/SPARK-29431 Cu

[jira] [Updated] (SPARK-30367) De-duplicate InMemoryTableScan cached plans in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30367: - Attachment: deduplicated-imr.png > De-duplicate InMemoryTableScan cached plans in SQL UI > -

[jira] [Updated] (SPARK-30368) Add computed rows metric to InMemoryRelation and show in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30368: - Attachment: w-metric.png > Add computed rows metric to InMemoryRelation and show in SQL UI > ---

[jira] [Created] (SPARK-30368) Add computed rows metric to InMemoryRelation and show in SQL UI

2019-12-27 Thread Max Thompson (Jira)
Max Thompson created SPARK-30368: Summary: Add computed rows metric to InMemoryRelation and show in SQL UI Key: SPARK-30368 URL: https://issues.apache.org/jira/browse/SPARK-30368 Project: Spark

[jira] [Updated] (SPARK-30368) Add computed rows metric to InMemoryRelation and show in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30368: - Description: This is a follow-up JIRA for: https://issues.apache.org/jira/browse/SPARK-30367 We

[jira] [Created] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
Max Thompson created SPARK-30369: Summary: Prune uncomputed children of InMemoryRelation Key: SPARK-30369 URL: https://issues.apache.org/jira/browse/SPARK-30369 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30369: - Description: This is a follow-up JIRA for: [De-duplicate InMemoryTableScan cached plans in SQL

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30369: - Attachment: unpruned.png > Prune uncomputed children of InMemoryRelation > -

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30369: - Attachment: pruned.png > Prune uncomputed children of InMemoryRelation > ---

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30369: - Description: This is a follow-up JIRA for: [De-duplicate InMemoryTableScan cached plans in SQL

[jira] [Resolved] (SPARK-29013) Structurally equivalent subexpression elimination

2019-12-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-29013. - Resolution: Won't Fix > Structurally equivalent subexpression elimination >

[jira] [Commented] (SPARK-30366) Remove Redundant Information for InMemoryTableScan in SQL UI

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004310#comment-17004310 ] Max Thompson commented on SPARK-30366: -- Requesting myself as the assignee for all i

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

2019-12-27 Thread Max Thompson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Thompson updated SPARK-30369: - Description: This is a follow-up JIRA for: https://issues.apache.org/jira/browse/SPARK-30367 Cu

[jira] [Commented] (SPARK-24122) Allow automatic driver restarts on K8s

2019-12-27 Thread jinxing (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004323#comment-17004323 ] jinxing commented on SPARK-24122: - I am all in on true native k8s support for spark.  u

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

2019-12-27 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004360#comment-17004360 ] Takeshi Yamamuro commented on SPARK-27764: -- ok, I'll clean up later. > Feature

[jira] [Commented] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

2019-12-27 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004361#comment-17004361 ] Takeshi Yamamuro commented on SPARK-27878: -- nvm, its ok just to reopen if we re

[jira] [Created] (SPARK-30370) Update SqlBase.g4 to combine namespace and database tokens.

2019-12-27 Thread Terry Kim (Jira)
Terry Kim created SPARK-30370: - Summary: Update SqlBase.g4 to combine namespace and database tokens. Key: SPARK-30370 URL: https://issues.apache.org/jira/browse/SPARK-30370 Project: Spark Issue

[jira] [Resolved] (SPARK-28670) [UDF] create permanent UDF does not throw Exception if jar does not exist in HDFS path or Local

2019-12-27 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28670. -- Fix Version/s: 3.0.0 Assignee: Sandeep Katta Resolution: Fixed Resolve

[jira] [Updated] (SPARK-29947) Improve ResolveRelations performance

2019-12-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Summary: Improve ResolveRelations performance (was: Improve ResolveRelations and ResolveTables pe