[jira] [Updated] (SPARK-30531) Duplicate query plan on Spark UI SQL page

2020-01-20 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-30531: -- Affects Version/s: 2.4.4 > Duplicate query plan on Spark UI SQL page > ---

[jira] [Created] (SPARK-30593) Revert interval ISO/ANSI SQL Standard output since we decide not to follow ANSI and no round trip.

2020-01-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-30593: Summary: Revert interval ISO/ANSI SQL Standard output since we decide not to follow ANSI and no round trip. Key: SPARK-30593 URL: https://issues.apache.org/jira/browse/SPARK-30593

[jira] [Resolved] (SPARK-30021) set ownerName and owner type as reserved properties to support v2 catalog

2020-01-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-30021. -- Resolution: Won't Fix > set ownerName and owner type as reserved properties to support v2 catalog > --

[jira] [Created] (SPARK-30592) to_csv should not support output intervals as same as using CSV file format

2020-01-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-30592: Summary: to_csv should not support output intervals as same as using CSV file format Key: SPARK-30592 URL: https://issues.apache.org/jira/browse/SPARK-30592 Project: Spark

[jira] [Assigned] (SPARK-30587) Run test suites for CSV v1 and JSON v1

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30587: --- Assignee: Maxim Gekk > Run test suites for CSV v1 and JSON v1 > ---

[jira] [Resolved] (SPARK-30587) Run test suites for CSV v1 and JSON v1

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30587. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27294 [https://gith

[jira] [Resolved] (SPARK-30475) File source V2: Push data filters for file listing

2020-01-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30475. Assignee: Guy Khazma Resolution: Fixed This issue is resolved by https://github.com/

[jira] [Assigned] (SPARK-30568) Invalidate interval type as a field table schema

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30568: --- Assignee: Kent Yao > Invalidate interval type as a field table schema > ---

[jira] [Resolved] (SPARK-30568) Invalidate interval type as a field table schema

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30568. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27277 [https://gith

[jira] [Created] (SPARK-30591) Remove the nonstandard SET OWNER syntax for namespaces

2020-01-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-30591: Summary: Remove the nonstandard SET OWNER syntax for namespaces Key: SPARK-30591 URL: https://issues.apache.org/jira/browse/SPARK-30591 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-30019) Support ALTER TABLE SET OWNER syntax

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30019: --- Assignee: Kent Yao > Support ALTER TABLE SET OWNER syntax > ---

[jira] [Resolved] (SPARK-30019) Support ALTER TABLE SET OWNER syntax

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30019. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27249 [https://gith

[jira] [Updated] (SPARK-30590) can't use more than five type-safe user-defined aggregation in select statement

2020-01-20 Thread Daniel Mantovani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Mantovani updated SPARK-30590: - Description:  How to reproduce: {code:scala} val df = Seq((1,2,3,4,5,6)).toDF("a","b","c

[jira] [Created] (SPARK-30590) can't use more than five type-safe user-defined aggregation in select statement

2020-01-20 Thread Daniel Mantovani (Jira)
Daniel Mantovani created SPARK-30590: Summary: can't use more than five type-safe user-defined aggregation in select statement Key: SPARK-30590 URL: https://issues.apache.org/jira/browse/SPARK-30590

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

2020-01-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019770#comment-17019770 ] Bryan Cutler commented on SPARK-24915: -- [~jhereth] since there is already a lot of

[jira] [Created] (SPARK-30589) Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference.

2020-01-20 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-30589: Summary: Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference. Key: SPARK-30589 URL: https://issues.apache.org/jira/browse/SPARK-30589 Project: Spark

[jira] [Created] (SPARK-30588) Document CLUSTER BY Clause of SELECT statement in SQL Reference.

2020-01-20 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-30588: Summary: Document CLUSTER BY Clause of SELECT statement in SQL Reference. Key: SPARK-30588 URL: https://issues.apache.org/jira/browse/SPARK-30588 Project: Spark

[jira] [Resolved] (SPARK-30584) Non-synchronized methods override Synchronized methods

2020-01-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30584. -- Resolution: Not A Problem > Non-synchronized methods override Synchronized methods > -

[jira] [Created] (SPARK-30587) Run test suites for CSV v1 and JSON v1

2020-01-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30587: -- Summary: Run test suites for CSV v1 and JSON v1 Key: SPARK-30587 URL: https://issues.apache.org/jira/browse/SPARK-30587 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-30578) Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30578: --- Assignee: wuyi > Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite > ---

[jira] [Resolved] (SPARK-30578) Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30578. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27285 [https://gith

[jira] [Resolved] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30535. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27243 [https://gith

[jira] [Assigned] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

2020-01-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30535: --- Assignee: Terry Kim > Migrate ALTER TABLE commands to the new resolution framework > --

[jira] [Updated] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

2020-01-20 Thread Jan Van den bosch (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Van den bosch updated SPARK-30586: -- Description: We've been noticing a great amount of NullPointerExceptions in our long-r

[jira] [Created] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

2020-01-20 Thread Jan Van den bosch (Jira)
Jan Van den bosch created SPARK-30586: - Summary: NPE in LiveRDDDistribution (AppStatusListener) Key: SPARK-30586 URL: https://issues.apache.org/jira/browse/SPARK-30586 Project: Spark Issu

[jira] [Comment Edited] (SPARK-30542) Two Spark structured streaming jobs cannot write to same base path

2020-01-20 Thread Sivakumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017820#comment-17017820 ] Sivakumar edited comment on SPARK-30542 at 1/20/20 12:36 PM: -

[jira] [Commented] (SPARK-30585) scalatest fails for Apache Spark SQL project

2020-01-20 Thread Rashmi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019425#comment-17019425 ] Rashmi commented on SPARK-30585: - cte.sql - datetime.sql - describe-table-column.sql 03

[jira] [Resolved] (SPARK-30470) Uncache table in tempViews if needed on session closed

2020-01-20 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30470. -- Resolution: Duplicate > Uncache table in tempViews if needed on session closed > -

[jira] [Created] (SPARK-30585) scalatest fails for Apache Spark SQL project

2020-01-20 Thread Rashmi (Jira)
Rashmi created SPARK-30585: -- Summary: scalatest fails for Apache Spark SQL project Key: SPARK-30585 URL: https://issues.apache.org/jira/browse/SPARK-30585 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-30585) scalatest fails for Apache Spark SQL project

2020-01-20 Thread Rashmi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019335#comment-17019335 ] Rashmi commented on SPARK-30585: Trying to build Apache Spark on Power. > scalatest fai

[jira] [Created] (SPARK-30584) Non-synchronized methods override Synchronized methods

2020-01-20 Thread Aman Omer (Jira)
Aman Omer created SPARK-30584: - Summary: Non-synchronized methods override Synchronized methods Key: SPARK-30584 URL: https://issues.apache.org/jira/browse/SPARK-30584 Project: Spark Issue Type:

[jira] [Created] (SPARK-30583) Document LIMIT Clause of SELECT statement in SQL Reference.

2020-01-20 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-30583: Summary: Document LIMIT Clause of SELECT statement in SQL Reference. Key: SPARK-30583 URL: https://issues.apache.org/jira/browse/SPARK-30583 Project: Spark

[jira] [Updated] (SPARK-30582) Spark UI is not showing Aggregated Metrics by Executor in stage page

2020-01-20 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-30582: --- Attachment: SparkUIStagePage.mov > Spark UI is not showing Aggregated Metrics by Executor in

[jira] [Created] (SPARK-30582) Spark UI is not showing Aggregated Metrics by Executor in stage page

2020-01-20 Thread Saurabh Chawla (Jira)
Saurabh Chawla created SPARK-30582: -- Summary: Spark UI is not showing Aggregated Metrics by Executor in stage page Key: SPARK-30582 URL: https://issues.apache.org/jira/browse/SPARK-30582 Project: Spa

[jira] [Created] (SPARK-30581) Document SORT BY Clause of SELECT statement in SQL Reference.

2020-01-20 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-30581: Summary: Document SORT BY Clause of SELECT statement in SQL Reference. Key: SPARK-30581 URL: https://issues.apache.org/jira/browse/SPARK-30581 Project: Spark

[jira] [Created] (SPARK-30580) Why can PySpark persist data only in serialised format?

2020-01-20 Thread Francesco Cavrini (Jira)
Francesco Cavrini created SPARK-30580: - Summary: Why can PySpark persist data only in serialised format? Key: SPARK-30580 URL: https://issues.apache.org/jira/browse/SPARK-30580 Project: Spark