[jira] [Updated] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

2019-08-31 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-23519: Component/s: (was: Spark Core) > Create View Commands Fails with The view output

[jira] [Commented] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

2019-08-31 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920302#comment-16920302 ] Liang-Chi Hsieh commented on SPARK-23519: - This was closed and then reopened and fixed. The

[jira] [Updated] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

2019-08-31 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-23519: Labels: (was: bulk-closed) > Create View Commands Fails with The view output

[jira] [Resolved] (SPARK-28612) DataSourceV2: Add new DataFrameWriter API for v2

2019-08-31 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-28612. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by 

[jira] [Assigned] (SPARK-28612) DataSourceV2: Add new DataFrameWriter API for v2

2019-08-31 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-28612: --- Assignee: Ryan Blue > DataSourceV2: Add new DataFrameWriter API for v2 >

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

2019-08-31 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920234#comment-16920234 ] Wing Yew Poon commented on SPARK-28770: --- I looked into the issue further. In EventLoggingListener,

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920227#comment-16920227 ] Dongjoon Hyun commented on SPARK-28921: --- BTW, [~andygrove]. I tried to add your PR to this, but it

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920226#comment-16920226 ] Dongjoon Hyun commented on SPARK-28921: --- [~psschwei] and [~andygrove]. BTW, do you know how many

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28921: -- Priority: Major (was: Critical) > Spark jobs failing on latest versions of Kubernetes

[jira] [Created] (SPARK-28938) Kubernetes using unsupported docker image

2019-08-31 Thread Rodney Aaron Stainback (Jira)
Rodney Aaron Stainback created SPARK-28938: -- Summary: Kubernetes using unsupported docker image Key: SPARK-28938 URL: https://issues.apache.org/jira/browse/SPARK-28938 Project: Spark

[jira] [Resolved] (SPARK-28803) Document DESCRIBE TABLE in SQL Reference.

2019-08-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28803. - Fix Version/s: 3.0.0 Assignee: Dilip Biswal Resolution: Fixed > Document DESCRIBE TABLE

[jira] [Commented] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2019-08-31 Thread Ruben Berenguel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920213#comment-16920213 ] Ruben Berenguel commented on SPARK-25994: - Hi [~mju], I’ve had a series of unforeseen increases

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

2019-08-31 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920212#comment-16920212 ] Wing Yew Poon commented on SPARK-28770: --- On my branch from which

[jira] [Updated] (SPARK-27907) HiveUDAF should return NULL in case of 0 rows

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27907: -- Labels: correctness (was: ) > HiveUDAF should return NULL in case of 0 rows >

[jira] [Updated] (SPARK-28871) Some codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28871: -- Labels: (was: documentation) > Some codes in 'Policy for handling multiple watermarks' does

[jira] [Updated] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28542: -- Fix Version/s: 3.0.0 > Document Stages page > > > Key:

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Fix Version/s: (was: 3.0.0) Assignee: (was: Pablo Langa Blanco)

[jira] [Resolved] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28542. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25598

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Assignee: Pablo Langa Blanco > Document Stages page > > >

[jira] [Resolved] (SPARK-28932) Maven install fails on JDK11

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28932. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25638

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920153#comment-16920153 ] Marco Gaido commented on SPARK-28916: - I think the problem is related to subexpression elimination.

[jira] [Updated] (SPARK-28864) Add spark source connector for Aliyun Log Service

2019-08-31 Thread Ke Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Li updated SPARK-28864: -- Description: Alibaba Log Service is a big data service which has been widely used in Alibaba Group and 

[jira] [Resolved] (SPARK-28903) Fix AWS JDK version conflict that breaks Pyspark Kinesis tests

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28903. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

2019-08-31 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920133#comment-16920133 ] Andy Grove commented on SPARK-28921: Here's a PR to fix against master branch since it didn't

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920074#comment-16920074 ] Marco Gaido commented on SPARK-28916: - Thanks for reporting this. I am checking it. > Generated

[jira] [Commented] (SPARK-28934) Add `spark.sql.compatiblity.mode`

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920072#comment-16920072 ] Marco Gaido commented on SPARK-28934: - Hi [~smilegator]! Thanks for opening this. I am wondering

[jira] [Updated] (SPARK-28908) Structured Streaming Kafka sink support Exactly-Once semantics

2019-08-31 Thread wenxuanguan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenxuanguan updated SPARK-28908: Attachment: (was: Kafka Sink Exactly-Once Semantics Design Sketch.pdf) > Structured Streaming

[jira] [Updated] (SPARK-28908) Structured Streaming Kafka sink support Exactly-Once semantics

2019-08-31 Thread wenxuanguan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenxuanguan updated SPARK-28908: Attachment: Kafka Sink Exactly-Once Semantics Design Sketch V1.pdf > Structured Streaming Kafka

[jira] [Updated] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network

2019-08-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28778: -- Fix Version/s: 2.4.5 > Shuffle jobs fail due to incorrect advertised address when running in