[jira] [Resolved] (SPARK-24185) add flatten function

2018-05-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24185. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21244 [https://git

[jira] [Assigned] (SPARK-24185) add flatten function

2018-05-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24185: Assignee: Huaxin Gao > add flatten function > - > > K

[jira] [Updated] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-05-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23390: -- Description: We're seeing multiple failures in {{FileBasedDataSourceSuite}} in {{spark-branch-

[jira] [Assigned] (SPARK-24185) add flatten function

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24185: Assignee: Apache Spark > add flatten function > - > >

[jira] [Assigned] (SPARK-24185) add flatten function

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24185: Assignee: (was: Apache Spark) > add flatten function > - > >

[jira] [Commented] (SPARK-24185) add flatten function

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464932#comment-16464932 ] Apache Spark commented on SPARK-24185: -- User 'huaxingao' has created a pull request

[jira] [Updated] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread spark_user (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] spark_user updated SPARK-24191: --- Description: We need to provide an example code for Power Iteration Clustering in Spark ML examples.

[jira] [Updated] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread spark_user (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] spark_user updated SPARK-24191: --- Description: We need to provide an example code for Power Iteration Clustering, under examples/ of S

[jira] [Issue Comment Deleted] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread spark_user (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] spark_user updated SPARK-24191: --- Comment: was deleted (was: I have created a PR https://github.com/apache/spark/pull/21248) > SparkML

[jira] [Commented] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464904#comment-16464904 ] Apache Spark commented on SPARK-24191: -- User 'shahidki31' has created a pull request

[jira] [Assigned] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24191: Assignee: Apache Spark > SparkML: Example code for Power Iteration Clustering > -

[jira] [Commented] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread spark_user (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464905#comment-16464905 ] spark_user commented on SPARK-24191: I have created a PR https://github.com/apache/sp

[jira] [Assigned] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24191: Assignee: (was: Apache Spark) > SparkML: Example code for Power Iteration Clustering

[jira] [Created] (SPARK-24191) SparkML: Example code for Power Iteration Clustering

2018-05-05 Thread spark_user (JIRA)
spark_user created SPARK-24191: -- Summary: SparkML: Example code for Power Iteration Clustering Key: SPARK-24191 URL: https://issues.apache.org/jira/browse/SPARK-24191 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23703) Collapse sequential watermarks

2018-05-05 Thread Jose Torres (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464853#comment-16464853 ] Jose Torres commented on SPARK-23703: - Up to you. It might be worth asking if there a

[jira] [Assigned] (SPARK-24190) lineSep shouldn't be required in JSON write

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24190: Assignee: Apache Spark > lineSep shouldn't be required in JSON write > ---

[jira] [Commented] (SPARK-24190) lineSep shouldn't be required in JSON write

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464837#comment-16464837 ] Apache Spark commented on SPARK-24190: -- User 'MaxGekk' has created a pull request fo

[jira] [Assigned] (SPARK-24190) lineSep shouldn't be required in JSON write

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24190: Assignee: (was: Apache Spark) > lineSep shouldn't be required in JSON write >

[jira] [Created] (SPARK-24190) lineSep shouldn't be required in JSON write

2018-05-05 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-24190: -- Summary: lineSep shouldn't be required in JSON write Key: SPARK-24190 URL: https://issues.apache.org/jira/browse/SPARK-24190 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464802#comment-16464802 ] bharath kumar avusherla edited comment on SPARK-24189 at 5/5/18 3:40 PM: --

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464802#comment-16464802 ] bharath kumar avusherla commented on SPARK-24189: - Yup. I have added abov

[jira] [Assigned] (SPARK-23901) Data Masking Functions

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23901: Assignee: Apache Spark > Data Masking Functions > -- > >

[jira] [Assigned] (SPARK-23901) Data Masking Functions

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23901: Assignee: (was: Apache Spark) > Data Masking Functions > -- > >

[jira] [Commented] (SPARK-23901) Data Masking Functions

2018-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464801#comment-16464801 ] Apache Spark commented on SPARK-23901: -- User 'mgaido91' has created a pull request f

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464798#comment-16464798 ] Marco Gaido commented on SPARK-24189: - You need to add also: {code} org.apache.kafk

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464795#comment-16464795 ] bharath kumar avusherla commented on SPARK-24189: - [~mgaido] I'm using be

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464788#comment-16464788 ] Marco Gaido commented on SPARK-24189: - [~abharath9] how are you submitting this appli

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464781#comment-16464781 ] bharath kumar avusherla edited comment on SPARK-24189 at 5/5/18 2:23 PM: --

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464781#comment-16464781 ] bharath kumar avusherla commented on SPARK-24189: - I have tried both ways

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

2018-05-05 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464700#comment-16464700 ] Marco Gaido commented on SPARK-24189: - all kafka option should be set with the prefix