[jira] [Closed] (SPARK-18855) Add RDD flatten function

[ https://issues.apache.org/jira/browse/SPARK-18855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo closed SPARK-18855. - Resolution: Unresolved > Add RDD flatten function > > > Key: SPARK-18855

[jira] [Commented] (SPARK-18855) Add RDD flatten function

[ https://issues.apache.org/jira/browse/SPARK-18855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15753120#comment-15753120 ] Linbo commented on SPARK-18855: --- Tried several ways, the more "Spark" way is trying to crea

[jira] [Updated] (SPARK-18855) Add RDD flatten function

[ https://issues.apache.org/jira/browse/SPARK-18855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-18855: -- Target Version/s: (was: 2.1.0) > Add RDD flatten function > > > Key:

[jira] [Created] (SPARK-18855) Add RDD flatten function

Linbo created SPARK-18855: - Summary: Add RDD flatten function Key: SPARK-18855 URL: https://issues.apache.org/jira/browse/SPARK-18855 Project: Spark Issue Type: New Feature Components: Spar

[jira] [Commented] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

[ https://issues.apache.org/jira/browse/SPARK-17957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15579294#comment-15579294 ] Linbo commented on SPARK-17957: --- Thank you! > Calling outer join and na.fill(0) and then i

[jira] [Comment Edited] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

[ https://issues.apache.org/jira/browse/SPARK-17957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15579142#comment-15579142 ] Linbo edited comment on SPARK-17957 at 10/16/16 2:26 AM: - cc [~sm

[jira] [Commented] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

[ https://issues.apache.org/jira/browse/SPARK-17957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15579142#comment-15579142 ] Linbo commented on SPARK-17957: --- cc [~smilegator] > Calling outer join and na.fill(0) and

[jira] [Updated] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

[ https://issues.apache.org/jira/browse/SPARK-17957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-17957: -- Description: I reported a similar bug two months ago and it's fixed in Spark 2.0.1: https://issues.apache.org/

[jira] [Created] (SPARK-17957) Calling outer join and na.fill(0) and then inner join will miss rows

Linbo created SPARK-17957: - Summary: Calling outer join and na.fill(0) and then inner join will miss rows Key: SPARK-17957 URL: https://issues.apache.org/jira/browse/SPARK-17957 Project: Spark Issue

[jira] [Updated] (SPARK-17060) Call inner join after outer join will miss rows with null values

[ https://issues.apache.org/jira/browse/SPARK-17060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-17060: -- Description: {code:title=test.scala|borderStyle=solid} scala> val df1 = sc.parallelize(Seq((1, 2, 3), (3, 3, 3)

[jira] [Created] (SPARK-17060) Call inner join after outer join will miss rows with null values

Linbo created SPARK-17060: - Summary: Call inner join after outer join will miss rows with null values Key: SPARK-17060 URL: https://issues.apache.org/jira/browse/SPARK-17060 Project: Spark Issue Typ

[jira] [Updated] (SPARK-15282) UDF executed twice when filter on new column created by withColumn and the final value may be not correct

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Summary: UDF executed twice when filter on new column created by withColumn and the final value may be not corr

[jira] [Comment Edited] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297569#comment-15297569 ] Linbo edited comment on SPARK-15282 at 5/24/16 2:56 AM: Hi [~dong

[jira] [Commented] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297569#comment-15297569 ] Linbo commented on SPARK-15282: --- Hi [~dongjoon]Dongjoon Hyun, I removed the link and also a

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: (was: Screen Shot 2016-05-22 at 22.19.24.png) > UDF function executed twice when filter on new

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: (was: Screen Shot 2016-05-22 at 22.18.02.png) > UDF function executed twice when filter on new

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: Screen Shot 2016-05-22 at 22.18.02.png Screen Shot 2016-05-22 at 22.19.24.png > UDF

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Commented] (SPARK-13773) UDF being applied to filtered data

[ https://issues.apache.org/jira/browse/SPARK-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296052#comment-15296052 ] Linbo commented on SPARK-13773: --- See this pr: https://github.com/apache/spark/pull/13087 >

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Summary: UDF function executed twice when filter on new column created by withColumn (was: UDF functioin execu

[jira] [Commented] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281374#comment-15281374 ] Linbo commented on SPARK-15282: --- [~marmbrus] Any suggestion? > UDF functioin executed twi

[jira] [Commented] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281075#comment-15281075 ] Linbo commented on SPARK-15282: --- There is a related JIRA issue: https://issues.apache.org/

[jira] [Updated] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Created] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

Linbo created SPARK-15282: - Summary: UDF functioin executed twice when filter on new column created by withColumn Key: SPARK-15282 URL: https://issues.apache.org/jira/browse/SPARK-15282 Project: Spark

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:37 AM: Inside or

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:34 AM: Inside or

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:33 AM: Inside or

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:33 AM: Inside or

[jira] [Commented] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo commented on SPARK-13341: --- Inside org.apache.spark.sql.catalyst.expressions.Cast, the

[jira] [Commented] (SPARK-8360) Streaming DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15158377#comment-15158377 ] Linbo commented on SPARK-8360: -- Spark 2.0 on April/May > Streaming DataFrames >