[jira] [Commented] (SPARK-15282) UDF executed twice when filter on new column created by withColumn and the final value may be not correct

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297719#comment-15297719 ] Dongjoon Hyun commented on SPARK-15282: --- Thank you, @Linbo. My approaches (defining ScalaUDF

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297714#comment-15297714 ] Miao Wang commented on SPARK-15439: --- I am still investigating the errors. Now, I see new errors without

[jira] [Commented] (SPARK-15450) Clean up SparkSession builder for python

[ https://issues.apache.org/jira/browse/SPARK-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297670#comment-15297670 ] Sandeep Singh commented on SPARK-15450: --- [~andrewor14] Do you mind If I work on this ? > Clean up

[jira] [Assigned] (SPARK-15498) fix slow tests

[ https://issues.apache.org/jira/browse/SPARK-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15498: Assignee: Apache Spark (was: Wenchen Fan) > fix slow tests > -- > >

[jira] [Assigned] (SPARK-15498) fix slow tests

[ https://issues.apache.org/jira/browse/SPARK-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15498: Assignee: Wenchen Fan (was: Apache Spark) > fix slow tests > -- > >

[jira] [Commented] (SPARK-15498) fix slow tests

[ https://issues.apache.org/jira/browse/SPARK-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297665#comment-15297665 ] Apache Spark commented on SPARK-15498: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-15498) fix slow tests

Wenchen Fan created SPARK-15498: --- Summary: fix slow tests Key: SPARK-15498 URL: https://issues.apache.org/jira/browse/SPARK-15498 Project: Spark Issue Type: Improvement Components:

[jira] [Resolved] (SPARK-15285) Generated SpecificSafeProjection.apply method grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15285. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13243

[jira] [Resolved] (SPARK-15485) Spark SQL Configuration

[ https://issues.apache.org/jira/browse/SPARK-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15485. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Spark SQL

[jira] [Comment Edited] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296743#comment-15296743 ] Kazuaki Ishizaki edited comment on SPARK-15467 at 5/24/16 3:54 AM: --- The

[jira] [Commented] (SPARK-15329) When start spark with yarn: spark.SparkContext: Error initializing SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297604#comment-15297604 ] Vijay Parmar commented on SPARK-15329: -- 1. For WARN util.NativeCodeLoader: Unable to load

[jira] [Comment Edited] (SPARK-15329) When start spark with yarn: spark.SparkContext: Error initializing SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297604#comment-15297604 ] Vijay Parmar edited comment on SPARK-15329 at 5/24/16 3:35 AM: --- 1. For WARN

[jira] [Created] (SPARK-15497) DecisionTreeClassificationModel can't be saved within in Pipeline caused by not implement Writable

lichenglin created SPARK-15497: -- Summary: DecisionTreeClassificationModel can't be saved within in Pipeline caused by not implement Writable Key: SPARK-15497 URL: https://issues.apache.org/jira/browse/SPARK-15497

[jira] [Updated] (SPARK-15282) UDF executed twice when filter on new column created by withColumn and the final value may be not correct

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Summary: UDF executed twice when filter on new column created by withColumn and the final value may be not

[jira] [Comment Edited] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297569#comment-15297569 ] Linbo edited comment on SPARK-15282 at 5/24/16 2:56 AM: Hi [~dongjoon], I removed

[jira] [Commented] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297569#comment-15297569 ] Linbo commented on SPARK-15282: --- Hi [~dongjoon]Dongjoon Hyun, I removed the link and also add more detail

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: (was: Screen Shot 2016-05-22 at 22.19.24.png) > UDF function executed twice when filter on new

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: (was: Screen Shot 2016-05-22 at 22.18.02.png) > UDF function executed twice when filter on new

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Attachment: Screen Shot 2016-05-22 at 22.18.02.png Screen Shot 2016-05-22 at 22.19.24.png >

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Commented] (SPARK-15044) spark-sql will throw "input path does not exist" exception if it handles a partition which exists in hive table, but the path is removed manually

[ https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297540#comment-15297540 ] lichenglin commented on SPARK-15044: This exception is caused by “the HiveContext cache the metadata

[jira] [Commented] (SPARK-15451) Spark PR builder should fail if code doesn't compile against JDK 7

[ https://issues.apache.org/jira/browse/SPARK-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297544#comment-15297544 ] Apache Spark commented on SPARK-15451: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15451) Spark PR builder should fail if code doesn't compile against JDK 7

[ https://issues.apache.org/jira/browse/SPARK-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15451: Assignee: Apache Spark > Spark PR builder should fail if code doesn't compile against JDK

[jira] [Assigned] (SPARK-15451) Spark PR builder should fail if code doesn't compile against JDK 7

[ https://issues.apache.org/jira/browse/SPARK-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15451: Assignee: (was: Apache Spark) > Spark PR builder should fail if code doesn't compile

[jira] [Updated] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linbo updated SPARK-15282: -- Description: I found this problem on spark version 1.6.1 and based on [~tedyu] in current master branch, the

[jira] [Resolved] (SPARK-15496) Spill metrics not updated when off-heap memory is enabled

[ https://issues.apache.org/jira/browse/SPARK-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang resolved SPARK-15496. Resolution: Fixed Fix Version/s: 2.0.0 Ah, actually the reproduction was incorrect. This

[jira] [Created] (SPARK-15496) Spill metrics not updated when off-heap memory is enabled

Eric Liang created SPARK-15496: -- Summary: Spill metrics not updated when off-heap memory is enabled Key: SPARK-15496 URL: https://issues.apache.org/jira/browse/SPARK-15496 Project: Spark Issue

[jira] [Commented] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

[ https://issues.apache.org/jira/browse/SPARK-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297489#comment-15297489 ] Liwei Lin commented on SPARK-15315: --- Hi [~cloud_fan], maybe as a credit we should assign this to

[jira] [Assigned] (SPARK-15495) Improve the output of explain for aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15495: Assignee: (was: Apache Spark) > Improve the output of explain for aggregate operator

[jira] [Assigned] (SPARK-15495) Improve the output of explain for aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15495: Assignee: Apache Spark > Improve the output of explain for aggregate operator >

[jira] [Commented] (SPARK-15495) Improve the output of explain for aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297488#comment-15297488 ] Apache Spark commented on SPARK-15495: -- User 'clockfly' has created a pull request for this issue:

[jira] [Created] (SPARK-15495) Improve the output of explain for aggregate operator

Sean Zhong created SPARK-15495: -- Summary: Improve the output of explain for aggregate operator Key: SPARK-15495 URL: https://issues.apache.org/jira/browse/SPARK-15495 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsuites

[ https://issues.apache.org/jira/browse/SPARK-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15464. --- Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15311. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target

[jira] [Commented] (SPARK-15491) JSON serializations fails for JDBC DataFrames

[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297466#comment-15297466 ] Marc Prud'hommeaux commented on SPARK-15491: I'm guessing the problem is coming from the

[jira] [Comment Edited] (SPARK-15491) JSON serializations fails for JDBC DataFrames

[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297466#comment-15297466 ] Marc Prud'hommeaux edited comment on SPARK-15491 at 5/24/16 1:01 AM: -

[jira] [Commented] (SPARK-15269) Creating external table leaves empty directory under warehouse directory

[ https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297446#comment-15297446 ] Apache Spark commented on SPARK-15269: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

[ https://issues.apache.org/jira/browse/SPARK-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15431: --- Assignee: Xin Wu > Support LIST FILE(s)|JAR(s) command natively >

[jira] [Resolved] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

[ https://issues.apache.org/jira/browse/SPARK-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15431. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13212

[jira] [Resolved] (SPARK-15455) For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes

[ https://issues.apache.org/jira/browse/SPARK-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15455. -- Resolution: Won't Fix > For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop

[jira] [Commented] (SPARK-15455) For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes

[ https://issues.apache.org/jira/browse/SPARK-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297409#comment-15297409 ] Yin Huai commented on SPARK-15455: -- I am closing this JIRA as "Won't Fix". Please see

[jira] [Commented] (SPARK-15269) Creating external table leaves empty directory under warehouse directory

[ https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297408#comment-15297408 ] Cheng Lian commented on SPARK-15269: Two facts make this issue pretty hard to be fixed cleanly: #

[jira] [Updated] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

[ https://issues.apache.org/jira/browse/SPARK-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15315: Assignee: Wenchen Fan > CSV datasource writes garbage for complex types instead of rasing error.

[jira] [Updated] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

[ https://issues.apache.org/jira/browse/SPARK-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15315: Assignee: (was: Wenchen Fan) > CSV datasource writes garbage for complex types instead of

[jira] [Resolved] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

[ https://issues.apache.org/jira/browse/SPARK-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15315. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13105

[jira] [Commented] (SPARK-15494) encoder code cleanup

[ https://issues.apache.org/jira/browse/SPARK-15494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297390#comment-15297390 ] Apache Spark commented on SPARK-15494: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15494) encoder code cleanup

[ https://issues.apache.org/jira/browse/SPARK-15494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15494: Assignee: Wenchen Fan (was: Apache Spark) > encoder code cleanup >

[jira] [Assigned] (SPARK-15494) encoder code cleanup

[ https://issues.apache.org/jira/browse/SPARK-15494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15494: Assignee: Apache Spark (was: Wenchen Fan) > encoder code cleanup >

[jira] [Commented] (SPARK-15491) JSON serializations fails for JDBC DataFrames

[ https://issues.apache.org/jira/browse/SPARK-15491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297385#comment-15297385 ] Marc Prud'hommeaux commented on SPARK-15491: Putting in some debug statements shows above the

[jira] [Created] (SPARK-15494) encoder code cleanup

Wenchen Fan created SPARK-15494: --- Summary: encoder code cleanup Key: SPARK-15494 URL: https://issues.apache.org/jira/browse/SPARK-15494 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12071: Assignee: Apache Spark > Programming guide should explain NULL in JVM translate to NA in

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297311#comment-15297311 ] Apache Spark commented on SPARK-12071: -- User 'krishnakalyan3' has created a pull request for this

[jira] [Assigned] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12071: Assignee: (was: Apache Spark) > Programming guide should explain NULL in JVM

[jira] [Commented] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297282#comment-15297282 ] Cheng Lian commented on SPARK-14343: Seems that we were reading from the wrong column, and happened

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297245#comment-15297245 ] Shivaram Venkataraman commented on SPARK-12071: --- You can add it under the migration guide

[jira] [Assigned] (SPARK-15493) Allow setting the quoteEscapingEnabled flag when writing CSV

[ https://issues.apache.org/jira/browse/SPARK-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15493: Assignee: Apache Spark > Allow setting the quoteEscapingEnabled flag when writing CSV >

[jira] [Commented] (SPARK-15493) Allow setting the quoteEscapingEnabled flag when writing CSV

[ https://issues.apache.org/jira/browse/SPARK-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297248#comment-15297248 ] Apache Spark commented on SPARK-15493: -- User 'jurriaan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15493) Allow setting the quoteEscapingEnabled flag when writing CSV

[ https://issues.apache.org/jira/browse/SPARK-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15493: Assignee: (was: Apache Spark) > Allow setting the quoteEscapingEnabled flag when

[jira] [Updated] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14343: --- Priority: Blocker (was: Critical) > Dataframe operations on a partitioned dataset (using partition

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297242#comment-15297242 ] Krishna Kalyan commented on SPARK-12071: [~shivaram] To summarise, We need to mention that

[jira] [Created] (SPARK-15493) Allow setting the quoteEscapingEnabled flag when writing CSV

Jurriaan Pruis created SPARK-15493: -- Summary: Allow setting the quoteEscapingEnabled flag when writing CSV Key: SPARK-15493 URL: https://issues.apache.org/jira/browse/SPARK-15493 Project: Spark

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297176#comment-15297176 ] Shivaram Venkataraman commented on SPARK-15439: --- [~wm624] Any luck in figuring out why this

[jira] [Assigned] (SPARK-15492) Binarization scala example copy & paste to spark-shell error

[ https://issues.apache.org/jira/browse/SPARK-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15492: Assignee: Apache Spark > Binarization scala example copy & paste to spark-shell error >

[jira] [Assigned] (SPARK-15492) Binarization scala example copy & paste to spark-shell error

[ https://issues.apache.org/jira/browse/SPARK-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15492: Assignee: (was: Apache Spark) > Binarization scala example copy & paste to

[jira] [Commented] (SPARK-15492) Binarization scala example copy & paste to spark-shell error

[ https://issues.apache.org/jira/browse/SPARK-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297171#comment-15297171 ] Apache Spark commented on SPARK-15492: -- User 'wangmiao1981' has created a pull request for this

[jira] [Created] (SPARK-15492) Binarization scala example copy & paste to spark-shell error

Miao Wang created SPARK-15492: - Summary: Binarization scala example copy & paste to spark-shell error Key: SPARK-15492 URL: https://issues.apache.org/jira/browse/SPARK-15492 Project: Spark

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297162#comment-15297162 ] Shivaram Venkataraman commented on SPARK-12071: --- [~KrishnaKalyan3] Feel free to work on

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297159#comment-15297159 ] Shivaram Venkataraman commented on SPARK-13525: --- If the problem is on line 353 it means

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297146#comment-15297146 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] I think the code diff looks

[jira] [Created] (SPARK-15491) JSON serializations fails for JDBC DataFrames

Marc Prud'hommeaux created SPARK-15491: -- Summary: JSON serializations fails for JDBC DataFrames Key: SPARK-15491 URL: https://issues.apache.org/jira/browse/SPARK-15491 Project: Spark

[jira] [Commented] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297105#comment-15297105 ] Dongjoon Hyun commented on SPARK-15282: --- Ah, I can not remove my PR links due to permissions.

[jira] [Issue Comment Deleted] (SPARK-15282) UDF function executed twice when filter on new column created by withColumn

[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15282: -- Comment: was deleted (was: Hi, [~linbojin]. I think I can find solution for this bug. I'll

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297095#comment-15297095 ] Michael Armbrust commented on SPARK-15489: -- Wild guess...

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297087#comment-15297087 ] Amit Sela commented on SPARK-15489: --- This is my registrator: public class ImmutableRegistrator

[jira] [Updated] (SPARK-15487) Spark Master UI to reverse proxy Application and Workers UI

[ https://issues.apache.org/jira/browse/SPARK-15487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gurvinder updated SPARK-15487: -- Description: Currently when running in Standalone mode, Spark UI's link to workers and application

[jira] [Resolved] (SPARK-15488) Possible Accumulator bug causing OneVsRestSuite to be flaky

[ https://issues.apache.org/jira/browse/SPARK-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15488. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-15490) SparkR 2.0 QA: New R APIs and API docs for non-MLib changes

[ https://issues.apache.org/jira/browse/SPARK-15490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15490: -- Description: See parent JIRA for details > SparkR 2.0 QA: New R APIs and API docs for

[jira] [Updated] (SPARK-15490) SparkR 2.0 QA: New R APIs and API docs for non-MLib changes

[ https://issues.apache.org/jira/browse/SPARK-15490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15490: -- Assignee: Kai Jiang > SparkR 2.0 QA: New R APIs and API docs for non-MLib changes >

[jira] [Created] (SPARK-15490) SparkR 2.0 QA: New R APIs and API docs for non-MLib changes

Joseph K. Bradley created SPARK-15490: - Summary: SparkR 2.0 QA: New R APIs and API docs for non-MLib changes Key: SPARK-15490 URL: https://issues.apache.org/jira/browse/SPARK-15490 Project: Spark

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296989#comment-15296989 ] Amit Sela commented on SPARK-15489: --- In 2.0.0-SNAPSHOT it manifests as: java.lang.AssertionError:

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296964#comment-15296964 ] Michael Armbrust commented on SPARK-15489: -- Also, does this problem exist in the 2.0 preview? >

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296963#comment-15296963 ] Michael Armbrust commented on SPARK-15489: -- Is your registration making into the instance of

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296950#comment-15296950 ] Amit Sela commented on SPARK-15489: --- I've tried registering `UnmodifiableCollectionsSerializer` and

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296951#comment-15296951 ] Amit Sela commented on SPARK-15489: --- Serialization trace: tupleTags

[jira] [Created] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

Amit Sela created SPARK-15489: - Summary: Dataset kryo encoder fails on Collections$UnmodifiableCollection Key: SPARK-15489 URL: https://issues.apache.org/jira/browse/SPARK-15489 Project: Spark

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296929#comment-15296929 ] Kazuaki Ishizaki commented on SPARK-15467: -- I created test cases to reproduce this problem and a

[jira] [Assigned] (SPARK-15447) Performance test for ALS in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-15447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-15447: -- Assignee: Nick Pentreath > Performance test for ALS in Spark 2.0 >

[jira] [Created] (SPARK-15488) Possible Accumulator bug causing OneVsRestSuite to be flaky

Joseph K. Bradley created SPARK-15488: - Summary: Possible Accumulator bug causing OneVsRestSuite to be flaky Key: SPARK-15488 URL: https://issues.apache.org/jira/browse/SPARK-15488 Project: Spark

[jira] [Resolved] (SPARK-15279) Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

[ https://issues.apache.org/jira/browse/SPARK-15279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15279. --- Resolution: Fixed Fix Version/s: 2.0.0 > Disallow ROW FORMAT and STORED AS (parquet | orc |

  1   2   >