[jira] [Created] (SPARK-29437) CSV Writer should escape 'escapechar' when it exists in the data

Tomasz Bartczak created SPARK-29437: --- Summary: CSV Writer should escape 'escapechar' when it exists in the data Key: SPARK-29437 URL: https://issues.apache.org/jira/browse/SPARK-29437 Project: Spark

[jira] [Created] (SPARK-26627) sql_ctx loses '_conf' attribute for a pyspark dataframe converted to jdf and back

Tomasz Bartczak created SPARK-26627: --- Summary: sql_ctx loses '_conf' attribute for a pyspark dataframe converted to jdf and back Key: SPARK-26627 URL: https://issues.apache.org/jira/browse/SPARK-26627

[jira] [Created] (SPARK-24347) df.alias() in python API should not clear metadata by default

Tomasz Bartczak created SPARK-24347: --- Summary: df.alias() in python API should not clear metadata by default Key: SPARK-24347 URL: https://issues.apache.org/jira/browse/SPARK-24347 Project: Spark

[jira] [Updated] (SPARK-23478) Inconsistent behaviour of union when columns have conflicting metadata

[ https://issues.apache.org/jira/browse/SPARK-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Bartczak updated SPARK-23478: Priority: Minor (was: Major) > Inconsistent behaviour of union when columns have conflicti

[jira] [Updated] (SPARK-23479) struct() cannot be combined with alias(metadata={})

[ https://issues.apache.org/jira/browse/SPARK-23479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Bartczak updated SPARK-23479: Priority: Minor (was: Major) > struct() cannot be combined with alias(metadata={}) > -

[jira] [Commented] (SPARK-23477) Misleading exception message when union fails due to metadata

[ https://issues.apache.org/jira/browse/SPARK-23477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371271#comment-16371271 ] Tomasz Bartczak commented on SPARK-23477: - So what is the effect on master? no ex

[jira] [Created] (SPARK-23479) struct() cannot be combined with alias(metadata={})

Tomasz Bartczak created SPARK-23479: --- Summary: struct() cannot be combined with alias(metadata={}) Key: SPARK-23479 URL: https://issues.apache.org/jira/browse/SPARK-23479 Project: Spark Iss

[jira] [Created] (SPARK-23478) Inconsistent behaviour of union when columns have conflicting metadata

Tomasz Bartczak created SPARK-23478: --- Summary: Inconsistent behaviour of union when columns have conflicting metadata Key: SPARK-23478 URL: https://issues.apache.org/jira/browse/SPARK-23478 Project:

[jira] [Created] (SPARK-23477) Misleading exception message when union fails due to metadata

Tomasz Bartczak created SPARK-23477: --- Summary: Misleading exception message when union fails due to metadata Key: SPARK-23477 URL: https://issues.apache.org/jira/browse/SPARK-23477 Project: Spark

[jira] [Commented] (SPARK-23157) withColumn fails for a column that is a result of mapped DataSet

[ https://issues.apache.org/jira/browse/SPARK-23157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343168#comment-16343168 ] Tomasz Bartczak commented on SPARK-23157: - [~henryr] I see what you mean in your

[jira] [Created] (SPARK-23157) withColumn fails for a column that is a result of mapped DataSet

Tomasz Bartczak created SPARK-23157: --- Summary: withColumn fails for a column that is a result of mapped DataSet Key: SPARK-23157 URL: https://issues.apache.org/jira/browse/SPARK-23157 Project: Spark

[jira] [Commented] (SPARK-21567) Dataset with Tuple of type alias throws error

[ https://issues.apache.org/jira/browse/SPARK-21567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106920#comment-16106920 ] Tomasz Bartczak commented on SPARK-21567: - That's good there is a workaround. H

[jira] [Created] (SPARK-21567) Dataset with Tuple of type alias throws error

Tomasz Bartczak created SPARK-21567: --- Summary: Dataset with Tuple of type alias throws error Key: SPARK-21567 URL: https://issues.apache.org/jira/browse/SPARK-21567 Project: Spark Issue Typ

[jira] [Created] (SPARK-14759) After join one cannot drop dynamically added column

Tomasz Bartczak created SPARK-14759: --- Summary: After join one cannot drop dynamically added column Key: SPARK-14759 URL: https://issues.apache.org/jira/browse/SPARK-14759 Project: Spark Iss

[jira] [Commented] (SPARK-10802) Let ALS recommend for subset of data

[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907669#comment-14907669 ] Tomasz Bartczak commented on SPARK-10802: - hmm you are probably referring to meth

[jira] [Created] (SPARK-10802) Let ALS recommend for subset of data

Tomasz Bartczak created SPARK-10802: --- Summary: Let ALS recommend for subset of data Key: SPARK-10802 URL: https://issues.apache.org/jira/browse/SPARK-10802 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612929#comment-14612929 ] Tomasz Bartczak commented on SPARK-7483: hmm that's right - adding it in FPGrowthS

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612060#comment-14612060 ] Tomasz Bartczak commented on SPARK-7483: this solves the problem for me as well.

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537762#comment-14537762 ] Tomasz Bartczak commented on SPARK-7483: hmm, class org.apache.spark.mllib.fpm.FPT

[jira] [Created] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

Tomasz Bartczak created SPARK-7483: -- Summary: [MLLib] Using Kryo with FPGrowth fails with an exception Key: SPARK-7483 URL: https://issues.apache.org/jira/browse/SPARK-7483 Project: Spark Is

[jira] [Commented] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386924#comment-14386924 ] Tomasz Bartczak commented on SPARK-6239: I also stumbled upon this little inconven