[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

2020-09-30 Thread Simone (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204565#comment-17204565 ] Simone commented on SPARK-19335: +1 it is really strange that Delta Lake offer this capa

[jira] [Commented] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-18 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152150#comment-15152150 ] Simone commented on SPARK-13301: Maybe could it be dataset dependent? I am not able to re

[jira] [Commented] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-15 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147161#comment-15147161 ] Simone commented on SPARK-13301: Hi, The values in col1 field are 32 chars long. The ou

[jira] [Updated] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13301: --- Environment: PySpark in yarn-client mode - CDH 5.5.1 (was: PySpark - CDH 5.5.1) > PySpark Dataframe return

[jira] [Updated] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13301: --- Description: Using a User Defined Function in PySpark inside the withColumn() method of Dataframe, gives wro

[jira] [Updated] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13301: --- Description: Using a User Defined Function in PySpark inside the withColumn() method of Dataframe, gives wro

[jira] [Updated] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13301: --- Description: Using a User Defined Function in PySpark inside the withColumn() method of Dataframe, gives wro

[jira] [Updated] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13301: --- Description: Using a User Defined Function in PySpark inside the withColumn() method of Dataframe, gives wro

[jira] [Created] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

2016-02-12 Thread Simone (JIRA)
Simone created SPARK-13301: -- Summary: PySpark Dataframe return wrong results with custom UDF Key: SPARK-13301 URL: https://issues.apache.org/jira/browse/SPARK-13301 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13141) Dataframe created from Hive partitioned tables using HiveContext returns wrong results

2016-02-02 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13141: --- Description: I get wrong dataframe results using HiveContext with Spark 1.5.0 on CDH 5.5.1 in yarn-client mo

[jira] [Created] (SPARK-13141) Dataframe created from Hive partitioned tables using HiveContext returns wrong results

2016-02-02 Thread Simone (JIRA)
Simone created SPARK-13141: -- Summary: Dataframe created from Hive partitioned tables using HiveContext returns wrong results Key: SPARK-13141 URL: https://issues.apache.org/jira/browse/SPARK-13141 Project: S

[jira] [Updated] (SPARK-13141) Dataframe created from Hive partitioned tables using HiveContext returns wrong results

2016-02-02 Thread Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simone updated SPARK-13141: --- Description: I get wrong dataframe results using HiveContext with Spark 1.5.0 on CDH 5.5.1 in yarn-client mo

[jira] [Closed] (SPARK-10457) Unable to connect to MySQL with the DataFrame API

2015-09-04 Thread Mariano Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariano Simone closed SPARK-10457. -- Resolution: Fixed Found the solution. spark.executor.extraClassPath needed configuration. > U

[jira] [Updated] (SPARK-10457) Unable to connect to MySQL with the DataFrame API

2015-09-04 Thread Mariano Simone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariano Simone updated SPARK-10457: --- Description: I'm getting this error everytime I try to create a dataframe using jdbc: java.s

[jira] [Created] (SPARK-10457) Unable to connect to MySQL with the DataFrame API

2015-09-04 Thread Mariano Simone (JIRA)
Mariano Simone created SPARK-10457: -- Summary: Unable to connect to MySQL with the DataFrame API Key: SPARK-10457 URL: https://issues.apache.org/jira/browse/SPARK-10457 Project: Spark Issue T