[jira] [Commented] (SPARK-16741) spark.speculation causes duplicate rows in df.write.jdbc()

2016-07-26 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394515#comment-15394515 ] Zoltan Fedor commented on SPARK-16741: -- Most databases allow you to set unique keys and disallow the

[jira] [Commented] (SPARK-16741) spark.speculation causes duplicate rows in df.write.jdbc()

2016-07-26 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394501#comment-15394501 ] Zoltan Fedor commented on SPARK-16741: -- Thanks Sean. I agree, it is debatable whether this is a bug

[jira] [Created] (SPARK-16741) spark.speculation causes duplicate rows in df.write.jdbc()

2016-07-26 Thread Zoltan Fedor (JIRA)
Zoltan Fedor created SPARK-16741: Summary: spark.speculation causes duplicate rows in df.write.jdbc() Key: SPARK-16741 URL: https://issues.apache.org/jira/browse/SPARK-16741 Project: Spark

[jira] [Updated] (SPARK-14162) java.lang.IllegalStateException: Did not find registered driver with class oracle.jdbc.OracleDriver

2016-03-25 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-14162: - Description: This is an interesting one. We are using JupyterHub with Python to connect to a

[jira] [Created] (SPARK-14162) java.lang.IllegalStateException: Did not find registered driver with class oracle.jdbc.OracleDriver

2016-03-25 Thread Zoltan Fedor (JIRA)
Zoltan Fedor created SPARK-14162: Summary: java.lang.IllegalStateException: Did not find registered driver with class oracle.jdbc.OracleDriver Key: SPARK-14162 URL:

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-03-22 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Affects Version/s: 1.6.1 > HiveContext reads avro Hive tables incorrectly >

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-03-04 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Affects Version/s: 1.6.0 > HiveContext reads avro Hive tables incorrectly >

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Description: I am using PySpark to read avro-based tables from Hive and while the avro tables

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Description: I am using PySpark to read avro-based tables from Hive and while the avro tables

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Description: I am using PySpark to read avro-based tables from Hive and while the avro tables

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Attachment: logs Spark logs showing no errors or even warning. The avro schema seems to be read

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Attachment: table_definition This is how the table is defined in Hive. > HiveContext reads avro

[jira] [Created] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

2016-02-29 Thread Zoltan Fedor (JIRA)
Zoltan Fedor created SPARK-13572: Summary: HiveContext reads avro Hive tables incorrectly Key: SPARK-13572 URL: https://issues.apache.org/jira/browse/SPARK-13572 Project: Spark Issue Type: