[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486263#comment-17486263 ] john commented on SPARK-38058: -- since i am working in production env i cannot disclose any docs in here.

[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484318#comment-17484318 ] john commented on SPARK-38058: -- it seems it doesn't specific to sql server.it is the problem with the spark

[jira] [Created] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

john created SPARK-38058: Summary: Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently Key: SPARK-38058 URL: https://issues.apache.org/jira/browse/SPARK-38058 Project:

[jira] [Updated] (SPARK-34513) Kubernetes Spark Driver Pod Name Length Limitation

[ https://issues.apache.org/jira/browse/SPARK-34513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John updated SPARK-34513: - Description: Hi, We are using Spark in Airflow with the k8s-master. Airflow is attaching to our spark-driver

[jira] [Created] (SPARK-34513) Kubernetes Spark Driver Pod Name Length Limitation

John created SPARK-34513: Summary: Kubernetes Spark Driver Pod Name Length Limitation Key: SPARK-34513 URL: https://issues.apache.org/jira/browse/SPARK-34513 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

[ https://issues.apache.org/jira/browse/SPARK-26000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682163#comment-16682163 ] john commented on SPARK-26000: -- I have Cloudera Manager in Environment A which has HDFS component and Spark

[jira] [Created] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

john created SPARK-26000: Summary: Missing block when reading HDFS Data from Cloudera Manager Key: SPARK-26000 URL: https://issues.apache.org/jira/browse/SPARK-26000 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

[ https://issues.apache.org/jira/browse/SPARK-26000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] john updated SPARK-26000: - Description: I am able to write to Cloudera Manager HDFS through Open Source Spark which runs separately. but

[jira] [Commented] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-23982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438895#comment-16438895 ] John commented on SPARK-23982: -- see spark-core_2.11-2.3.0 and spark-yarn_2.11-2.3.0

[jira] [Created] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil

John created SPARK-23982: Summary: NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil Key: SPARK-23982 URL: https://issues.apache.org/jira/browse/SPARK-23982

[jira] [Comment Edited] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189483#comment-16189483 ] Vishal John edited comment on SPARK-17885 at 10/3/17 11:27 AM: --- I can see

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189483#comment-16189483 ] Vishal John commented on SPARK-17885: - I can see that the checkpointed folder was explicitly deleted

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189403#comment-16189403 ] Vishal John commented on SPARK-17885: - Hello all, Our application also suffers from the same

[jira] [Comment Edited] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

[ https://issues.apache.org/jira/browse/SPARK-21346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079405#comment-16079405 ] John edited comment on SPARK-21346 at 7/9/17 1:27 AM: -- Sorry, I wasn't aware of

[jira] [Commented] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

[ https://issues.apache.org/jira/browse/SPARK-21346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079405#comment-16079405 ] John commented on SPARK-21346: -- Sorry, I wasn't aware of that. Do you mind elaborating more on what kind of

[jira] [Created] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

John created SPARK-21346: Summary: Spark does not use SSL for HTTP File Server and Broadcast Server Key: SPARK-21346 URL: https://issues.apache.org/jira/browse/SPARK-21346 Project: Spark Issue

[jira] [Commented] (SPARK-12763) Spark gets stuck executing SSB query

[ https://issues.apache.org/jira/browse/SPARK-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292263#comment-15292263 ] Rogers Jeffrey Leo John commented on SPARK-12763: - I believe it is related to the join

[jira] [Created] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

John created SPARK-6388: --- Summary: Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40 Key: SPARK-6388 URL: https://issues.apache.org/jira/browse/SPARK-6388 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John closed SPARK-6388. --- Resolution: Not a Problem Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[jira] [Commented] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365148#comment-14365148 ] John commented on SPARK-6388: - Ok, it looks like my problem. I'll try it later. Sorry for

[jira] [Updated] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John updated SPARK-6388: Environment: 1. Linux version 3.16.0-30-generic (buildd@komainu) (gcc version 4.9.1 (Ubuntu 4.9.1-16ubuntu6) )

[jira] [Commented] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365211#comment-14365211 ] John commented on SPARK-6388: - Thanks, I will try it later Spark 1.3 + Hadoop 2.6 Can't work