[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486263#comment-17486263 ] john commented on SPARK-38058: -- since i am working in production env i cannot disclose any

[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484318#comment-17484318 ] john commented on SPARK-38058: -- it seems it doesn't specific to sql server.it is the proble

[jira] [Created] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

john created SPARK-38058: Summary: Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently Key: SPARK-38058 URL: https://issues.apache.org/jira/browse/SPARK-38058 Project: Sp

[jira] [Updated] (SPARK-34513) Kubernetes Spark Driver Pod Name Length Limitation

[ https://issues.apache.org/jira/browse/SPARK-34513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John updated SPARK-34513: - Description: Hi, We are using Spark in Airflow with the k8s-master. Airflow is attaching to our spark-driver p

[jira] [Created] (SPARK-34513) Kubernetes Spark Driver Pod Name Length Limitation

John created SPARK-34513: Summary: Kubernetes Spark Driver Pod Name Length Limitation Key: SPARK-34513 URL: https://issues.apache.org/jira/browse/SPARK-34513 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

[ https://issues.apache.org/jira/browse/SPARK-26000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682163#comment-16682163 ] john commented on SPARK-26000: -- I have Cloudera Manager in Environment A which has HDFS com

[jira] [Created] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

john created SPARK-26000: Summary: Missing block when reading HDFS Data from Cloudera Manager Key: SPARK-26000 URL: https://issues.apache.org/jira/browse/SPARK-26000 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

[ https://issues.apache.org/jira/browse/SPARK-26000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] john updated SPARK-26000: - Description: I am able to write to Cloudera Manager HDFS through Open Source Spark which runs separately. but n

[jira] [Commented] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-23982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438895#comment-16438895 ] John commented on SPARK-23982: -- see spark-core_2.11-2.3.0 and spark-yarn_2.11-2.3.0 org.apa

[jira] [Created] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil

John created SPARK-23982: Summary: NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil Key: SPARK-23982 URL: https://issues.apache.org/jira/browse/SPARK-23982 Pr

[jira] [Comment Edited] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189483#comment-16189483 ] Vishal John edited comment on SPARK-17885 at 10/3/17 11:27 AM:

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189483#comment-16189483 ] Vishal John commented on SPARK-17885: - I can see that the checkpointed folder was exp

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189403#comment-16189403 ] Vishal John commented on SPARK-17885: - Hello all, Our application also suffers from

[jira] [Comment Edited] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

[ https://issues.apache.org/jira/browse/SPARK-21346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079405#comment-16079405 ] John edited comment on SPARK-21346 at 7/9/17 1:27 AM: -- Sorry, I wasn

[jira] [Commented] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

[ https://issues.apache.org/jira/browse/SPARK-21346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079405#comment-16079405 ] John commented on SPARK-21346: -- Sorry, I wasn't aware of that. Do you mind elaborating more

[jira] [Created] (SPARK-21346) Spark does not use SSL for HTTP File Server and Broadcast Server

John created SPARK-21346: Summary: Spark does not use SSL for HTTP File Server and Broadcast Server Key: SPARK-21346 URL: https://issues.apache.org/jira/browse/SPARK-21346 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12763) Spark gets stuck executing SSB query

[ https://issues.apache.org/jira/browse/SPARK-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292263#comment-15292263 ] Rogers Jeffrey Leo John commented on SPARK-12763: - I believe it is relate

[jira] [Updated] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal John updated SPARK-9341: --- Description: I try to build spark by using the command ./build/sbt I get the following error - Attem

[jira] [Updated] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal John updated SPARK-9341: --- Description: I try to build spark by using the command ./build/sbt I get the following error - Attem

[jira] [Created] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

Vishal John created SPARK-9341: -- Summary: The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar Key: SPARK-9341 URL: https://issues.apache.org/jira/browse/SPARK-9341 Project: Spark

[jira] [Commented] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365211#comment-14365211 ] John commented on SPARK-6388: - Thanks, I will try it later > Spark 1.3 + Hadoop 2.6 Can't wor

[jira] [Commented] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365158#comment-14365158 ] John commented on SPARK-6388: - OK. But I rollback my system to Java 7 environment, I don't kee

[jira] [Commented] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365148#comment-14365148 ] John commented on SPARK-6388: - Ok, it looks like my problem. I'll try it later. Sorry for open

[jira] [Closed] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John closed SPARK-6388. --- Resolution: Not a Problem > Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40 > -

[jira] [Updated] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

[ https://issues.apache.org/jira/browse/SPARK-6388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John updated SPARK-6388: Environment: 1. Linux version 3.16.0-30-generic (buildd@komainu) (gcc version 4.9.1 (Ubuntu 4.9.1-16ubuntu6) ) #40-

[jira] [Created] (SPARK-6388) Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40

John created SPARK-6388: --- Summary: Spark 1.3 + Hadoop 2.6 Can't work on Java 8_40 Key: SPARK-6388 URL: https://issues.apache.org/jira/browse/SPARK-6388 Project: Spark Issue Type: Bug Componen