Hi,
There is an unmerged PR which can be used against spark 2.4(if you are
interested) or master branch(3.0). Spark 2.3 K8S lacks lot of features. I
suggest you upgrade to 2.4 which will be released in few days from now.
https://github.com/apache/spark/pull/22722
Regards
Surya
From: Matt
know, if this approach is fine.
Please correct me if my understanding is wrong with this approach.
Regards
Surya
From: Garlapati, Suryanarayana (Nokia - IN/Bangalore)
Sent: Wednesday, September 26, 2018 9:14 AM
To: Ilan Filonenko ; liyinan...@gmail.com
Cc: Spark dev list ; user@spark.apache.org
Regards
Surya
From: Ilan Filonenko
Sent: Wednesday, September 26, 2018 2:06 AM
To: liyinan...@gmail.com
Cc: Garlapati, Suryanarayana (Nokia - IN/Bangalore)
; Spark dev list ;
user@spark.apache.org
Subject: Re: Python kubernetes spark 2.4 branch
Is this in reference to: https://issues.apache
Hi,
I am trying to run spark python testcases on k8s based on tag spark-2.4-rc1.
When the dependent files are passed through the --py-files option, they are not
getting resolved by the main python script. Please let me know, is this a known
issue?
Regards
Surya
Hi,
Following is the bug to track the same.
https://issues.apache.org/jira/browse/SPARK-25442
Regards
Surya
From: Garlapati, Suryanarayana (Nokia - IN/Bangalore)
Sent: Sunday, September 16, 2018 10:15 AM
To: d...@spark.apache.org; Ilan Filonenko
Cc: user@spark.apache.org; Imandi, Srinivas
Hi All,
I would like to propose the following changes for supporting the STS to run in
k8s deployments with spark deployment mode as cluster.
PR: https://github.com/apache/spark/pull/22433
Can you please review and provide the comments?
Regards
Surya
Hi,
Provide the following options in spark-defaults.conf and make sure the
log4j.properties file is available in driver and executor:
spark.driver.extraJavaOptions -Dlog4j.configuration=file:/log4j.properties
spark.executor.extraJavaOptions -Dlog4j.configuration=file:
/log4j.properties
Hi Sandeep,
Any inputs on this?
Regards
Surya
From: Garlapati, Suryanarayana (Nokia - IN/Bangalore)
Sent: Saturday, July 21, 2018 6:50 PM
To: Sandeep Katta
Cc: d...@spark.apache.org; user@spark.apache.org
Subject: RE: Query on Spark Hive with kerberos Enabled on Kubernetes
Hi Sandeep,
Thx
the hive metastore. Please let me know, if doing wrong.
Regards
Surya
From: Sandeep Katta [mailto:sandeep0102.opensou...@gmail.com]
Sent: Friday, July 20, 2018 9:59 PM
To: Garlapati, Suryanarayana (Nokia - IN/Bangalore)
Cc: d...@spark.apache.org; user@spark.apache.org
Subject: Re: Query on Spark
Hi All,
I am trying to use Spark 2.2.0
Kubernetes(https://github.com/apache-spark-on-k8s/spark/tree/v2.2.0-kubernetes-0.5.0)
code to run the Hive Query on Kerberos Enabled cluster. Spark-submit's fail
for the Hive Queries, but pass when I am trying to access the hdfs. Is this a
known
10 matches
Mail list logo
