park/spark-3.2.1-bin-hadoop3.2/examples/jars/spark-examples_2.12-3.2.1.jar
Thanks
GK
On Wed, Feb 16, 2022 at 11:11 PM Gnana Kumar
wrote:
> Hi Mich
>
> Also I would like to run Spark nodes ( Master and Worker nodes in
> Kubernetes) and then run my Java Spark application from a JA
r any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
Gnana Kumar
wrote:
> Hi Mich
>
> This is the latest error I'm stuck with. Please help me resolve this issue.
>
> Exception in thread "main"
> io.fabric8.kubernetes.client.KubernetesClientException: Operation: [create]
> for kind: [Pod] with name: [null]
Hi There,
I have been trying to run Spark 3.2.1 in Google Cloud's Kubernetes Cluster
version 1.19 or 1.21
But I kept on getting on following error and could not proceed.
Please help me resolve this issue.
22/02/14 16:00:48 INFO SparkKubernetesClientFactory: Auto-configuring K8S
client using
\
--conf spark.kubernetes.authenticate.driver.serviceAccountName=spark \
$SPARK_HOME/examples/jars/spark-examples_2.12-3.2.1.jar
On Mon, Feb 14, 2022 at 9:51 PM Gnana Kumar
wrote:
> Hi There,
>
> I have been trying to run Spark 3.2.1 in Google Cloud's Kubernetes Cluster
> version
content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Thu, 17 Feb 2022 at 18:24, Gnana Kumar
> wrote:
>
>> Though I have created the kubernetes RBAC as pe
Hi There,
I have been able to start the Spark History Server in GKE Kubernetes
Cluster.
And I have created a Service Account in my google project with permissions
as storage admin,storage object admin and owner.
Now when I have tried to submit the job using Spark Submit, using below
options to
eds more mem in Java 11
> and/or some envs. As a quick check, try replacing all "-Xss4m" with
> "-Xss16m" or something larger, in the project build files. Just search and
> replace.
>
> On Fri, Dec 16, 2022 at 9:53 AM Gnana Kumar
> wrote:
>
>> I have
Hi There,
I have cloned spark 3.3.2 snapshot source code where Volcano feature is
present and then I built the binary distribution for the same.
However when I tried to use this spark 3.3.2 SNAPSHOT dist with Volcano but
I have got class not found exception.
--conf
Hi There,
I have installed Spark 3.3.1 and tried to use the following configuration
in Spark Submit for a spark job to run in Kubernetes Cluster and I have got
class not found exception for the reference "VolcanoFeatureStep"
--conf
are in
> volcano-client-5.12.2.jar and volcano-model-v1beta1-5.12.2.jar.
>
> I haven't tested this new feature myself, so I don't know if there are
> other steps you'll hit after this. Speaking just in terms of what the build
> does though, this should be sufficient.
>
> I ho
11 matches
Mail list logo
