Everything is working fine now
Thanks again
Loïc
De : German Schiavon
Envoyé : mercredi 16 décembre 2020 19:23
À : Loic DESCOTTE
Cc : user@spark.apache.org
Objet : Re: Spark on Kubernetes : unable to write files to HDFS
We all been there! no reason
Oh thank you you're right!! I feel shameful ??
De : German Schiavon
Envoyé : mercredi 16 décembre 2020 18:01
À : Loic DESCOTTE
Cc : user@spark.apache.org
Objet : Re: Spark on Kubernetes : unable to write files to HDFS
Hi,
seems that you have a typo
impl",
classOf[org.apache.hadoop.hdfs.DistributedFileSystem].getName)
.getOrCreate()
But still the same error...
De : Sean Owen
Envoyé : mercredi 16 décembre 2020 14:27
À : Loic DESCOTTE
Objet : Re: Spark on Kubernetes : unable to write files to HDFS
Hello,
I am using Spark On Kubernetes and I have the following error when I try to
write data on HDFS : "no filesystem for scheme hdfs"
More details :
I am submitting my application with Spark submit like this :
spark-submit --master k8s://https://myK8SMaster:6443 \
--deploy-mode cluster \
