to submit job remotely. I have passed all dependent jars while
calling the submit.
Regards,
Favas
From: Stelios Philippou
Sent: Wednesday, October 6, 2021 16:51 PM
To: Muhammed Favas
Cc: user@spark.apache.org
Subject: Re: Running spark Kafka streaming jo in Azure HDInsight
Hi Favas,
The error
Hi Favas,
The error states that you are using different libraries version.
Exception in thread "streaming-start" java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/Collection;)V
Have in mind that Spark uses its internal libraries for the majority
Hi,
I am facing some dependency issue in running a spark streaming job in Azure
HDInsight. The job is connecting to a kafka broker which is hosted in a LAN and
has public IP access to it.
Spark job porn.xml set up - spark version 3.0.0, Scala version 2.12
org.scala-lang
scala-library
