RE: Running spark Kafka streaming jo in Azure HDInsight

2021-10-06 Thread Muhammed Favas
to submit job remotely. I have passed all dependent jars while calling the submit. Regards, Favas From: Stelios Philippou Sent: Wednesday, October 6, 2021 16:51 PM To: Muhammed Favas Cc: user@spark.apache.org Subject: Re: Running spark Kafka streaming jo in Azure HDInsight Hi Favas, The error

Re: Running spark Kafka streaming jo in Azure HDInsight

2021-10-06 Thread Stelios Philippou
Hi Favas, The error states that you are using different libraries version. Exception in thread "streaming-start" java.lang.NoSuchMethodError: org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/Collection;)V Have in mind that Spark uses its internal libraries for the majority