*** I move it to u...@beam.apache.org since it’s rather user-related question 
***


Hello Liu,

Could you check which versions of Jackson you have in your Spark class path 
while running a job?

—
Alexey 

> On 8 Apr 2022, at 07:01, Liu Jie <jieliu5...@gmail.com> wrote:
> 
> Dear Sir/Madam,
> 
> I followed the official documentation to download the WordCount example 
> (https://beam.apache.org/get-started/quickstart-java/ 
> <https://beam.apache.org/get-started/quickstart-java/>), used Maven to build 
> the project, deployed spark-2.4.8-bin-hadoop2.7 locally, and followed the 
> official Spark Runner configuration 
> (https://beam.apache.org/documentation/runners/spark/ 
> <https://beam.apache.org/documentation/runners/spark/>), the error was 
> reported.
> 
> Exception in thread "main" java.lang.NoSuchMethodError: 
> com.fasterxml.jackson.databind.type.TypeBindings.emptyBindings()Lcom/fasterxml/jackson/databind/type/TypeBindings;
>         at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.createBeanProperty(PipelineOptionsFactory.java:1706)
> 
> 
> The Spark commit cluster command is:
> ./bin/spark-submit \
>   --class org.apache.beam.examples.WordCount \
>   --master spark://yuanshu-2288H-V5:7077 \
>   
> /share/apache_beam_code/word-count-beam/target/word-count-beam-bundled-0.1.jar
>  \
> --runner=SparkRunner \
> --inputFile=/share/k_means_data_python/10000_point_4_center_2_feature.txt \
> --output=/share/apache_beam_code/word-count-beam/src/main/java/BeamKmeans/4core6G1worker/output
> 
> The pom.xml file and full error output in Maven are in the attachment.
> 
> I created the question on StackOverflow:
> https://stackoverflow.com/questions/71791853/apache-beam-2-37-0-sparkrunner-program-executing-in-spark-2-4-8-standalone-clust
>  
> <https://stackoverflow.com/questions/71791853/apache-beam-2-37-0-sparkrunner-program-executing-in-spark-2-4-8-standalone-clust>
> 
> Looking forward to your reply
>  
> -- 
> Kind regards,
> Jie Liu
> ----------------
> Mr. Jie Liu
> Computer School, University of South China, Hengyang 421001
> E-Mail: jieliu5...@gmail.com <mailto:chiara...@mdpi.com>
> <spark_2.4.8_standalone_apache_beam_2.37.0_SparkRunner_error.txt><apache_beam_2.37.0_maven_example_pom.txt>

Reply via email to