Shawn Chang created HUDI-4806:
---------------------------------

             Summary: Use Avro version from root pom file for Flink bundle
                 Key: HUDI-4806
                 URL: https://issues.apache.org/jira/browse/HUDI-4806
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Shawn Chang


In pom of flink bundle it specifically defines avro 1.10.0 as its dependency, 
but this will cause conflicts with some avro generated classes if the project 
was built with spark3 profile which uses avro 1.11.0.

Example exception:

{{}}
{code:java}
Caused by: java.lang.NoSuchMethodError: 
org.apache.hudi.org.apache.avro.specific.SpecificRecordBuilderBase.<init>(Lorg/apache/hudi/org/apache/avro/Schema;Lorg/apache/hudi/org/apache/avro/specific/SpecificData;)V{code}
{{}}

 

We should make avro version consistent across the whole project

 

Also, in flink bundle we are shading avro version so it doesn't matter which 
avro Flink is using.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to