[ https://issues.apache.org/jira/browse/HUDI-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xiaozhongcheng closed HUDI-4383. -------------------------------- Fix Version/s: 0.12.1 (was: 0.13.0) Resolution: Fixed > Make hudi-flink-bundle module compile with the correct flink version > -------------------------------------------------------------------- > > Key: HUDI-4383 > URL: https://issues.apache.org/jira/browse/HUDI-4383 > Project: Apache Hudi > Issue Type: Bug > Components: flink > Reporter: xiaozhongcheng > Priority: Major > Labels: pull-request-available > Fix For: 0.12.1 > > > At present, If I compile hudi withe the compile command of > {code:java} > mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12 > -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15 > -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12 {code} > the flink version of hudi-flink-bundle is still 1.14. > Compile output: > {code:java} > [root@hadoop3 hudi-master]# mvn clean package -DskipTests > -Dhive.version=3.1.2 -Dscala.version=2.12.12 -Dscala.binary.version=2.12 > -Pflink-bundle-shade-hive3 -Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2 > -Dscala-2.12 > [INFO] Scanning for projects... > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-common:jar:0.12.0-SNAPSHOT > [WARNING] > 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' > must be unique: org.apache.logging.log4j:log4j-core:jar -> version > ${log4j2.version} vs ${log4j.test.version} @ > org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1175, > column 19 > [WARNING] > 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' > must be unique: org.apache.logging.log4j:log4j-api:jar -> version > ${log4j2.version} vs ${log4j.test.version} @ > org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1182, > column 19 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-cli:jar:0.12.0-SNAPSHOT > [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must > be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration > of version (?) @ line 216, column 17 > [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must > be unique: org.apache.logging.log4j:log4j-api:jar -> duplicate declaration of > version (?) @ line 222, column 17 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-spark-common_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-spark-common_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/hudi-spark-datasource/hudi-spark-common/pom.xml, line 24, > column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-spark_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-spark_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/hudi-spark-datasource/hudi-spark/pom.xml, line 26, column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-utilities_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/hudi-utilities/pom.xml, line 26, column 15 > [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must > be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration > of version (?) @ > org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/hudi-utilities/pom.xml, line 501, column 17 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-hive-sync:jar:0.12.0-SNAPSHOT > [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must > be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration > of version (?) @ line 162, column 17 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-spark3.2-bundle_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-spark${sparkbundle.version}-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/packaging/hudi-spark-bundle/pom.xml, line 26, column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-utilities-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/packaging/hudi-utilities-bundle/pom.xml, line 26, column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-utilities-slim-bundle_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-utilities-slim-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/packaging/hudi-utilities-slim-bundle/pom.xml, line 26, > column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-flink1.14-bundle:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-flink${flink.bundle.version}-bundle:0.12.0-SNAPSHOT, > /data/hudi-master/packaging/hudi-flink-bundle/pom.xml, line 28, column 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi-spark2_2.12:jar:0.12.0-SNAPSHOT > [WARNING] 'artifactId' contains an expression but should be a constant. @ > org.apache.hudi:hudi-spark2_${scala.binary.version}:0.12.0-SNAPSHOT, > /data/hudi-master/hudi-spark-datasource/hudi-spark2/pom.xml, line 24, column > 15 > [WARNING] > [WARNING] Some problems were encountered while building the effective model > for org.apache.hudi:hudi:pom:0.12.0-SNAPSHOT > [WARNING] > 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' > must be unique: org.apache.logging.log4j:log4j-core:jar -> version > ${log4j2.version} vs ${log4j.test.version} @ line 1175, column 19 > [WARNING] > 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' > must be unique: org.apache.logging.log4j:log4j-api:jar -> version > ${log4j2.version} vs ${log4j.test.version} @ line 1182, column 19 > [WARNING] > [WARNING] It is highly recommended to fix these problems because they > threaten the stability of your build. > [WARNING] > [WARNING] For this reason, future Maven versions might no longer support > building such malformed projects. > [WARNING] > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Build Order: > [INFO] > [INFO] Hudi > [pom] > [INFO] hudi-common > [jar] > [INFO] hudi-hadoop-mr > [jar] > [INFO] hudi-sync-common > [jar] > [INFO] hudi-hive-sync > [jar] > [INFO] hudi-aws > [jar] > [INFO] hudi-timeline-service > [jar] > [INFO] hudi-client > [pom] > [INFO] hudi-client-common > [jar] > [INFO] hudi-spark-client > [jar] > [INFO] hudi-spark-datasource > [pom] > [INFO] hudi-spark-common_2.12 > [jar] > [INFO] hudi-spark3-common > [jar] > [INFO] hudi-spark3_2.12 > [jar] > [INFO] hudi-java-client > [jar] > [INFO] hudi-spark_2.12 > [jar] > [INFO] hudi-utilities_2.12 > [jar] > [INFO] hudi-utilities-bundle_2.12 > [jar] > [INFO] hudi-cli > [jar] > [INFO] hudi-flink-client > [jar] > [INFO] hudi-gcp > [jar] > [INFO] hudi-datahub-sync > [jar] > [INFO] hudi-adb-sync > [jar] > [INFO] hudi-sync > [pom] > [INFO] hudi-hadoop-mr-bundle > [jar] > [INFO] hudi-datahub-sync-bundle > [jar] > [INFO] hudi-hive-sync-bundle > [jar] > [INFO] hudi-aws-bundle > [jar] > [INFO] hudi-gcp-bundle > [jar] > [INFO] hudi-spark3.2-bundle_2.12 > [jar] > [INFO] hudi-presto-bundle > [jar] > [INFO] hudi-utilities-slim-bundle_2.12 > [jar] > [INFO] hudi-timeline-server-bundle > [jar] > [INFO] hudi-trino-bundle > [jar] > [INFO] hudi-examples > [pom] > [INFO] hudi-examples-common > [jar] > [INFO] hudi-examples-spark > [jar] > [INFO] hudi-flink-datasource > [pom] > [INFO] hudi-flink1.14.x > [jar] > [INFO] hudi-flink > [jar] > [INFO] hudi-examples-flink > [jar] > [INFO] hudi-examples-java > [jar] > [INFO] hudi-flink1.13.x > [jar] > [INFO] hudi-flink1.15.x > [jar] > [INFO] hudi-kafka-connect > [jar] > [INFO] hudi-flink1.14-bundle > [jar] > [INFO] hudi-kafka-connect-bundle > [jar] > [INFO] hudi-spark2_2.12 > [jar] > [INFO] hudi-spark2-common > [jar] > [INFO] > [INFO] ------------------------< org.apache.hudi:hudi > >------------------------ > [INFO] Building Hudi 0.12.0-SNAPSHOT > [1/49] > [INFO] --------------------------------[ pom > ]--------------------------------- > [INFO] > [INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi --- > [INFO] Deleting /data/hudi-master/target > [INFO] > ......{code} > > -- This message was sent by Atlassian Jira (v8.20.10#820010)