Hello,
I was trying to include "hadoop-minikdc" component to Yarn test framework by
adding the dependency in "flink-shaded-include-yarn-tests" pom.xml file.
<dependency> <groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-minikdc</artifactId>
<version>${hadoop.version}</version></dependency>
The dependency inclusion seems to be working from IDE. IntelliJ picked up the
jar and did not report any compilation issue when I create a new test program
in "flink-yarn-tests" module and try to use the minikdc class.
However, when I try to run the test using maven command, I am getting
compilation error for the MiniKdc package.
Could someone please share some insights on how the dependency inclusion works
with the shaded hadoop components?
mvn verify -pl flink-yarn-tests -Pinclude-yarn-tests
-Dtest=YARNSessionFIFOITCase
[ERROR] COMPILATION ERROR : [INFO]
-------------------------------------------------------------[ERROR]
/workspace/git-projects/junk/flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionSecuredFIFOITCase.java:[24,33]
package org.apache.hadoop.minikdc does not exist[ERROR]
/workspace/git-projects/junk/flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionSecuredFIFOITCase.java:[46,24]
cannot find symbol symbol: class MiniKdc location: class
org.apache.flink.yarn.YARNSessionSecuredFIFOITCase[ERROR]
/workspace/git-projects/junk/flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionSecuredFIFOITCase.java:[58,38]
cannot find symbol symbol: variable MiniKdc location: class
org.apache.flink.yarn.YARNSessionSecuredFIFOITCase[ERROR]
/workspace/git-projects/junk/flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionSecuredFIFOITCase.java:[59,27]
cannot find symbol symbol: class MiniKdc location: class
org.apache.flink.yarn.YARNSessionSecuredFIFOITCase
RegardsVijay
