Hi Chenkaibit, Let's further discuss it on the ticket as it indeed looks like a bug/missing feature. I think Cloudera is currently taking the lead of Flink-YARN development, so you will get a response soonish.
On Fri, Jul 23, 2021 at 8:59 AM chenkaibit <chenkai...@163.com> wrote: > > Hi: > I followed instructions described in [ > https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/hive] > and tested hive streaming sink, met this exception > > > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.mapred.JobConf > > > [http://apache-flink.147419.n8.nabble.com/Flink-td7866.html] met the same > problem. > > > > I checked TM jvm envs and the code and found that flink only set up > YARN_APPLICATION_CLASSPATH, but without MAPREDUCE_APPLICATION_CLASSPATH. > > > See: [ > https://github.com/apache/flink/blob/ed39fb2efc790af038c1babd4a48847b7b39f91e/flink-yarn/src/main/java/org/apache/flink/yarn/Utils.java#L119 > ] > > > > > I think we should add MAPREDUCE_APPLICATION_CLASSPATH as well, as the same > as spark does. > > I created https://issues.apache.org/jira/browse/FLINK-23449 for this and > hope someone could review. >
