Hi Chenkaibit,
Let's further discuss it on the ticket as it indeed looks like a
bug/missing feature. I think Cloudera is currently taking the lead of
Flink-YARN development, so you will get a response soonish.
On Fri, Jul 23, 2021 at 8:59 AM chenkaibit wrote:
>
> Hi:
> I followed instructions described in [
> https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/hive]
> and tested hive streaming sink, met this exception
>
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.mapred.JobConf
>
>
> [http://apache-flink.147419.n8.nabble.com/Flink-td7866.html] met the same
> problem.
>
>
>
> I checked TM jvm envs and the code and found that flink only set up
> YARN_APPLICATION_CLASSPATH, but without MAPREDUCE_APPLICATION_CLASSPATH.
>
>
> See: [
> https://github.com/apache/flink/blob/ed39fb2efc790af038c1babd4a48847b7b39f91e/flink-yarn/src/main/java/org/apache/flink/yarn/Utils.java#L119
> ]
>
>
>
>
> I think we should add MAPREDUCE_APPLICATION_CLASSPATH as well, as the same
> as spark does.
>
> I created https://issues.apache.org/jira/browse/FLINK-23449 for this and
> hope someone could review.
>
