[
https://issues.apache.org/jira/browse/FLINK-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613451#comment-16613451
]
ASF GitHub Bot commented on FLINK-8247:
---------------------------------------
jaredstehler opened a new pull request #6689: [FLINK-8247] [Mesos] Support case
where hadoop is not on classpath
URL: https://github.com/apache/flink/pull/6689
## What is the purpose of the change
The hadoop-free distribution of Flink currently does not work on mesos, as
the call to
```HadoopUserOverlay.newBuilder().fromEnvironment(configuration).build()```
fails with a class not found exception. This change guards against that error
by checking for Hadoop on the classpath when loading UserGroupInformation;
modeled after HadoopModuleFactory.
## Brief change log
- *Updated HadoopUserOverlay to handle case where Hadoop is not on CP,
without breaking API*
## Verifying this change
This change can be verified as follows:
- *Manually verified the change by starting a Flink Appmaster instance in
mesos, without the hadoop uber jar in the lib dir*
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): no
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: no
- The serializers: no
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: yes
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? not applicable
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Support Hadoop-free variant of Flink on Mesos
> ---------------------------------------------
>
> Key: FLINK-8247
> URL: https://issues.apache.org/jira/browse/FLINK-8247
> Project: Flink
> Issue Type: Bug
> Components: Mesos
> Affects Versions: 1.4.0
> Reporter: Eron Wright
> Assignee: Eron Wright
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.4.3, 1.5.4
>
>
> In Hadoop-free mode, Hadoop isn't on the classpath. The Mesos job manager
> normally uses the Hadoop UserGroupInformation class to overlay a user context
> (`HADOOP_USER_NAME`) for the task managers.
> Detect the absence of Hadoop and skip over the `HadoopUserOverlay`, similar
> to the logic in `HadoopModuleFactory`. This may require the introduction
> of an overlay factory.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
