[
https://issues.apache.org/jira/browse/FLINK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699437#comment-14699437
]
ASF GitHub Bot commented on FLINK-1984:
---------------------------------------
Github user rmetzger commented on the pull request:
https://github.com/apache/flink/pull/948#issuecomment-131796852
Hi @ankurcha,
I've started a Mesos cluster on Google Compute Engine to try out your pull
request.
I've used this configuration:
```
flink.mesos.master: zk://127.0.0.1:2181/mesos
flink.uberjar.location: hdfs:///user/jclouds/flink-dist-0.10-SNAPSHOT.jar
flink.mesos.taskmanagers.mem: 512
flink.mesos.taskmanagers.cpu: 0.5
taskmanager.logging.level: INFO
streamingMode: streaming
jobmanager.web.port: 8081
webclient.port: 8080
```
But I'm getting this error
```
Exception in thread "main" java.lang.NullPointerException
at
org.apache.flink.mesos.scheduler.SchedulerUtils$class.createFrameworkInfoAndCredentials(SchedulerUtils.scala:255)
at
org.apache.flink.mesos.scheduler.FlinkScheduler$.createFrameworkInfoAndCredentials(FlinkScheduler.scala:31)
at
org.apache.flink.mesos.scheduler.FlinkScheduler$.main(FlinkScheduler.scala:183)
at
org.apache.flink.mesos.scheduler.FlinkScheduler.main(FlinkScheduler.scala)
```
I'll further investigate the issue.
*Why did you decide to start the JobManager alongside the Scheduler?*
For Flink on YARN, we are starting the JobManager in a separate container.
There is a lot of communication going on between the JobManager and
TaskManagers, also, we need to ensure that the TaskManagers are able to reach
the JM.
I think we can safely assume that containers can always communicate among
each other ... I'm not so sure about Mesos clients and cluster containers.
> The mesos scheduler is not HA and should be used with marathon or similar
service to ensure that there is always one instance running. This may be
addressed in future patches.
Would you start the mesos scheduler on the client machine or inside the
cluster, using a container?
Whats the typical deployment model for Mesos?
> Integrate Flink with Apache Mesos
> ---------------------------------
>
> Key: FLINK-1984
> URL: https://issues.apache.org/jira/browse/FLINK-1984
> Project: Flink
> Issue Type: New Feature
> Components: New Components
> Reporter: Robert Metzger
> Priority: Minor
> Attachments: 251.patch
>
>
> There are some users asking for an integration of Flink into Mesos.
> There also is a pending pull request for adding Mesos support for Flink:
> https://github.com/apache/flink/pull/251
> But the PR is insufficiently tested. I'll add the code of the pull request to
> this JIRA in case somebody wants to pick it up in the future.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
