[
https://issues.apache.org/jira/browse/FLINK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905889#comment-14905889
]
ASF GitHub Bot commented on FLINK-1984:
---------------------------------------
Github user ankurcha commented on the pull request:
https://github.com/apache/flink/pull/948#issuecomment-142825340
Hi @rmetzger,
This completely got buried in scheduler but i think i have finally worked
out the kinks. Thanks for spending the time to try it out.
I think we are closer to having this out of the door so have a go at it and
let me know if you see something off.
```bash
vagrant@mesos:/vagrant$ java
-Dlog4j.configuration=file:/vagrant/log4j.properties -cp *.jar
org.apache.flink.mesos.scheduler.FlinkScheduler --confDir /vagrant --port 10080
INFO 2015-09-24 06:22:04,584 [main] FlinkScheduler$:
--------------------------------------------------------------------------------
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Starting JobManager
(Version: 0.10-SNAPSHOT, Rev:bc21de2, Date:23.09.2015 @ 20:06:33 UTC)
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Current user: vagrant
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JVM: OpenJDK 64-Bit
Server VM - Oracle Corporation - 1.7/24.79-b02
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Maximum heap size:
592 MiBytes
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JAVA_HOME: (not set)
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Hadoop version: 2.3.0
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: JVM Options:
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$:
-Dlog4j.configuration=file:/vagrant/log4j.properties
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Program Arguments:
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --confDir
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: /vagrant
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --port
INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$: 10080
INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$:
--------------------------------------------------------------------------------
INFO 2015-09-24 06:22:04,595 [main] FlinkScheduler$: Maximum number of
open file descriptors is 4096
INFO 2015-09-24 06:22:04,596 [main] FlinkScheduler$: Loading configuration
from /vagrant
DEBUG 2015-09-24 06:22:04,665 [main] FlinkScheduler$: Serving configuration
via: Some(http://127.0.0.1:10080)
INFO 2015-09-24 06:22:04,725 [Thread-3] JobManager: Starting JobManager
INFO 2015-09-24 06:22:04,726 [Thread-3] JobManager: Starting JobManager
actor system at :6123.
I0924 06:22:04.812088 7312 sched.cpp:157] Version: 0.22.1
2015-09-24 06:22:04,815:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@712: Client
environment:zookeeper.version=zookeeper C client 3.4.5
2015-09-24 06:22:04,816:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@716: Client
environment:host.name=mesos
2015-09-24 06:22:04,818:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@723: Client
environment:os.name=Linux
2015-09-24 06:22:04,821:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@724: Client
environment:os.arch=3.16.0-30-generic
2015-09-24 06:22:04,822:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@725: Client
environment:os.version=#40~14.04.1-Ubuntu SMP Thu Jan 15 17:43:14 UTC 2015
2015-09-24 06:22:04,824:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@733: Client
environment:user.name=vagrant
2015-09-24 06:22:04,827:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@741: Client
environment:user.home=/home/vagrant
2015-09-24 06:22:04,829:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@753: Client
environment:user.dir=/vagrant
2015-09-24 06:22:04,830:7311(0x7fcaf8bbb700):ZOO_INFO@zookeeper_init@786:
Initiating client connection, host=127.0.0.1:2181 sessionTimeout=10000
watcher=0x7fcb29b99a60 sessionId=0 sessionPasswd=<null> context=0x1c0f350
flags=0
2015-09-24 06:22:04,837:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1703:
initiated connection to server [127.0.0.1:2181]
2015-09-24 06:22:04,839:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1750:
session establishment complete on server [127.0.0.1:2181],
sessionId=0x14ffdcf98d00015, negotiated timeout=10000
I0924 06:22:04.840190 7333 group.cpp:313] Group process
(group(1)@127.0.1.1:36068) connected to ZooKeeper
I0924 06:22:04.840239 7333 group.cpp:790] Syncing group operations: queue
size (joins, cancels, datas) = (0, 0, 0)
I0924 06:22:04.840265 7333 group.cpp:385] Trying to create path '/mesos'
in ZooKeeper
I0924 06:22:04.843736 7333 detector.cpp:138] Detected a new leader:
(id='0')
I0924 06:22:04.843868 7331 group.cpp:659] Trying to get
'/mesos/info_0000000000' in ZooKeeper
I0924 06:22:04.844832 7331 detector.cpp:452] A new leading master
([email protected]:5050) is detected
I0924 06:22:04.844923 7331 sched.cpp:254] New master detected at
[email protected]:5050
I0924 06:22:04.845263 7331 sched.cpp:264] No credentials provided.
Attempting to register without authentication
I0924 06:22:04.847537 7331 sched.cpp:448] Framework registered with
20150924-052444-16842879-5050-1219-0012
INFO 2015-09-24 06:22:04,872 [Thread-2] log: jetty-0.10-SNAPSHOT
INFO 2015-09-24 06:22:04,948 [Thread-2] log: Started
[email protected]:10080
Embedded server listening at
http://127.0.0.1:10080
Press any key to stop.
INFO 2015-09-24 06:22:05,194 [Thread-5] FlinkScheduler$: Accepting
INFO 2015-09-24 06:22:05,951 [flink-akka.actor.default-dispatcher-4]
Slf4jLogger: Slf4jLogger started
INFO 2015-09-24 06:22:06,243 [flink-akka.actor.default-dispatcher-4]
Remoting: Starting remoting
INFO 2015-09-24 06:22:06,536 [flink-akka.actor.default-dispatcher-4]
Remoting: Remoting started; listening on addresses
:[akka.tcp://[email protected]:6123]
INFO 2015-09-24 06:22:06,549 [Thread-3] JobManager: Starting JobManager
actor
INFO 2015-09-24 06:22:06,559 [Thread-3] BlobServer: Created BLOB server
storage directory /tmp/blobStore-b226277a-1f52-47ad-b3a5-c981cc67cb02
INFO 2015-09-24 06:22:06,560 [Thread-3] BlobServer: Started BLOB server at
0.0.0.0:50466 - max concurrent requests: 50 - max backlog: 1000
INFO 2015-09-24 06:22:06,588 [flink-akka.actor.default-dispatcher-4]
MemoryArchivist: Started memory archivist akka://flink/user/archive
INFO 2015-09-24 06:22:06,595 [flink-akka.actor.default-dispatcher-2]
JobManager: Starting JobManager at
akka.tcp://[email protected]:6123/user/jobmanager.
INFO 2015-09-24 06:22:06,623 [flink-akka.actor.default-dispatcher-2]
JobManager: JobManager akka.tcp://[email protected]:6123/user/jobmanager was
granted leadership with leader session ID None.
INFO 2015-09-24 06:22:06,638 [Thread-3] JobManager: Starting JobManger web
frontend
INFO 2015-09-24 06:22:06,640 [Thread-3] WebInfoServer: Setting up web info
server, using web-root directory
jar:file:/vagrant/flink-dist-0.10-SNAPSHOT.jar!/web-docs-infoserver.
INFO 2015-09-24 06:22:06,650 [Thread-3] log: jetty-0.10-SNAPSHOT
INFO 2015-09-24 06:22:06,656 [Thread-3] log: Started
[email protected]:8081
INFO 2015-09-24 06:22:06,656 [Thread-3] WebInfoServer: Started web info
server for JobManager on 0.0.0.0:8081
INFO 2015-09-24 06:22:06,978 [Thread-27] FlinkScheduler$: statusUpdate
received from taskId: TaskManager_1 slaveId:
20150924-052444-16842879-5050-1219-S0 [TASK_RUNNING]
DEBUG 2015-09-24 06:22:06,979 [Thread-27] FlinkScheduler$: No action to
take for statusUpdate TASK_RUNNING
INFO 2015-09-24 06:22:10,768 [Thread-28] FlinkScheduler$: Declining
offer(s) from slave 20150924-052444-16842879-5050-1219-S0 offered [cpus: 1.5 |
mem : 488.0 | disk: 33044.0] required [cpus: 0.5 | mem: 512.0 | disk: 1024.0]
```
> Integrate Flink with Apache Mesos
> ---------------------------------
>
> Key: FLINK-1984
> URL: https://issues.apache.org/jira/browse/FLINK-1984
> Project: Flink
> Issue Type: New Feature
> Components: New Components
> Reporter: Robert Metzger
> Priority: Minor
> Attachments: 251.patch
>
>
> There are some users asking for an integration of Flink into Mesos.
> There also is a pending pull request for adding Mesos support for Flink:
> https://github.com/apache/flink/pull/251
> But the PR is insufficiently tested. I'll add the code of the pull request to
> this JIRA in case somebody wants to pick it up in the future.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
