Oh, I can’t attach files. Here are my log data
*************************Job manager************************************
21:24:59,837 WARN org.apache.hadoop.util.NativeCodeLoader
- Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- -------------------------------------------------------
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- Starting JobManager (Version: 0.9-SNAPSHOT, Rev:bed3da4, Date:20.02.2015 @
20:40:35 IST)
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- Current user: Vidura
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.5-b02
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- Startup Options: -Xms768m -Xmx768m
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- Maximum heap size: 736 MiBytes
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- JAVA_HOME: /Library/Java/JavaVirtualMachines/jdk1.8.0_05.jdk/Contents/Home
21:24:59,924 INFO org.apache.flink.runtime.jobmanager.JobManager
- -------------------------------------------------------
21:25:00,194 INFO org.apache.flink.runtime.jobmanager.JobManager
- Starting JobManager
21:25:00,625 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
21:25:00,675 INFO Remoting
- Starting remoting
21:25:00,839 INFO Remoting
- Remoting started; listening on addresses
:[akka.tcp://flink@10.216.192.98:6123]
21:25:00,856 INFO org.apache.flink.runtime.blob.BlobServer
- Created BLOB server storage directory
/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-efad515a-da85-4c39-afeb-1aef1d965aef
21:25:00,864 INFO org.apache.flink.runtime.blob.BlobServer
- Started BLOB server at 0.0.0.0:49678 - max concurrent requests: 50 - max
backlog: 1000
21:25:00,876 INFO org.apache.flink.runtime.jobmanager.JobManager
- Starting embedded TaskManager for JobManager's LOCAL mode execution
21:25:00,881 INFO org.apache.flink.runtime.jobmanager.JobManager
- Starting JobManager at akka://flink/user/jobmanager.
21:25:00,883 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Using 0.7 of the free heap space for managed memory.
21:25:00,941 INFO org.apache.flink.runtime.jobmanager.JobManager
- Starting JobManger web frontend
21:25:00,945 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Starting task manager at akka://flink/user/taskmanager.
21:25:00,945 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Creating 1 task slot(s).
21:25:00,946 INFO org.apache.flink.runtime.taskmanager.TaskManager
- TaskManager connection information 127.0.0.1 (dataPort=49679).
21:25:00,948 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Temporary file directory '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T':
total 232 GB, usable 14 GB (6.03% usable)
21:25:00,951 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager
- I/O manager uses directory
/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/flink-io-e9999120-d46d-47f1-8784-094a833cedb1
for spill files.
21:25:00,953 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer
- Setting up web info server, using web-root
directoryjar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-runtime-0.9-SNAPSHOT.jar!/web-docs-infoserver.
21:25:01,304 INFO org.eclipse.jetty.util.log
- jetty-8.0.0.M1
21:25:01,338 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Profiling of jobs is disabled.
21:25:01,338 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Memory usage stats: [HEAP: 523/736/736 MB, NON HEAP: 28/28/-1 MB
(used/committed/max)]
21:25:01,342 INFO org.eclipse.jetty.util.log
- Started SelectChannelConnector@0.0.0.0:8081
21:25:01,342 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer
- Started web info server for JobManager on null:8081
21:25:01,405 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Try to register at master
akka.tcp://flink@10.216.192.98:6123/user/jobmanager. 1. Attempt
21:25:01,410 INFO org.apache.flink.runtime.instance.InstanceManager
- Registered TaskManager at 127 (akka://flink/user/taskmanager) as
60cbc9f7d2513d5fdec5b26970d30b85. Current number of registered hosts is 1.
21:25:01,555 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool
- Allocated 64 MB for network buffer pool (number of memory segments: 2048,
bytes per segment: 32768).
21:25:01,558 INFO org.apache.flink.runtime.taskmanager.TaskManager
- Determined BLOB server address to be localhost/10.216.192.98:49678.
21:25:01,559 INFO org.apache.flink.runtime.blob.BlobCache
- Created BLOB cache storage directory
/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-575d89fe-e45a-4729-823c-1e24a6c394ad
********************************************************************
**********************Webclient***********************************
21:25:09,556 INFO org.apache.flink.client.web.WebInterfaceServer
- Setting up web frontend server, using web-root directory
'jar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-clients-0.9-SNAPSHOT.jar!/web-docs'.
21:25:09,558 INFO org.apache.flink.client.web.WebInterfaceServer
- Web frontend server will store temporary files in
'/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T', uploaded jobs in
'/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-jobs',
plan-json-dumps in
'/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-plans'.
21:25:09,558 INFO org.apache.flink.client.web.WebInterfaceServer
- Web-frontend will submit jobs to nephele job-manager on localhost, port 6123.
21:25:10,231 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
21:25:10,291 INFO Remoting
- Starting remoting
21:25:10,469 INFO Remoting
- Remoting started; listening on addresses
:[akka.tcp://JobsInfoServletActorSystem@127.0.0.1:49683]
21:26:25,710 WARN Remoting
- Tried to associate with unreachable remote address
[akka.tcp://flink@10.216.192.98:6123]. Address is now gated for 5000 ms, all
messages to this address will be delivered to dead letters. Reason: Operation
timed out: /10.216.192.98:6123
21:26:25,715 ERROR org.apache.flink.client.WebFrontend
- Unexpected exception: Could not find job manager at specified address
akka.tcp://flink@10.216.192.98:6123/user/jobmanager.
java.lang.RuntimeException: Could not find job manager at specified address
akka.tcp://flink@10.216.192.98:6123/user/jobmanager.
at
org.apache.flink.client.web.JobsInfoServlet.<init>(JobsInfoServlet.java:82)
at
org.apache.flink.client.web.WebInterfaceServer.<init>(WebInterfaceServer.java:158)
at org.apache.flink.client.WebFrontend.main(WebFrontend.java:74)
************************************************************************************
> On Feb 24, 2015, at 9:32 PM, Dulaj Viduranga <vidura...@icloud.com> wrote:
>
> Hi,
> I still couldn’t figure out a solution. The logs for Jobmanager and webclient
> follows… It would be great if someone could take a look… Thanks
>
>
>
>> On Feb 24, 2015, at 1:41 PM, Stephan Ewen <se...@apache.org> wrote:
>>
>> Hey Dulaj!
>>
>> As a contributor, I would go against the latest version, which is
>> 0.9-SNAPSHOT.
>>
>> It may be in your case that the JobManager actor is down, but the process
>> still lingers. (BTW: I have a patch pending that makes sure the process
>> disappears when the actor via down).
>>
>> Could you have a look at the log "flink-<user>-jobmanager-<host>-.log" and
>> see if there are any errors logged?
>>
>> Greetings,
>> Stephan
>> Am 24.02.2015 06:29 schrieb "Dulaj Viduranga" <vidura...@icloud.com>:
>>
>>> The JobManager seems to run fine. I don't know. When I tried to run
>>> start-local.sh again, It shows the PID of the running JobManager and also
>>> :8081 runs fine. I want to contribute to the project and I could get a
>>> little boost if I could see the capabilities of FLINK. :)
>>> Will it be OK to use 0.8.1 as a developer?
>>>
>>> On Feb 24, 2015, at 04:15 AM, Stephan Ewen <se...@apache.org> wrote:
>>>
>>> Hi Dulaj,
>>>
>>> That error message indicates that the JobManager is not running. Are you
>>> sure that the JobManager runs properly? Anything in the JobManager logs?
>>>
>>> BTW: The 0.9 branch is under heavy development / changes. That is why it
>>> may behave a bit different on different days right now. I would recommend
>>> to use the 0.8.1 release for a stable experience.
>>>
>>> Greetings,
>>> Stephan
>>>
>>>
>>> On Mon, Feb 23, 2015 at 7:39 PM, Robert Metzger <rmetz...@apache.org>
>>> wrote:
>>>
>>> Thank you for the quick reply.
>>>
>>> The log you've send is from the webclient. Can you also send the log of the
>>>
>>> JobManager?
>>>
>>> On Mon, Feb 23, 2015 at 7:28 PM, Dulaj Viduranga <vidura...@icloud.com>
>>>
>>> wrote:
>>>
>>>> Yes. It seams it is not a problem with the arguments. I tried two days
>>>
>>> but
>>>
>>>> different error occurs. It seams the web client can’t connect to the job
>>>
>>>> manager although it is running
>>>
>>>> Right now, I can’t even get the webclient to run.
>>>
>>> ./bin/start-webclient.sh
>>>
>>>> executes fine but I cannot connect to localhost:8080 (even with telnet or
>>>
>>>> curl)
>>>
>>>> Here is the log for jobManager
>>>
>>>>
>>>
>>>> 23:22:31,933 INFO org.apache.flink.client.web.WebInterfaceServer
>>>
>>>> - Setting up web frontend server, using web-root directory
>>>
>>>>
>>>
>>> 'jar:
>>> file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-clients-0.9-SNAPSHOT.jar!/web-docs
>>> '.
>>>
>>>> 23:22:31,934 INFO org.apache.flink.client.web.WebInterfaceServer
>>>
>>>> - Web frontend server will store temporary files in
>>>
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T', uploaded jobs in
>>>
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-jobs',
>>>
>>>> plan-json-dumps in
>>>
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-plans'.
>>>
>>>> 23:22:31,934 INFO org.apache.flink.client.web.WebInterfaceServer
>>>
>>>> - Web-frontend will submit jobs to nephele job-manager on
>>>
>>> localhost,
>>>
>>>> port 6123.
>>>
>>>> 23:22:32,580 INFO akka.event.slf4j.Slf4jLogger
>>>
>>>> - Slf4jLogger started
>>>
>>>> 23:22:32,625 INFO Remoting
>>>
>>>> - Starting remoting
>>>
>>>> 23:22:32,838 INFO Remoting
>>>
>>>> - Remoting started; listening on addresses :[akka.tcp://
>>>
>>>
>>>> JobsInfoServletActorSystem@127.0.0.1:51517]
>>>
>>>> 23:23:48,119 WARN Remoting
>>>
>>>> - Tried to associate with unreachable remote address [akka.tcp://
>>>
>>>
>>>> flink@10.218.98.169:6123]. Address is now gated for 5000 ms, all
>>>
>>> messages
>>>
>>>> to this address will be delivered to dead letters. Reason: Operation
>>>
>>> timed
>>>
>>>> out: /10.218.98.169:6123
>>>
>>>> 23:23:48,124 ERROR org.apache.flink.client.WebFrontend
>>>
>>>> - Unexpected exception: Could not find job manager at specified
>>>
>>>> address akka.flink@10.218.98.169:6123/user/jobmanager'>tcp://
>>> flink@10.218.98.169:6123/user/jobmanager.
>>>
>>>> java.lang.RuntimeException: Could not find job manager at specified
>>>
>>>> address akka.flink@10.218.98.169:6123/user/jobmanager'>tcp://
>>> flink@10.218.98.169:6123/user/jobmanager.
>>>
>>>> at
>>>
>>>>
>>>
>>> org.apache.flink.client.web.JobsInfoServlet.<init>(JobsInfoServlet.java:82)
>>>
>>>> at
>>>
>>>>
>>>
>>>
>>> org.apache.flink.client.web.WebInterfaceServer.<init>(WebInterfaceServer.java:158)
>>>
>>>> at org.apache.flink.client.WebFrontend.main(WebFrontend.java:74)
>>>
>>>>
>>>
>>>>
>>>
>>>>> On Feb 23, 2015, at 11:46 PM, Robert Metzger <rmetz...@apache.org>
>>>
>>>> wrote:
>>>
>>>>>
>>>
>>>>> Hi,
>>>
>>>>> you said in the other email thread that the error only occurs for
>>>
>>>>> Wordcount, not for Kmeans.
>>>
>>>>> Can you copy me the commands for both examples?
>>>
>>>>> I can not really believe that there is a difference between the two
>>>
>>> jobs.
>>>
>>>>>
>>>
>>>>> Can you also send us the contents of the jobmanager log file?
>>>
>>>>>
>>>
>>>>> Best,
>>>
>>>>> Robert
>>>
>>>>>
>>>
>>>>>
>>>
>>>>> On Mon, Feb 23, 2015 at 6:04 PM, Dulaj Viduranga <vidura...@icloud.com
>>>
>>>
>>>>
>>>
>>>>> wrote:
>>>
>>>>>
>>>
>>>>>> I’m getting "Could not build up connection to JobManager.” When i
>>>
>>> tried
>>>
>>>> to
>>>
>>>>>> run the wordCount example. Can anyone help?
>>>
>>>>>>
>>>
>>>>>> Dulaj
>>>
>>>>
>>>
>>>>
>>>
>>>
>
