look through the Cluster Setup and Command- line execution pages but
could not find useful information.
Kind Regards,
Ravinder Kaur
streams left. The global result then has the aggregated key/value pairs.
Kind Regards,
Ravinder Kaur
On Wed, Apr 20, 2016 at 12:12 PM, Fabian Hueske wrote:
> Hi Ravinder,
>
> your drawing is pretty much correct (Flink will inject a combiner between
> flat map and reduce which loca
case the global result would have duplicates of strings and would be
wrong.
Could one of you kindly clarify what exactly happens?
Kind Regards,
Ravinder Kaur
eachable remote address [akka.tcp://
flink@10.155.208.156:6123]. Address is now gated for 5000 ms, all messages
to this address will be delivered to dead letters. Reason: The remote
system has quarantined this system. No further associations to the remote
system are possible until this system is restarted.
Could anyone explain what is the reason for the systems getting
disassociated and be quarantined?
Kind Regards,
Ravinder Kaur
as to why is it necessary
to allocate 50 GB of memory to taskmanager.heap.mb? Is the value I provided
not sufficient for the job? If this is so, how was I able to run the
previous examples with input datasets as large as 50GB error-free? It would
help if you could provide some explanation here?
Hello Ufuk,
Yes, the same WordCount program is being run.
Kind Regards,
Ravinder Kaur
On Tue, Mar 15, 2016 at 10:45 AM, Ufuk Celebi wrote:
> What do you mean with iteration in this context? Are you repeatedly
> running the same WordCount program for streaming and batch
> res
uld be some kind of failure why the taskmanager
> stopped working.
>
> Moreover, given that you have 64 GB of main memory, you could easily give
> 50GB as heap memory to each taskmanager.
>
> Cheers,
> Till
>
> On Tue, Mar 15, 2016 at 9:48 AM, Ravinder Kaur
> wrote:
>
ol$WorkQueue.runTask(ForkJoinPool.java:1339)
... 2 more
While I look at the results generated at each taskmanager, they are fine.
The logs also don't show any causes for the the job to get cancelled.
Could anyone kindly guide me here?
Kind Regards,
Ravinder Kaur.
andom port during job execution
for which I need to disable firewall using 'ufw allow port' during the
execution, otherwise the job hangs and finally fails. So I wanted to know
a particular range of ports which I can specify in the iptables to always
allow access.
Kind Regards,
Ravind
Hello All,
I need to know the range of ports that are being used during the
master/slave communication in the Flink cluster. Also is there a way I can
specify a range of ports, at the slaves, to restrict them to connect to
master only in this range?
Kind Regards,
Ravinder Kaur
On Wed, Feb 3
Hello,
Thank you very much. This was indeed the problem. The firewall was blocking
6123 and 43008. Also the user did not have permissions to unblock the
firewall.
Retried the following command with root privileges : ufw allow port
and this made the job run.
Kind Regards,
Ravinder Kaur
On Wed
not able to register at the job
> manager. Did you check the JobManager log? Do you see anything suspicious
> there? Are the ports matching?
>
>
> On Wed, Feb 3, 2016 at 9:23 PM, Ravinder Kaur wrote:
>
>> Hello,
>>
>> Thank you for pointing it out. I had a little
the JobManager log? Do you see anything suspicious
>> there? Are the ports matching?
>>
>>
>> On Wed, Feb 3, 2016 at 9:23 PM, Ravinder Kaur
>> wrote:
>>
>>> Hello,
>>>
>>> Thank you for pointing it out. I ha
ager.TaskManager
- Trying to register at JobManager
akka.tcp://flink@master-IP:6123/user/jobmanager
(attempt 5, timeout: 8000 milliseconds)
Kind Regards,
Ravinder Kaur
On Wed, Feb 3, 2016 at 8:12 PM, Stephan Ewen wrote:
> This looks like the reason:
>
> java.net.UnknownHostExceptio
askManager$.selectNetworkInterfaceAndRunTaskManager(TaskManager.scala:1328)
at
org.apache.flink.runtime.taskmanager.TaskManager$.main(TaskManager.scala:1240)
at
org.apache.flink.runtime.taskmanager.TaskManager.main(TaskManager.scala)
Kind Regards,
Ravinder Kaur
On Wed, Feb 3, 2016
output of starting the Jobmanager and Taskmanager but when I run jps
on the nodes the slave does not have the Taskmanager running.
Running the WordCount example again fails showing the same error. Stopping
the cluster says no taskmanager to stop.
Kind Regards,
Ravinder Kaur
On Wed, Feb 3, 2016 at 5:47
localhost:8080 says connection refused.
Kindly help me out as it is very important for me. Let me know if you have
any questions.
Kind Regards,
Ravinder Kaur
17 matches
Mail list logo
