Hi Ufuk,
Sure... I will let you know. I'm planning to use centralized zookeeper.
That way Flink and ZK will have the separation.
On Fri, Feb 19, 2016 at 12:06 PM, Ufuk Celebi wrote:
> OK, nice! :-) Then you can just skip the "slaves" file and directly
> work with the scripts.
>
> I'm curious to
OK, nice! :-) Then you can just skip the "slaves" file and directly
work with the scripts.
I'm curious to know if everything works as expected. If you encounter
something that seems wrong, let us know.
– Ufuk
On Fri, Feb 19, 2016 at 9:02 PM, Deepak Jha wrote:
> Hi Ufuk,
> I'm planning to build
Hi Ufuk,
I'm planning to build Flink HA cluster and I may need to autoscale
taskmanager based on the the requirement. I feel it makes more sense for me
to start each taskmanager & jobmanager individually using taskmanager.sh
and jobmanager.sh and let these taskmanager's discover jobmanager's using
No, the "slaves" file is still used to ssh into the machines and start
the task manager processes in the start-cluster.sh script. So you
still need password-less ssh into the machines if you want to use
that. The task managers discover the job manager via ZooKeeper though
(therefore you don't need
Hi Max and Stephan,
Does this mean that I can start Flink HA cluster without keeping any entry
in "slaves" file ? I'm asking this because then I should not worry about
copying public key for password-less ssh in Flink HA cluster
On Wed, Feb 17, 2016 at 12:38 PM, Deepak Jha wrote:
> Sorry for
Sorry for the typo Stephan
On Wednesday, February 17, 2016, Deepak Jha wrote:
> Thanks Max and Steven for the response.
>
> On Wednesday, February 17, 2016, Stephan Ewen > wrote:
>
>> Hi Deepak!
>>
>> The "slaves" file is only used by the SSH script to start a standalone
>> cluster.
>>
>> As Ma
Thanks Max and Steven for the response.
On Wednesday, February 17, 2016, Stephan Ewen wrote:
> Hi Deepak!
>
> The "slaves" file is only used by the SSH script to start a standalone
> cluster.
>
> As Max said, TaskManagers register dynamically at the JobManager.
>
> Discovery works via:
>- co
Hi Deepak!
The "slaves" file is only used by the SSH script to start a standalone
cluster.
As Max said, TaskManagers register dynamically at the JobManager.
Discovery works via:
- config in non-HA mode
- ZooKeeper in HA mode
On Wed, Feb 17, 2016 at 10:11 AM, Maximilian Michels wrote:
Hi Deepak,
The job manager doesn't have to know about task managers. They will
simply register at the job manager using the provided configuration.
In HA mode, they will lookup the currently leading job manager first
and then connect to it. The job manager can then assign work.
Cheers,
Max
On Tu
Hi All,
I have a question on scaling-up/scaling-down flink cluster.
As per the documentation, in order to scale-up the cluster, I can add a new
taskmanager on the fly and jobmanager can assign work to it. Assuming, I
have Flink HA , so in the event of master JobManager failure, how is this
taskmana
10 matches
Mail list logo
