Hi
I am trying to build a cluster for flink with 1 master and 2 workers.
The program is working fine locally. The messages are read from Kafka and
just printed on STDOUT.
The cluster is successfully created and UI is also shows all config. But
the job fails to execute on the cluster.
Here are fe
Hi,
I don't think this is a bug. It looks like the machines can not talk to
each other. Can you validate that all the machines can talk to each other
on the ports used by Flink (6123, 8081, ...)
If that doesn't help:
- How is the network set up?
- Are you running physical machines / VMs / containe
The cluster is set up on AWS with 1 Job manager and 2 task managers.
They all belong to same security group with 6123, 8081, 50100 - 50200 ports
having access granted
Job manager config is as follows :
FLINK_PLUGINS_DIR : /usr/local/flink-1.9.1/plugins
io.tmp.dirs
I figured out that it was problem with the ports. 39493/34094 were not
accessible. So to get this working I opened all the ports 0-65535 for the
security group.
How do I control that if I want to open only certain range of ports ?
Is "taskmanager.rpc.port" the right parameter to set ? I did try a
Maybe you forget to limit the blob server port(blob.server.port) to the
range.
Best,
Yang
Milind Vaidya 于2020年2月7日周五 上午7:03写道：
> I figured out that it was problem with the ports. 39493/34094 were not
> accessible. So to get this working I opened all the ports 0-65535 for the
> security group.
I tried setting that option but did not work.
2020-02-07 19:28:45,999 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager -
Registering TaskManager with ResourceID 32fb9e7dcc9d41917bce38a2d5bb0093
(akka.tcp://flink@ip-1:34718/user/taskmanager_0) at ResourceManager
2020-02-07
Hey Milind,
can you additionally also set
metrics.internal.query-service.port
to the range?
Best,
Robert
On Fri, Feb 7, 2020 at 8:35 PM Milind Vaidya wrote:
> I tried setting that option but did not work.
>
> 2020-02-07 19:28:45,999 INFO
> org.apache.flink.runtime.resourcemanager.Standalo
