Task is always created state after submit a example job
flink 1.11.2 on a single host. ./bin/start-cluster.sh and then ./bin/flink run examples/streaming/SocketWindowWordCount.jar --hostname localhost --port But on the jobmanager UI, the task is always in created state. There's available slots. Any insights on this? Thanks, Lei
Re: Task is always created state after submit a example job
Hi, I would start by looking at the Job Manager and Task Manager logs. Take a look if Task Managers connected/registered in the Job Manager and if so, if there were no problems when submitting the job. It seems like either there are not enough slots, or slots are actually not available. Best, Piotrek pt., 18 cze 2021 o 05:53 Lei Wang napisał(a): > flink 1.11.2 on a single host. > > ./bin/start-cluster.sh and then > > ./bin/flink run examples/streaming/SocketWindowWordCount.jar --hostname > localhost --port > > But on the jobmanager UI, the task is always in created state. There's > available slots. > > Any insights on this? > > Thanks, > Lei >
Re: Task is always created state after submit a example job
There's enough slots on the jobmanger UI, but the slots are not available. After i add taskmanager.host: localhost to flink-conf.yaml, it works. But i don't know why. Thanks, Lei On Fri, Jun 18, 2021 at 6:07 PM Piotr Nowojski wrote: > Hi, > > I would start by looking at the Job Manager and Task Manager logs. Take a > look if Task Managers connected/registered in the Job Manager and if so, if > there were no problems when submitting the job. It seems like either there > are not enough slots, or slots are actually not available. > > Best, > Piotrek > > pt., 18 cze 2021 o 05:53 Lei Wang napisał(a): > >> flink 1.11.2 on a single host. >> >> ./bin/start-cluster.sh and then >> >> ./bin/flink run examples/streaming/SocketWindowWordCount.jar --hostname >> localhost --port >> >> But on the jobmanager UI, the task is always in created state. There's >> available slots. >> >> Any insights on this? >> >> Thanks, >> Lei >> >
Re: Task is always created state after submit a example job
I'm glad that you managed to work it out. As far as I understand, without specifying the `taskmanager.host`, Task Manager would try to automatically detect what host/ip address should be advertised to the Job Manager, using which JM can connect to TM. I don't know what is your network setup, what are the local network cards, firewall or routing settings, but either of those can lead to some connection issues. For example your local machine not being accessible via using 127.0.0.1, but "localhost" working fine. This automatically detected address is logged in the TM logs "TaskManager will use hostname/address '{}' ({}) for communication", so if it matters to you, you can check what was the detected address without specifying `taskmanager.host`, and try to workout what's wrong with it. But it's most likely not a Flink issue. Best, Piotrek niedz., 20 cze 2021 o 16:17 Lei Wang napisał(a): > There's enough slots on the jobmanger UI, but the slots are not available. > > After i add taskmanager.host: localhost to flink-conf.yaml, it works. > > But i don't know why. > > Thanks, > Lei > > > On Fri, Jun 18, 2021 at 6:07 PM Piotr Nowojski > wrote: > >> Hi, >> >> I would start by looking at the Job Manager and Task Manager logs. Take a >> look if Task Managers connected/registered in the Job Manager and if so, if >> there were no problems when submitting the job. It seems like either there >> are not enough slots, or slots are actually not available. >> >> Best, >> Piotrek >> >> pt., 18 cze 2021 o 05:53 Lei Wang napisał(a): >> >>> flink 1.11.2 on a single host. >>> >>> ./bin/start-cluster.sh and then >>> >>> ./bin/flink run examples/streaming/SocketWindowWordCount.jar --hostname >>> localhost --port >>> >>> But on the jobmanager UI, the task is always in created state. There's >>> available slots. >>> >>> Any insights on this? >>> >>> Thanks, >>> Lei >>> >>