Re: How to shut down Flink Web Dashboard in detached Yarn session?

2018-12-31 Thread Gary Yao
Hi, You can use the YARN client to list all applications on your YARN cluster: yarn application -list If this does not show any running applications, the Flink cluster must have somehow terminated. If you have YARN's log aggregation enabled, you should be able to view the Flink logs by runni

Re: [ANNOUNCE] Apache Flink 1.5.6 released

2018-12-31 Thread Stephan Ewen
Thank you to all who contributed, and, of course, especially to the release manager! On Fri, Dec 28, 2018 at 10:12 AM Till Rohrmann wrote: > Thanks a lot for being our release manager Thomas. Great work! Also thanks > to the community for making this release possible. > > Cheers, > Till > > On T

Re: [ANNOUNCE] Apache Flink 1.7.1 released

2018-12-31 Thread Stephan Ewen
Thank you very much for managing this bugfix release, Chesnay! On Tue, Dec 25, 2018 at 3:36 AM jincheng sun wrote: > Thanks for being the release manager Chesnay! > Thanks a lot for made this release possible! > > Thanks, > Jincheng > > Chesnay Schepler 于2018年12月23日周日 上午3:34写道: > >> The Apache

Re: [ANNOUNCE] Apache Flink 1.6.3 released

2018-12-31 Thread Stephan Ewen
Great work, thank you for volunteering to manage this release, Gordon! On Tue, Dec 25, 2018 at 3:30 AM jincheng sun wrote: > Thanks a lot for being our release manager Gordon. > Thanks a lot for made this release possible! > > Cheers, > Jincheng > > Tzu-Li (Gordon) Tai 于2018年12月23日周日 下午9:35写道:

Re: HA with HDFS question

2018-12-31 Thread Steven Nelson
Well, I have a fully functioning HDFS HA setup via a helm chart. My question is more about how to specify the hdfs nodename in such a way so that if a name node fails it communicates with the new active name node automatically. Swapnil mentioned configuring nameservice for hdfs namenode and I was l

Flink HA setup on Kubernetes

2018-12-31 Thread Steven Nelson
Hello! I am trying to setup Flink in an HA mode on Kubernetes. I have an existing Zookeeper cluster that is coming from my HDFS setup. I set the nodes up in a StatefulSet so I can get exactly 3 masters that have consistent names. The first node launches okay and I can see it when I view the port. H

Re: How to shut down Flink Web Dashboard in detached Yarn session?

2018-12-31 Thread Sai Inampudi
On 2018/12/31 10:53:58, Gary Yao wrote: > Hi, > > You can use the YARN client to list all applications on your YARN cluster: > > yarn application -list > > If this does not show any running applications, the Flink cluster must have > somehow terminated. If you have YARN's log aggregatio

Re: How to shut down Flink Web Dashboard in detached Yarn session?

2018-12-31 Thread Sai Inampudi
Hey Gary, thanks for reaching out. Executing "yarn application -list" does not return my flink cluster so I assume like in my initial post that the application must be terminated. My config when I ran the job did not have log aggregation enabled and that might be why when I try to look at the