Re: FLIP 27 is not already, how can i workaround ?

2020-03-14 Thread Jingsong Li
Hi forideal, I got your point. About replay kafka history data, if the data came in flink very unbalanced between partitions. That maybe lead to very big state, and lead to disk/memory unstable. And Yes, FLIP-27 can help you. About work around way, IMO, it maybe a little hacky but works. And it s

Re: Stop job with savepoint during graceful shutdown on a k8s cluster

2020-03-14 Thread shravan
Our understanding is to stop job with savepoint, all the task manager will persist their state during savepoint. If a Task Manager receives a shutdown signal while savepoint is being taken, does it complete the savepoint before shutdown ? [Ans ] Why task manager is shutdown suddenly? Are you saying

Re: How to change the flink web-ui jobServer?

2020-03-14 Thread LakeShen
Ok, thanks! Arvid Arvid Heise 于2020年3月10日周二 下午4:14写道: > Hi LakeShen, > > you can change the port with > > conf.setInteger(RestOptions.PORT, 8082); > > or if want to be on the safe side specify a range > > conf.setString(RestOptions.BIND_PORT, "8081-8099"); > > > On Mon, Mar 9, 2020 at 10:47 AM L

Re: How to change the flink web-ui jobServer?

2020-03-14 Thread tison
IIRC Flink on Kubernetes doesn't support configure rest port as port range. Maybe Yang(in cc) can give more information and if so, our current logic only take care of RestOptions.PORT but not RestOptions.BIND_PORT, which will be a bug. Best, tison. LakeShen 于2020年3月15日周日 上午11:25写道: > Ok, than