Re: Auto Scaling in Flink

2019-12-03 Thread vino yang
out to to Pravega Community but just checking here. > > Thanks, > Akash Goel > > On Fri, Nov 29, 2019 at 11:14 AM Caizhi Weng wrote: > >> Hi Akash, >> >> Flink doesn't support auto scaling in core currently, it may be supported >> in the future,

Re: Auto Scaling in Flink

2019-12-03 Thread Akash Goel
ash, > > Flink doesn't support auto scaling in core currently, it may be supported > in the future, when the new scheduling architecture is implemented > https://issues.apache.org/jira/browse/FLINK-10407 . > > You can do it externally by cancel the job with a savepoint, update the >

Re: Auto Scaling in Flink

2019-11-28 Thread Caizhi Weng
Hi Akash, Flink doesn't support auto scaling in core currently, it may be supported in the future, when the new scheduling architecture is implemented https://issues.apache.org/jira/browse/FLINK-10407 . You can do it externally by cancel the job with a savepoint, update the parallelism

Re: Auto Scaling in Flink

2019-11-28 Thread vino yang
Hi Akash, You can use Pravega connector to integrate with Flink, the source code is here[1]. In short, relying on its rescalable state feature[2] flink supports scalable streaming jobs. Currently, the mainstream solution about auto-scaling is Flink + K8S, I can share some resources with you[3

Auto Scaling in Flink

2019-11-28 Thread Akash Goel
Hi, Does Flunk support auto scaling. I read that it is supported using pravega? Is it incorporated in any version. Thanks, Akash Goel