Re: Making broadcast state queryable?

2019-09-15 Thread Yu Li
Thanks for the reply Oytun (and sorry for the late response, somehow just noticed). Requirement received, interesting one. Let's see whether this could draw any attention from the committers (smile). Best Regards, Yu On Fri, 6 Sep 2019 at 22:14, Oytun Tez wrote: > Hi Yu, > > Excuse my late

FLINK WEEKLY 2019/37

2019-09-15 Thread Zili Chen
FLINK WEEKLY 2019/37 中秋节快乐呀 >_< 这里依旧是小 tison 跟大家分享上周 FLINK 的新进展,主要包括 USER 列表的用户问题,社区开发的最新状态和 1.8.2 版本的发布。 USER 多个keyBy时,只有最后一个超作用吗?

Re: Will there be a Flink 1.9.1 release ?

2019-09-15 Thread Zili Chen
Hi Debasish, >From the information in the corresponding JIRA[1] 1.9.1 is not a fixed version of the issue you referred to. Technically Flink back ports notable fixes to brach release-1.9 and start the release of 1.9.1 from that branch. Visually, it looks like ... - ... - PR#9565 - ... - master

Re: [DISCUSS] Drop older versions of Kafka Connectors (0.9, 0.10) for Flink 1.10

2019-09-15 Thread Becket Qin
Thanks for bringing this up, Stephan. I am +1 on dropping support for Kafka 0.8. It is a pretty old version and I don't think there are many users on that version now. However, for Kafka 0.9, I think there are still quite some users on that version. It might be better to keep it a little longer.

Re: [EXTERNAL] High availability flink job

2019-09-15 Thread PoolakkalMukkath, Shakir
I do not think you will have any problem with one broker going down as long as you have provided enough brokers on the bootstrap. Thanks, Shakir From: Vishwas Siravara Date: Sunday, September 15, 2019 at 2:52 PM To: user Subject: [EXTERNAL] High availability flink job Hi guys, I have a flink

High availability flink job

2019-09-15 Thread Vishwas Siravara
Hi guys, I have a flink job running in standalone mode with a parallelism of >1 , that produces data to a kafka sink. My topic is replicated with a replication factor of 2. Now suppose one of the kafka brokers goes down , then will my streaming job fail ? Is there a way where in I can continue

[ANNOUNCE] Weekly Community Update 2019/37

2019-09-15 Thread Konstantin Knauf
Dear community, happy to share this week's community update with the release of Flink 1.8.2, more work in the area of dynamic resource management, three proposals in the SQL space and a bit more. Flink Development == * [releases] *Flink 1.8.2* has been released. [1] * [resource

Re: Use of loading flink-conf.yaml in Flink-sql client

2019-09-15 Thread Dipanjan Mazumder
Hi,    i was reading through the Flink docs, and i have got to an understanding that each application will have its own instance of Jobamanager and TaskManagers and so every application will have to have a initial configuration for defining the application topology to be drawn in the flink