Re: [DISCUSS] Drop Savepoint Compatibility with Flink 1.2

2020-02-23 Thread Yu Li
+1 for dropping savepoint compatibility with Flink 1.2. Best Regards, Yu On Sat, 22 Feb 2020 at 22:05, Ufuk Celebi wrote: > Hey Stephan, > > +1. > > Reading over the linked ticket and your description here, I think it makes > a lot of sense to go ahead with this. Since it's possible to upgrade

Re: FsStateBackend vs RocksDBStateBackend

2020-02-23 Thread Yu Li
Yes FsStateBackend would be the best fit for state access performance in this case. Just a reminder that FsStateBackend will upload the full dataset to DFS during checkpointing, so please watch the network bandwidth usage and make sure it won't become a new bottleneck. Best Regards, Yu On Fri, 2

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread Yu Li
Congratulations Jingsong! Well deserved. Best Regards, Yu On Mon, 24 Feb 2020 at 14:10, Congxian Qiu wrote: > Congratulations Jingsong! > > Best, > Congxian > > > jincheng sun 于2020年2月24日周一 下午1:38写道: > >> Congratulations Jingsong! >> >> Best, >> Jincheng >> >> >> Zhu Zhu 于2020年2月24日周一 上午11:5

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread Congxian Qiu
Congratulations Jingsong! Best, Congxian jincheng sun 于2020年2月24日周一 下午1:38写道: > Congratulations Jingsong! > > Best, > Jincheng > > > Zhu Zhu 于2020年2月24日周一 上午11:55写道: > >> Congratulations Jingsong! >> >> Thanks, >> Zhu Zhu >> >> Fabian Hueske 于2020年2月22日周六 上午1:30写道: >> >>> Congrats Jingsong!

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread jincheng sun
Congratulations Jingsong! Best, Jincheng Zhu Zhu 于2020年2月24日周一 上午11:55写道: > Congratulations Jingsong! > > Thanks, > Zhu Zhu > > Fabian Hueske 于2020年2月22日周六 上午1:30写道: > >> Congrats Jingsong! >> >> Cheers, Fabian >> >> Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong > >: >> >> > Congratula

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread Zhu Zhu
Congratulations Jingsong! Thanks, Zhu Zhu Fabian Hueske 于2020年2月22日周六 上午1:30写道: > Congrats Jingsong! > > Cheers, Fabian > > Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong >: > > > Congratulations Jingsong!! > > > > Cheers, > > Rong > > > > On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote:

Re: Flink on Kubernetes - Session vs Job cluster mode and storage

2020-02-23 Thread Yang Wang
Hi Singh, Glad to hear that you are looking to run Flink on the Kubernetes. I am trying to answer your question based on my limited knowledge and others could correct me and add some more supplements. I think the biggest difference between session cluster and per-job cluster on Kubernetesis the i

Re: yarn session: one JVM per task

2020-02-23 Thread Xintong Song
Hi David, In general, I don't think you can control all parallel subtasks of a certain task run in the same JVM process with the current Flink. If you job scale is very small, one thing you might try is to have only one task manager in the Flink session cluster. You need to make sure the task man

[ANNOUNCE] Weekly Community Update 2020/07

2020-02-23 Thread Konstantin Knauf
Dear community, happy to share this week's community digest with updates on the next release cycle, a set of proposal for Flink's web user interface, a couple of discussions around our development process and a bit more. Flink Development == * [releases] Stephan proposes an "anticipa

CfP: Workshop on Large Scale RDF Analytics (LASCAR-20) at ESWC'20

2020-02-23 Thread Hajira Jabeen
We apologize for cross-postings. We appreciate your great help in forwarding this CFP to your colleagues and friends.

Batch reading from Cassandra

2020-02-23 Thread Lasse Nedergaard
Hi. We would like to do some batch analytics on our data set stored in Cassandra and are looking for an efficient way to load data from a single table. Not by key, but random 15%, 50% or 100% Data bricks has create an efficient way to load Cassandra data into Apache Spark and they are doing it