Re: A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread aitozi
Hi Zhijiang, Thanks for your explanation, I have understood it. My former thoughts was wrong, the real TCP channel was established when createPartitionRequestClient. Thanks, Aitozi -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread zhijiang
Hi Aitozi, The current connection sharing is only suitbale for the same jobVertex between TaskMangaers via ConnectionIndex. I ever tried to remove this limit by ticket [1] but have not reached an agreement on this. You could watch this jira if interested. [1] https://issues.apache.org/jira/bro

Re: How to join/group 2 streams by key?

2019-06-16 Thread Congxian Qiu
Hi John I've seen other people have the same problem to solve, the following is their solution: union the two Datastreams, then use ProcsssFunction[1] to solve this, will also register timers to do GC things. [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/process_

Re: Building flink from source---error of resolving dependencies

2019-06-16 Thread syed
DeAR Fabian; THANKS FOR YOUR ANSWER! I tried to build the flink again, but after several tries I am still facing the same error. Is there any other alternative to resolve the dependencies to successfully build the flink? Kind Regards; Syed -- Sent from: http://apache-flink-user-mailing-list-

Re: [ANNOUNCE] Weekly Community Update 2019/24

2019-06-16 Thread Zili Chen
Hi Konstantin and all, Thank Konstantin very much for reviving this tradition! It reminds me of the joyful time I can easily catch up interesting ongoing threads. Thanks for Till's work, too. Besides exciting updates and news above, I'd like to pick up some other threads you guys may be intereste

[ANNOUNCE] Weekly Community Update 2019/24

2019-06-16 Thread Konstantin Knauf
Dear community, last year Till did a great job on summarizing recent developments in the Flink community in a "Weekly community update" thread. I found this very helpful and would like to revive this tradition with a focus on topics & threads which are particularly relevant to the wider community

A little doubt about the blog A Deep To Flink's NetworkStack

2019-06-16 Thread aitozi
Hi, community I read this blog A Deep To Flink's NetworkStack In the chapter *Physical Transport*, it says that the /if different subtasks of the same task are scheduled onto the same TaskManager, their network connections towards

Asynchronous I/O

2019-06-16 Thread Halfon, Roey
Hi All, I have a flow which contains few external REST calls, in few different operators. As I read in documentation, using AsyncFunction is the recommended way to execute these calls. Few questions regarding that: 1. Can someone explain better the 'capacity' parameter? How it affects latency/