Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-04 Thread Piotr Nowojski
Hi, I’m not if I understand your question/concerns. As Rong Rong explained, key selector is used to assign records to window operators. Within key context, you do not have access to other keys/values in your operator/functions, so your reduce/process/… functions when processing key:1 won’t

Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-03 Thread 刘 文
Sorry, I still don't understand. Can I ask for help again? For example, the degree of parallelism is 2, which will produce two Window threads. ).setParallelism(2) ).These two windows are how to read their own partition data. ).input data 1 2 3 4 5 6 7 8 9 10 ).source -> operator ->

Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-03 Thread Rong Rong
Hi I am not sure if I understand your question correctly, so will try to explain the flow how elements gets into window operators. Flink makes the partition assignment before invoking the operator to process element. For the word count example, WindowOperator is invoked by

[Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs to?

2019-03-03 Thread 刘 文
). Environment Flink1.7.2 WordCount local, stream processing ).source RecordWriter.emit(), for each element by key, divided into different partitions, the partition location of each element has been determined, the number of partitions is determined by DataStream.setParallelism(2) ). By