Flink streaming Parallelism

2017-08-07 Thread Jakes John
I am coming from Apache Storm world. I am planning to switch from storm to flink. I was reading Flink documentation but, I couldn't find some requirements in Flink which was present in Storm. I need to have a streaming pipeline Kafka->flink-> ElasticSearch. In storm, I have seen that I

Re: Flink streaming Parallelism

2017-08-07 Thread Tzu-Li (Gordon) Tai
Hi, The equivalent would be setting a parallelism on your sink operator. e.g. stream.addSink(…).setParallelism(…). By default the parallelism of all operators in the pipeline will be whatever parallelism was set for the whole job, unless parallelism is explicitly set for a specific operator. Fo