Re: Threading issue

2017-03-23 Thread Robert Metzger
Hi, how many unique combinations of your key "partition","threadNumber","schemaId" exist? In my opinion, all sinks should receive data if there are enough different keys. On Wed, Mar 22, 2017 at 3:41 AM, Telco Phone wrote: > I am looking to get readers from kafka / keyBy and Sink working with

Threading issue

2017-03-21 Thread Telco Phone
I am looking to get  readers from kafka / keyBy and Sink working with all 60 threads. For the most part it is working correctly DataStream stream =env.addSource(new FlinkKafkaConsumer08<>("kafkatopic", schema, properties)).setParallelism(60).flatMap(new SchemaRecordSplit()).setParallelism(60).n