Re: read from multiple kafka topics

2016-01-27 Thread Munagala Ramanath
Since a single AbstractKafkaInputOperator has a single KafkaConsumer and the latter has only a single topic, it appears that the only option is to have one input operator per topic. There also seems to be some machinery to get a reasonable mapping of input operator partitions to topic partitions,

Re: read from multiple kafka topics

2016-01-27 Thread Thomas Weise
The new operator for Kafka 0.9 can read multiple topics. On Wed, Jan 27, 2016 at 5:02 PM, Munagala Ramanath wrote: > Since a single AbstractKafkaInputOperator has a single KafkaConsumer and > the latter has only a single topic, > it appears that the only option is to have