Takes an array of topics (although there is a PR that will move the
splitting of multiple topics into the operator):
https://github.com/apache/incubator-apex-malhar/blob/devel-3/kafka/src/main/java/org/apache/apex/malhar/kafka/AbstractKafkaInputOperator.java#L369
On Wed, Jan 27, 2016 at 5:30 PM,
Thanks Thomas. How do I specify multiple topics on the operator?
On Wed, Jan 27, 2016 at 5:15 PM, Thomas Weise
wrote:
> The new operator for Kafka 0.9 can read multiple topics.
>
>
> On Wed, Jan 27, 2016 at 5:02 PM, Munagala Ramanath
> wrote:
>
>> Since a single AbstractKafkaInputOperator has a
The new operator for Kafka 0.9 can read multiple topics.
On Wed, Jan 27, 2016 at 5:02 PM, Munagala Ramanath
wrote:
> Since a single AbstractKafkaInputOperator has a single KafkaConsumer and
> the latter has only a single topic,
> it appears that the only option is to have one input operator per
Since a single AbstractKafkaInputOperator has a single KafkaConsumer and
the latter has only a single topic,
it appears that the only option is to have one input operator per topic.
There also seems to be some machinery to get a reasonable mapping of input
operator partitions to
topic partitions,
Hi,
Does the kafka input operator support reading from multiple kafka topics?
What is the suggested approach to deal with reading from multiple topics?
--
Regards,
Ashwin.
