Is one set of Kafka Connect maintenance topics enough on a Kafka Cluster if multiple Kafka Connect clusters connect to it?

, Behrang Saeedzadeh

Re: How to seek to beginning of all partitions of a topic without issuing a poll first?

ion())) .collect(Collectors.toList()); consumer.assign(partitions); consumer.seekToBeginning(consumer.assignment()); Best regards, Behrang Saeedzadeh On 15 December 2017 at 14:08, Behrang Saeedzadeh <behran...@gmail.com> wrote: > Hi > > In my consumer app, in order to start

How to seek to beginning of all partitions of a topic without issuing a poll first?

approach available to assign partitions to the consumer that doesn't require issuing an initial poll? Best regards, Behrang Saeedzadeh

Using Bootstrap Server List for data center failover

consumer apps and updating the list of their bootstrap servers whenever a data center failover occurs. Best regards, Behrang Saeedzadeh

Does SinkTaskContext.timeout recall the connector's put method with the original collection of sink records?

Hi, If a connector encounters a temporary error (e.g. exceeding throughput) and it calls the timeout(long) method, would it get passed the same set of records that had caused the call to the timeout(long) method or should it internally keep track of these records? Best regards, Behrang

Kafka Connect sink connector in distributed mode: how are records distributed to workers?

are taken by Connect? In particular, if Connect unassigns some partitions from the given workers and assigns them to this new worker, would it wait for all in-flight records belonging to these partitions to be processed by the existing workers? Best regards, Behrang Saeedzadeh

None of [consumer.]max.partition.fetch.bytes, [consumer.]max.message.bytes are picked up by Connect

do that. Am I missing something here? Thanks in advance, Behrang -- Best regards, Behrang Saeedzadeh

Are there any connector configuration properties to limit the rate of messages that are sent from a Kafka cluster to a Kafka connector?

of data and 1000 records per second from a source Kafka cluster Thanks, Behrang -- Best regards, Behrang Saeedzadeh

Kafka Connect 0.10.1.1 does not pick-up my connector's log4j.properties

http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Where should I put the logging config so that Kafka Connect can pick it up? -- Best regards, Behrang Saeedzadeh

Does Kafka Connect have a built-in, connector-agnostic way to throttle its connection to a Kafka Cluster?

. The bandwidth between on-prem to AWS is limited and shared between many services in the organisation. Is there a way to configure Kafka Connect to make sure the connector does not read more than, say, 1MB/s from Kafka to ensure it does not saturate the bandwidth? Thanks, Behrang -- Best regards, Behrang