GitHub user relief-melone edited a discussion: Should Kafka Source Connector itsself after unrecoverable error?
This is concerning the pulsar-io/kafka-source. Before I create an issue regarding this topic I would like to have some insight if the current behaviour is actually wrong or if there are already config values to adress this. We recently had an issue that caused the consumer in a kafka source connector to get kicked out of kafkas consumer group. The connector is running as a pod inside of kubernetes. The consumer is unrecoverable at that point so the source connector should have two options - create a new consumer and connect - end the process which would in turn result in another pod being spun up if this is a scenario where the connector is deployed in kubernetes However I feel like the connector just sitting there not consuming messages from kafka anymore is the wrong behaviour. Am I missing a config value? Would be happy to get your opinion on that and gladly create an issue as well if necessary GitHub link: https://github.com/apache/pulsar/discussions/19880 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
