Re: Problem with Kafka group.id

I had exact same issue, the temp fix what I did was, took open source code from github, modified the group.id mandatory logic and built customized library. Thanks, On Tue, Mar 17, 2020 at 7:34 AM Sjoerd van Leent < sjoerd.van.le...@alliander.com> wrote: > Dear reader, > > > > I must force the

unsubscribe

unsubscribe

unsubscribe

Re: [Spark Streaming Kafka 0-10] - What was the reason for adding "spark-executor-" prefix to group id in executor configurations

rference from any other consumer" > 2. Consumers may eat the data from each other, offset calculation may give > back wrong result (that's the reason why "extreme caution" is recommended > in Structured Streaming doc which still applies here) > 3. yes > > BR, > G

Re: [Spark Streaming Kafka 0-10] - What was the reason for adding "spark-executor-" prefix to group id in executor configurations

ause > Structured Streaming has another interesting feature: > groupIdPrefix string spark-kafka-source streaming and batch Prefix of > consumer group identifiers (`group.id`) that are generated by structured > streaming queries. If "kafka.group.id" is set, this option will be > ignored. > &

Re: [Spark Streaming Kafka 0-10] - What was the reason for adding "spark-executor-" prefix to group id in executor configurations

ng has another interesting feature: > groupIdPrefix string spark-kafka-source streaming and batch Prefix of > consumer group identifiers (`group.id`) that are generated by structured > streaming queries. If "kafka.group.id" is set, this option will be > ignored. > > BR, &g

[Spark Streaming Kafka 0-10] - What was the reason for adding "spark-executor-" prefix to group id in executor configurations

Hi Team, We have secured Kafka cluster (which only allows to consume from the pre-configured, authorized consumer group), there is a scenario where we want to use spark streaming to consume from secured kafka. so we have decided to use spark-streaming-kafka-0-10