Suggestions on canarying traffic for kafka consumers.

2021-01-23 Thread Devaki, Srinivas
Hi Folks, Canarying traffic is an excellent way of reducing the impact when releasing a new release with a bug. Such canarying is somewhat easier with a few queueing backends like sqs & redis. In sqs for example each application container/instance of canary can self regulate how much throughput

Guideline on higher version client to lower version Broker?

2021-01-23 Thread Ming Liu
Hi, I wonder what is the guideline on those scenarios? Is it recommended even if it is working? 1. Client 2.5.1, Broker 2.5.0 2. Client 2.6.1, Broker 2.5.0 Thanks! Ming

Re: Kafka Consumer Consumption based on TimeStamp-based position

2021-01-23 Thread M. Manna
Thanks. Just realised that it was in the API since 0.11.0. Thanks Steve. On Sat, 23 Jan 2021 at 12:42, Steve Howard wrote: > Hi, > > Yes, you can use the offsetsForTimes() method. See below for a simple > example that should get you started... > > import org.apache.kafka.clients.consumer.*; >

Re: Kafka Consumer Consumption based on TimeStamp-based position

2021-01-23 Thread Steve Howard
Hi, Yes, you can use the offsetsForTimes() method. See below for a simple example that should get you started... import org.apache.kafka.clients.consumer.*; import org.apache.kafka.common.config.ConfigException; import org.apache.kafka.common.*; import java.io.*; import java.time.Duration;

Kafka Consumer Consumption based on TimeStamp-based position

2021-01-23 Thread M. Manna
Hello, We know that using KafkaConsumer api we can replay messages from certain offsets. However, we are not sure if we could specify timeStamp from which we could replay messages again. Does anyone know if this is possible? Regards,