Re: ConsumeKafka to PublishKafka doesn't keep the order of the messages in the destination topic

2024-01-02 Thread edi mari
lowFiles out of order. > > Thanks > -Mark > > > On Dec 15, 2023, at 2:26 AM, edi mari wrote: > > Hi Mark, > I tried the combination of FIFO and setting the back pressure to 10k, but > it didn't preserve the order. > > Thanks > Edi > > On Wed, Dec 13, 202

Re: ConsumeKafka to PublishKafka doesn't keep the order of the messages in the destination topic

2023-12-14 Thread edi mari
connection’s configuration and adding the First In First Out > Prioritizer. > > Also of note you will want to keep the backpressure threshold set to > 10,000 objects rather than increasing it as shown in the image. > > Thanks > Mark > > > Sent from my iPhone > &

Re: ConsumeKafka to PublishKafka doesn't keep the order of the messages in the destination topic

2023-12-13 Thread edi mari
o be consumed must have the same number of partitions. If > multiple Topics are to be consumed and have a different number of > partitions, multiple Processors must be used so that each Processor > consumes only from Topics with the same number of partitions. > > On Dec 13, 2023 at