Re: [DISCUSS] Minimum constraint for segment.ms

hey guys, Regarding to num.recovery.threads.per.data.dir: I agree, in our company we use the number of vCPUs to do so as this is not competing with ready cluster traffic. On Wed, 13 Mar 2024 at 09:29, Luke Chen wrote: > Hi Divij, > > Thanks for raising this. > The valid minimum value 1 for

Re: [DISCUSS] KIP-964: Have visibility when produce requests become "async".

of a write in the OS (sync vs async) Thanks in advance!!! On Mon, 7 Aug 2023 at 14:43, Sergio Daniel Troiano < sergio.troi...@adevinta.com> wrote: > Hi everyone! > > I would like to start a discuss thread for this KIP > <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263426647> > > > Thanks >

[DISCUSS] KIP-964: Have visibility when produce requests become "async".

Hi everyone! I would like to start a discuss thread for this KIP Thanks

new KIP doubt

hey everyone, Sorry for bothering you, I created a KIP long time ago and now I am creating a new one here The problem is I lost my apache credentials for starting a discussion thread, could you please tell me how I can

Bug wile create users

Hi everyone! We think we found a bug, we dug deep and found the solution. Please take a look at the bug reported, I am happy to deliver the patch https://issues.apache.org/jira/browse/KAFKA-15243 Thanks!

log-cleaner priority while accessing block device (sharing idea)

*Hi everyone!* *In our company we use Kafka in hundreds of clusters in PRO. When the log cleaner triggers it “could” create some resource issues (disk I/O).* *For example when we are running a deployment it is possible one or several of the brokers run a log cleaner. As we know there is a

Message conversion and TLS

Hey lads, I was thinking about message conversions and zero copy, as we know TLS will break the zero copy as the encrypt/decrypt happens in userland, correct? For example ProduceMessageConversionsPerSec will be triggered when a message must be converted (for example compressing at topic

[Doubt] about breaking zero copy

My doubt is regarding the produced batches conversions. (Breaking the zero copy) I am producing using Kafka streams 3.0 (same version as the Kafka cluster) Messages are compressed on the producer. I am seeing several ProduceConversion per sec rate in a topic, as we know the recompression of

Re: [DISCUSS] KIP-838 Simulate batching and compression

t by the consumers > etc. > 3\ Can you please add the algorithm that would be used to determine whether > batching is recommended? > > > Divij Vaidya > > > > On Mon, May 16, 2022 at 8:42 AM Sergio Daniel Troiano > wrote: > > > Hey guys! > > > > I would like to start an early discussion on this: > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-838+Simulate+batching+and+compression > > > > > > Thanks! > > >

[DISCUSS] KIP-838 Simulate batching and compression

Hey guys! I would like to start an early discussion on this: https://cwiki.apache.org/confluence/display/KAFKA/KIP-838+Simulate+batching+and+compression Thanks!

Re: [VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

vid Jacot wrote: > > > > +1 (binding). Thanks for the KIP. > > > > > > > > Best, > > > > David > > > > > > > > Le ven. 25 mars 2022 à 07:11, Luke Chen a écrit > : > > > > > > > >>

Re: [VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

t; >> +1(binding) from me. > >> > >> Thank you. > >> Luke > >> > >> On Fri, Mar 25, 2022 at 1:40 PM Sergio Daniel Troiano > >> wrote: > >> > >> > Hi lads, > >> > > >> > I would like to start the

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

t; wrote: > > > > > Hey guys, > > > > > > > > > What is the next step? Who decides when it is time for voting? > > > > > > > > > Thanks! > > > > > > Sent from my iPhone > > > > > > &g

[VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

Hi lads, I would like to start the vote on this: https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output As an extra information we are already using the patch in our company, so thanks to this patch and other extra script we

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

atches: The number of batches to read from the log > segment. > > Thanks, > Mickael > > > On Tue, Mar 8, 2022 at 5:27 AM Sergio Daniel Troiano > wrote: > > > > Hi Luke, > > > > Make sense, done! > > > > Thank you. > > Sergi

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

t; batches. > > Agree! Let's focus on the feature of limiting the batch amounts. > > One more comment to the KIP: > 1. Could you put the new parameter description into the KIP proposed change > section? That would make it much clear. > > > Thank you. > Luke > > On M

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

ng logs? > I think it's good because it will also be a small change, and no need to go > through another KIP discussing/voting process. But I'm fine if you want to > keep this KIP as is, and create another JIRA ticket for future work. > > Thank you. > Luke > > On Mon, Mar 7, 20

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

ut any information to the user? > 2. After your explanation, I guess the use of *max-batches-size* won't > conflict with *max-message-size*, right? > That is, user can set the 2 arguments at the same time. Is that correct? > > Thank you. > Luke > > Thank you. > Luke

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

nts > arguments? > Thanks, > Kirk > > On Thu, Mar 3, 2022, at 1:32 PM, Sergio Daniel Troiano wrote: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output > > >

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

bytes, does it matter if that > > size doesn't align to a record boundary? > > 2. Can you add a check to make sure that --max-batches-size doesn't > allow > > the user to pass in a negative number? > > 3. Can you add/update any unit tests related to the Dum

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output