Re: [DISCUSS] Improve Commitlog write path

2022-09-21 Thread Branimir Lambov
. Now it is clear that what are some benefits of this > patch. I will send it for review once it is ready and hopefully it gets > accepted. > > > > Thanks, > > Amit > > > > *From:* Bowen Song via dev > *Sent:* Tuesday, July 26, 2022 5:36 PM > *To:* dev@cassand

RE: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Pawar, Amit
: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Hi Amit, That's some brilliant tests you have done there. It shows that the compaction throughput not only can be a bottleneck on the speed of insert operations, but it can also stress the JVM garbage collector. As a result

Re: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Bowen Song via dev
long. With lower throughput large system can ingest more data. Does it make sense ? Thanks, Amit *From:* Bowen Song via dev *Sent:* Friday, July 22, 2022 4:37 PM *To:* dev@cassandra.apache.org *Subject:* Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Hi Amit

RE: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Pawar, Amit
beneficial for workloads where data is not kept/left on nodes for too long. With lower throughput large system can ingest more data. Does it make sense ? Thanks, Amit From: Bowen Song via dev Sent: Friday, July 22, 2022 4:37 PM To: dev@cassandra.apache.org Subject: Re: [DISCUSS] Improve Commitlog write path

Re: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Elliott Sims
022 10:24 PM > *To:* dev@cassandra.apache.org > *Cc:* Bowen Song ; Raghavendra, Prakash < > prakash.raghaven...@amd.com> > *Subject:* Re: [DISCUSS] Improve Commitlog write path > > > > [CAUTION: External Email] > > Amit, welcome and thank you for contribut

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Amit, welcome and thank you for contributing the results from your test and opening this discussion. I don’t think anyone is arguing that the database shouldn’t take advantage of available hardware. A few things

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread C. Scott Andreas
:56 PM To: dev@cassandra.apache.org Cc: Bowen Song ; Raghavendra, Prakash Subject: Re: [DISCUSS] Improve Commitlog write path   [CAUTION: External Email] Hi Amit,   I am inclined to agree with Bowen Song, in that benchmarks from an initially empty cluster tend to lean more heavily

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Hi Amit, I am inclined to agree with Bowen Song, in that benchmarks from an initially empty cluster tend to lean more heavily on memtable and commit log bottlenecks than a real-world long running cluster does, as the algorithmic

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Brad
; > > Thanks, > > Amit > > > > *From:* Bowen Song via dev > *Sent:* Wednesday, July 20, 2022 4:13 PM > *To:* dev@cassandra.apache.org > *Subject:* Re: [DISCUSS] Improve Commitlog write path > > > > [CAUTION: External Email] > > From my past exp

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Bowen Song via dev
ti-threading is good to have now ? else please suggest if I need to test further. Thanks, Amit *From:* Bowen Song via dev *Sent:* Wednesday, July 20, 2022 4:13 PM *To:* dev@cassandra.apache.org *Subject:* Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] From my past experi

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Benedict
rom: Bowen Song via dev > Sent: Wednesday, July 20, 2022 4:13 PM > To: dev@cassandra.apache.org > Subject: Re: [DISCUSS] Improve Commitlog write path > > [CAUTION: External Email] > From my past experience, the bottleneck for insert heavy workload is likely > to be

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
to test further. Thanks, Amit From: Bowen Song via dev Sent: Wednesday, July 20, 2022 4:13 PM To: dev@cassandra.apache.org Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] >From my past experience, the bottleneck for insert heavy workload is likely to >be comp

Re: [DISCUSS] Improve Commitlog write path

2022-07-20 Thread Bowen Song via dev
From my past experience, the bottleneck for insert heavy workload is likely to be compaction, not commit log. You initially may see commit log as the bottleneck when the table size is relatively small, but as the table size increases, compaction will likely take its place and become the new

[DISCUSS] Improve Commitlog write path

2022-07-20 Thread Pawar, Amit
[Public] Hi all, (My previous mail is not appearing in mailing list and resending again after 2 days) Myself Amit and working at AMD Bangalore, India. I am new to Cassandra and need to do Cassandra testing on large core systems. Usually should test on multi-nodes Cassandra but started with