Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Harsha Kumara
Yes.One thread is too old.In cassandra documents they just mentioned commit logs can be clear after flush or drain.I have registered to the mailing list.Currently I'm to going through it.If i found anything regard of this matter I ll update. On Sat, Jul 21, 2012 at 12:08 AM, Tharindu Mathew wro

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Tharindu Mathew
Are you using the cassandra mailing list? They are quite helpful. The threads you refer to are quite old, as they are incubator threads. On Sat, Jul 21, 2012 at 12:01 AM, Harsha Kumara wrote: > Hi! > > I was looked at that.Flushing is a safe way to delete the > commitogs(Draining cause flushing

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Harsha Kumara
Hi! I was looked at that.Flushing is a safe way to delete the commitogs(Draining cause flushing all columnfamilies and stop accepting write requests to cassandra node).They still not replied to my forum post in cassandra forum.Below two threads discuss about this matter.But only say flushing and d

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Shelan Perera
Hi, Have you looked at this? (Which i found in wiki) Commit Log gets very big. Cassandra does not delete "old" commit logs. Why? You probably have one or more Column Families with very low throughput. These will typically not be flushed by crossing the throughput or operations thresholds, causing

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Harsha Kumara
On Fri, Jul 20, 2012 at 2:46 PM, Tharindu Mathew wrote: > Hi Harsha, > > Any luck with this? > They only defining a maximum size for log file.When logs filling up there is maximum size for commit log.Default maximum size is normally 4GB.But they not mention about automatic log file removing proce

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-20 Thread Tharindu Mathew
Hi Harsha, Any luck with this? On Mon, Jul 16, 2012 at 6:49 AM, Harsha Kumara wrote: > > > On Sun, Jul 15, 2012 at 12:27 PM, Deependra Ariyadewa wrote: > >> >> >> On Fri, Jul 13, 2012 at 11:39 PM, Tharindu Mathew wrote: >> >>> This has been there for some time now. Who's looking into this? >>>

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-15 Thread Harsha Kumara
On Sun, Jul 15, 2012 at 12:27 PM, Deependra Ariyadewa wrote: > > > On Fri, Jul 13, 2012 at 11:39 PM, Tharindu Mathew wrote: > >> This has been there for some time now. Who's looking into this? >> > Harsha Kumara did some research and found the flush and delete logs > workaround. Harsh and Deep wo

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-15 Thread Deependra Ariyadewa
On Sun, Jul 15, 2012 at 1:02 AM, Tharindu Mathew wrote: > We need this before 20th (that's the beta release)... ok, We will come with a solution. Thanks, Deependra. > > > On Sun, Jul 15, 2012 at 12:27 PM, Deependra Ariyadewa wrote: > >> >> >> On Fri, Jul 13, 2012 at 11:39 PM, Tharindu Mathew

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-15 Thread Tharindu Mathew
We need this before 20th (that's the beta release)... On Sun, Jul 15, 2012 at 12:27 PM, Deependra Ariyadewa wrote: > > > On Fri, Jul 13, 2012 at 11:39 PM, Tharindu Mathew wrote: > >> This has been there for some time now. Who's looking into this? >> > Harsha Kumara did some research and found th

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-14 Thread Deependra Ariyadewa
On Fri, Jul 13, 2012 at 11:39 PM, Tharindu Mathew wrote: > This has been there for some time now. Who's looking into this? > Harsha Kumara did some research and found the flush and delete logs workaround. Harsh and Deep working on the issue. Thank, Deependra. > Regards, > > Tharindu > Sent fro

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-13 Thread Tharindu Mathew
This has been there for some time now. Who's looking into this? Regards, Tharindu Sent from my Android© device On Jul 14, 2012 5:20 AM, "Deependra Ariyadewa" wrote: > > > On Fri, Jul 13, 2012 at 1:03 PM, Sinthuja Ragendran wrote: > >> Hi, >> >> On Thu, Jun 21, 2012 at 10:15 PM, Deependra Ariya

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-13 Thread Deependra Ariyadewa
On Fri, Jul 13, 2012 at 1:03 PM, Sinthuja Ragendran wrote: > Hi, > > On Thu, Jun 21, 2012 at 10:15 PM, Deependra Ariyadewa wrote: > >> >> >> On Thu, Jun 21, 2012 at 10:07 PM, Afkham Azeez wrote: >> >>> >>> >>> On Thu, Jun 21, 2012 at 10:03 PM, Deependra Ariyadewa wrote: >>> On Thu,

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-07-13 Thread Sinthuja Ragendran
Hi, On Thu, Jun 21, 2012 at 10:15 PM, Deependra Ariyadewa wrote: > > > On Thu, Jun 21, 2012 at 10:07 PM, Afkham Azeez wrote: > >> >> >> On Thu, Jun 21, 2012 at 10:03 PM, Deependra Ariyadewa wrote: >> >>> >>> >>> On Thu, Jun 21, 2012 at 9:12 PM, Afkham Azeez wrote: >>> Has this been sorted

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-21 Thread Deependra Ariyadewa
On Thu, Jun 21, 2012 at 10:07 PM, Afkham Azeez wrote: > > > On Thu, Jun 21, 2012 at 10:03 PM, Deependra Ariyadewa wrote: > >> >> >> On Thu, Jun 21, 2012 at 9:12 PM, Afkham Azeez wrote: >> >>> Has this been sorted out? >> >> >> It looks we need operational solution for this. >> >> Cassandra creat

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-21 Thread Afkham Azeez
On Thu, Jun 21, 2012 at 10:03 PM, Deependra Ariyadewa wrote: > > > On Thu, Jun 21, 2012 at 9:12 PM, Afkham Azeez wrote: > >> Has this been sorted out? > > > It looks we need operational solution for this. > > Cassandra creates a 128MB commit log for every restart and it is safe to > delete commi

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-21 Thread Deependra Ariyadewa
On Thu, Jun 21, 2012 at 9:12 PM, Afkham Azeez wrote: > Has this been sorted out? It looks we need operational solution for this. Cassandra creates a 128MB commit log for every restart and it is safe to delete commit logs after flush all the data in node to hard disk. Cassandra database folder

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-21 Thread Afkham Azeez
Has this been sorted out? On Tue, Jun 19, 2012 at 12:34 PM, Deependra Ariyadewa wrote: > > > On Tue, Jun 19, 2012 at 12:31 PM, Samisa Abeysinghe wrote: > >> Might want to check with Cassandra community >> >> On Tue, Jun 19, 2012 at 12:29 PM, Tharindu Mathew wrote: >> >>> I was running a BAM serv

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-19 Thread Deependra Ariyadewa
On Tue, Jun 19, 2012 at 12:31 PM, Samisa Abeysinghe wrote: > Might want to check with Cassandra community > > On Tue, Jun 19, 2012 at 12:29 PM, Tharindu Mathew wrote: > >> I was running a BAM server for some time (not continuously, restarting >> all the time), and noticed the Cassandra data has g

Re: [Dev] Dangerous growth in Cassandra 1.1.0

2012-06-19 Thread Samisa Abeysinghe
Might want to check with Cassandra community On Tue, Jun 19, 2012 at 12:29 PM, Tharindu Mathew wrote: > I was running a BAM server for some time (not continuously, restarting all > the time), and noticed the Cassandra data has grown to over 11 GB. I did > not do any load test to get this kind of

[Dev] Dangerous growth in Cassandra 1.1.0

2012-06-19 Thread Tharindu Mathew
I was running a BAM server for some time (not continuously, restarting all the time), and noticed the Cassandra data has grown to over 11 GB. I did not do any load test to get this kind of data growth. It seems the commit logs are the culprit. We need to figure out why this takes place. I have see