Help! Serious crash!

2009-10-07 Thread Dan Larsen
Hi guys, I have a small setup with 3 macs running os x snow leopard and the native java 1.6.0.something.something ;-) I am doing a lot of inserts, without any problems and I can read the data again. But At some point, around 1G Commitlog size, cassandra starts a rise in ram usage, unt

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
Forgot to say - It will eat up 1.13GB of RAM and 1.32GB VRAM, and still throw and OutOfMemory, though 700MB left... On 07/10/2009, at 19.38, Dan Larsen wrote: Hi guys, I have a small setup with 3 macs running os x snow leopard and the native java 1.6.0.something.something ;-) I am doing a

Re: Help! Serious crash!

2009-10-07 Thread Igor Katkov
What version are you running? Take 0.4 from trunk. Default config has 128 Did you change it allow your commit log chunks be 1Gb? On Wed, Oct 7, 2009 at 1:38 PM, Dan Larsen wrote: > Hi guys, > > I have a small setup with 3 macs running os x snow leopard and the native > java 1.6.0.something.som

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
O.k... I experimented a bit: changed "-Xmx1G \" to "-Xmx2G \" in bin/ cassandra.in.sh ... Is it really nescessary to have as much RAM as you have data?!?!? Best regards Dan On 07/10/2009, at 19.50, Dan Larsen wrote: Forgot to say - It will eat up 1.13GB of RAM and 1.32GB VRAM, and still thro

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
Sorry about that... running 0.4 taken from trunk. I didn't change CommitLogRotationThresholdInMB - it's still 128 Thanks! On 07/10/2009, at 20.12, Igor Katkov wrote: What version are you running? Take 0.4 from trunk. Default config has 128 Did you change it allow your commit log chunks be 1G

Re: Help! Serious crash!

2009-10-07 Thread Igor Katkov
I had similar OutOfMemory issues, see "commit logs are not deleted" thread, but it was fixed/commited to trunk. What I don't get is how your commit log segment grows beyond threshold. >Is it really nescessary to have as much RAM as you have data?!?!? No, I was able to insert 50Gb worth of data wi

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
I don't know why... But for some reason, the commitlogs grew bigger than 128MB - so I suppose a manual compact was needed...?!?! Anyways... I restarted with the 2GB value in cassandra.in.sh, everything got compacted, the commitlog rotated - and I could stop, change the settings back and start

Re: [VOTE] Project Logo

2009-10-07 Thread Eric Florenzano
~~{ Ballot }~~ [ 11 ] 2http://99designs.com/contests/28940/entries/002 [ 8 ] 30 http://99designs.com/contests/28940/entries/030 [ 2 ] 32 http://99designs.com/contests/28940/entries/032 [ 12 ] 33 http://99designs.com/contests/

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
I will check that thread out! Thanks :-) Maybe I should try to refresh the code... I am starting to think, it might be the "native" java of snow leopard, that is causing some of my problems... This is what has kept me from coding Java for more than a decade... Java is never just Java... I kn

Re: Help! Serious crash!

2009-10-07 Thread Jonathan Ellis
One tip: don't use ConcurrencyLevel.ZERO when bulk inserting. It's easy to OOM yourself that way. -Jonathan

Re: Help! Serious crash!

2009-10-07 Thread Dan Larsen
Thanks for the tip! I'm using QUORUM - I hate losing data :-P /Dan On 07/10/2009, at 22.56, Jonathan Ellis wrote: One tip: don't use ConcurrencyLevel.ZERO when bulk inserting. It's easy to OOM yourself that way. -Jonathan

Re: [VOTE] Project Logo

2009-10-07 Thread James Golick
Hi All, I'm going to go ahead and be "that guy", here. I haven't been involved in this process at all yet. So, it's probably too late to voice this opinion. But, I'm going to go for it anyway. I'm not a huge fan of any of the selections on the ballot. The eye image seems like something of a non-s

circular buffer

2009-10-07 Thread Igor Katkov
Hi, I was wondering if it's a good idea to use Cassandra for persist-able circular buffer? http://en.wikipedia.org/wiki/Circular_buffer The goal is to have at most X columns per key, where new columns wipe old columns out. There will be much more writes than reads. What bothers me is how to handl

Re: circular buffer

2009-10-07 Thread Jonathan Ellis
It's not a fantastic fit because as you say you need to read the contents to be able to see which if any need to be deleted. (On the bright side if you are sorting by time uuid, for instance, you won't need an extra sort step.) I would predict it would perform better than doing the same thing in

Re: circular buffer

2009-10-07 Thread Igor Katkov
Are there any hooks (API), for instance I could implement a simmilar RowMutationVerbHandler: IVerbHandler that would do the purging on the server side? On Wed, Oct 7, 2009 at 5:32 PM, Jonathan Ellis wrote: > It's not a fantastic fit because as you say you need to read the > contents to be able t

Re: Storage proxy write latency is too high

2009-10-07 Thread Jonathan Mischo
My bad...I guess that makes it even more important to find out if this is the problem on Windows? :) -Jon On Oct 6, 2009, at 6:26 PM, Jonathan Ellis wrote: Just to clarify, Cassandra only uses UDP for gossip -- passing data between nodes is done over TCP. -Jonathan On Tue, Oct 6, 2009 at 5

maven reository

2009-10-07 Thread Todd English
We're looking at the website and can't find any definitive working example of where to get the Cassandra libraries for java from Maven. Is this available? -T

Re: Storage proxy write latency is too high

2009-10-07 Thread Igor Katkov
Exact explanation to why Java NIO behave that way on Windows 2003 in Sun VM 1.6.0.16 represent only academical interest. It would be nice though, if someone could repeat my tests and would confirm or deny the result. On Wed, Oct 7, 2009 at 5:52 PM, Jonathan Mischo wrote: > My bad...I guess that m

Re: maven reository

2009-10-07 Thread Tom Chen
Please correct me if I'm wrong... but i didn't see the cassandra libraries in maven repositories. You can download the source distribution of cassandra, and look at the pom.xml included. The pom.xml will show you all the dependencies required, and it'll be easy enough to deploy to your local mave

Re: maven reository

2009-10-07 Thread Eric Evans
On Wed, 2009-10-07 at 14:57 -0700, Todd English wrote: > We're looking at the website and can't find any definitive working > example of where to get the Cassandra libraries for java from Maven. > Is this available? No, it's not, sorry. I'm not sure this is even practical since we have dependenci

Re: [VOTE] Project Logo

2009-10-07 Thread Philip Jenvey
~~{ Ballot }~~ [ 8] 2http://99designs.com/contests/28940/entries/002 [ 6] 30 http://99designs.com/contests/28940/entries/030 [11] 32 http://99designs.com/contests/28940/entries/032 [12] 33 http://99designs.com/contests/28940/ent