Re: Batch of prepared statements exceeding specified threshold

2014-06-19 Thread Pavel Kogan
What a coincidence! Today happened in my cluster of 7 nodes as well. Regards, Pavel On Wed, Jun 18, 2014 at 11:13 AM, Marcelo Elias Del Valle < marc...@s1mbi0se.com.br> wrote: > I have a 10 node cluster with cassandra 2.0.8. > > I am taking this exceptions in the log when I run my code. What

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
Valle < marc...@s1mbi0se.com.br> wrote: > Pavel, > > Out of curiosity, did it start to happen before some update? Which version > of Cassandra are you using? > > []s > > > 2014-06-19 16:10 GMT-03:00 Pavel Kogan : > >> What a coincidence! Today happened in my

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
000 system.log | grep GCInspector > > Do you see it running a lot? Is it taking much more time to run each time > it runs? > > I am no Cassandra expert, but I would try these things first and post the > results here. Maybe other people in the list have more ideas. > > Bes

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
thing else. >> Do you see increased times when looking for GCInspector in the logs? >> >> []s >> >> >> >> 2014-06-20 14:51 GMT-03:00 Pavel Kogan : >> >> Hi Marcelo, >>> >>> No pending write tasks, I am writing a lot, about 100-2

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
ng up atomicity, resolved the issue for me. http://mail-archives.apache.org/mod_mbox/cassandra-commits/201404.mbox/%3ceee5dd5bc4794ef0b5c5153fdb583...@git.apache.org%3E On Fri, Jun 20, 2014 at 3:55 PM, Pavel Kogan wrote: > Logged batch. > > > On Fri, Jun 20, 2014 at 2:13 PM, DuyHai Do

Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
Hi, In our project, many distributed modules sending each other binary blobs, up to 100-200kb each in average. Small JSONs are being sent over message queue, while Cassandra is being used as temporary storage for blobs. We are using Cassandra instead of in memory distributed cache like Couch due t

Re: Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
t not folders? Correct? Pavel On Fri, Jun 20, 2014 at 6:01 PM, Robert Coli wrote: > On Fri, Jun 20, 2014 at 2:48 PM, Pavel Kogan > wrote: > >> So what we did is creating every hour new keyspace named _MM_dd_HH >> and when disk becomes full, script running in crontrab on e

Re: Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
Pavel On Fri, Jun 20, 2014 at 6:01 PM, Robert Stupp wrote: > > Am 20.06.2014 um 23:48 schrieb Pavel Kogan : > > > 1) When new keyspace with its columnfamilies is being just created > (every round hour), sometimes other modules failed to read/write data, and > we lose reques

Re: Using Cassandra as cache

2014-06-23 Thread Pavel Kogan
wrote: > > Am 21.06.2014 um 00:37 schrieb Pavel Kogan : > > > Thanks, > > > > Is there any code way to know when the scheme finished to settle down? > > Yep - take a look at > com.datastax.driver.core.ControlConnection#waitForSchemaAgreement in the > Java D

Re: Storing values of mixed types in a list

2014-06-24 Thread Pavel Kogan
1) You can use list of strings which are serialized JSONs, or use ByteBuffer with your own serialization as Jeremy suggested. 2) Use Cassandra 2.1 (not officially released yet) were there is new feature of user defined types. Pavel On Tue, Jun 24, 2014 at 9:18 AM, Jeremy Jongsma wrote: > Use

Merging keyspaces

2014-06-27 Thread Pavel Kogan
Hi all, I want to merge one keyspace (A) data into another (B) with exactly same scheme. The partition keys of all records are unique in both keyspaces. Can I just copy all files under keyspace A column families into keyspace B column families folders, after running nodetool flush? Is filenames co

Re: Merging keyspaces

2014-06-27 Thread Pavel Kogan
can select any number? Regards, Pavel On Fri, Jun 27, 2014 at 1:35 PM, Robert Coli wrote: > On Fri, Jun 27, 2014 at 8:28 AM, Pavel Kogan > wrote: > >> I want to merge one keyspace (A) data into another (B) with exactly same >> scheme. The partition keys of all recor

Re: Merging keyspaces

2014-06-27 Thread Pavel Kogan
Thanks Robert. On Fri, Jun 27, 2014 at 2:21 PM, Robert Coli wrote: > On Fri, Jun 27, 2014 at 10:57 AM, Pavel Kogan > wrote: > >> So basically when I rename all files during merge of keyspaces, I will >> substitute dest keyspace, column family is the same cause it is same

Re: C* 2.1-rc2 gets unstable after a 'DROP KEYSPACE' command ?

2014-07-10 Thread Pavel Kogan
It seems that memtable tries to flush itself to SSTable of not existing keyspace. I don't know why it is happens, but probably running nodetool flush before drop should prevent this issue. Pavel On Thu, Jul 10, 2014 at 4:09 AM, Fabrice Larcher wrote: > ​Hello, > > I am using the 'development'

Re: Size-tiered Compaction runs out of memory

2014-07-10 Thread Pavel Kogan
Moving to Leveled compaction resolved same problem for us. As Robert mentioned, use it carefully. Size tiered compaction requires having 50% free disk space (also according to datastax documentation). Pavel On Wed, Jul 9, 2014 at 8:39 PM, Robert Coli wrote: > On Wed, Jul 9, 2014 at 4:27 PM, An

Commitlog files are not being deleted

2014-08-28 Thread Pavel Kogan
Hi all, Shouldn't all commitlog files be auto deleted after replaying, for example after node restart? Using Cassandra 2.0.8 Thanks, Pavel

Re: Commitlog files are not being deleted

2014-08-29 Thread Pavel Kogan
Thanks Robert. On Thu, Aug 28, 2014 at 6:32 PM, Robert Coli wrote: > On Thu, Aug 28, 2014 at 3:31 PM, Pavel Kogan > wrote: > >> Shouldn't all commitlog files be auto deleted after replaying, for >> example after node restart? >> Using Cassandra 2.0.8 >

system.peers table was not updated

2014-09-03 Thread Pavel Kogan
We use Cassandra 2.0.8. Probably after decommissioning nodes long time ago, but I am not sure. We are not using this cluster intensively. According to Jira, this problem was fixed in 2.0.5 https://issues.apache.org/jira/browse/CASSANDRA-6053 Anyway, I truncated peers table and restarted one node

Re: system.peers table was not updated

2014-09-03 Thread Pavel Kogan
I tried cqlsh command on other nodes and you are right! I had no idea that cqlsh results could be node dependent. Thanks, Pavel On Wed, Sep 3, 2014 at 10:54 AM, Tyler Hobbs wrote: > > On Wed, Sep 3, 2014 at 6:44 AM, Pavel Kogan > wrote: > >> Why peers table contains onl

Pending tasks are not being processed.

2014-09-04 Thread Pavel Kogan
Hi all, Yesterday I put a lot of blobs into Cassandra and it created many, probably compaction, pending tasks (few hundreds according to Ops Center). On all nodes all pending tasks were eventually processed, but on one problematic, I see no related activity. Problematic node seems to be responsive

Re: Pending tasks are not being processed.

2014-09-04 Thread Pavel Kogan
Should I experience any problems even if split versions vary only by minor digit? After another restart of node, it seems that the problem was solved somehow. Regards, Pavel On Thu, Sep 4, 2014 at 1:59 PM, Robert Coli wrote: > On Thu, Sep 4, 2014 at 8:09 AM, Pavel Kogan >