dedicated gossip lan

2011-10-04 Thread Sorin Julean
Hi,

 Did anyone used a dedicated interfaces and LAN / VLAN for gossip traffic ?

 Any benefits in such approach ?


Cheers,
Sorin


Re: dedicated gossip lan

2011-10-04 Thread Sorin Julean
Sorry for not being clear.
Indeed I mean a separate LAN and interfaces for listen_address.

- sorin

On Tue, Oct 4, 2011 at 10:49 PM, Brandon Williams dri...@gmail.com wrote:

 On Tue, Oct 4, 2011 at 2:00 PM, Sorin Julean sorin.jul...@gmail.com
 wrote:
  Hi,
 
   Did anyone used a dedicated interfaces and LAN / VLAN for gossip traffic
 ?
 
   Any benefits in such approach ?

 I don't think there is any substantial benefit to doing this, but also
 it's impossible: gossip is not separate from the storage protocol.  Of
 course, I am assuming you mean just gossip, but if what you actually
 mean is the entire storage protocol (listen_address) then yes, there
 is benefit to having a dedicated network for that.

 -Brandon



Re: Can't connect to MX4J endpoint on Ubuntu

2011-09-24 Thread Sorin Julean
Hey,

 Do a:   grep -i mx4 system.log | less

 and look for: Mx4jTool.java (line 67) mx4j successfuly loaded

 Also make sure you have the latest mx4j-tool from:
http://sourceforge.net/projects/mx4j/files/MX4J%20Binary/3.0.2/


Kind regards,
Sorin


On Fri, Sep 23, 2011 at 11:55 PM, Iwona Bialynicka-Birula 
iwona...@atigeo.com wrote:

 Hello,

 ** **

 I am trying to monitor Cassandra 8.0 using MX4J as described in
 http://wiki.apache.org/cassandra/Operations#Monitoring_with_MX4J. I have
 mx4j-tools.jar in Cassandra’s lib folder and when Cassandra starts in prints
 out:

 HttpAdaptor version 3.0.1 started on port 8081

 ** **

 But when I try to open http://localhost:8081/ in my browser I get “unable
 to connect”. I checked that Cassandra daemon (only) is listening on port
 8081 and that there are no errors in the logs.

 ** **

 Any ideas, why Cassandra is not answering on the 8081 MX4J port?

 ** **

 Thanks,

 Iwona



memtable flush thresholds

2011-09-12 Thread Sorin Julean
Hi,

 I've checked the memtable flush (cassandra 0.8.4)  and it seams to me it
hapens sooner then the threshold is reached.

Here's the threshould's (the default ones calculated for a heap size of
-Xmx1980M):
ColumnFamily: idx_graphable (Super)
  Key Validation Class: org.apache.cassandra.db.marshal.BytesType
  Default column value validator:
org.apache.cassandra.db.marshal.BytesType
  Columns sorted by:
org.apache.cassandra.db.marshal.UTF8Type/org.apache.cassandra.db.marshal.UTF8Type
  Row cache size / save period in seconds: 0.0/0
  Key cache size / save period in seconds: 20.0/14400
  *Memtable thresholds: 0.5671875/1440/121 (millions of ops/minutes/MB)*
  GC grace seconds: 864000
  Compaction min/max thresholds: 4/32
  Read repair chance: 1.0
  Replicate on write: true

In the logs it seams to me none oh the thresold is reached ( definitively
minutes threshold is not reached ).

9-08 20:12:30,136 MeteredFlusher.java (line 62) flushing high-traffic column
family ColumnFamilyStore(table='graph', columnFamily='idx_graphable')
 INFO [NonPeriodicTasks:1] 2011-09-08 20:12:30,144 ColumnFamilyStore.java
(line 1036) Enqueuing flush of
Memtable-idx_graphable@915643571*(4671498/96780112
serialized/live bytes, 59891 ops)*
 INFO [FlushWriter:111] 2011-09-08 20:12:30,145 Memtable.java (line 237)
Writing Memtable-idx_graphable@915643571(4671498/96780112 serialized/live
bytes, 59891 ops)
 INFO [FlushWriter:111] 2011-09-08 20:12:30,348 Memtable.java (line 254)
Completed flushing [...]/cassandra/data/graph/idx_graphable-g-23-Data.db
(4673905 bytes)


Could someone clarify it for me ?
high-traffic column family has a special meaning ?

Many thanks,
Sorin


Re: memtable flush thresholds

2011-09-12 Thread Sorin Julean
Thanks Jonathan !

 memtable_total_space_in_mb is the threshold that is reached.

Kind regards,
Sorin

On Mon, Sep 12, 2011 at 3:16 PM, Jonathan Ellis jbel...@gmail.com wrote:

 see memtable_total_space_in_mb at
 http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/

 On Mon, Sep 12, 2011 at 6:55 AM, Sorin Julean sorin.jul...@gmail.com
 wrote:
  Hi,
 
   I've checked the memtable flush (cassandra 0.8.4)  and it seams to me it
  hapens sooner then the threshold is reached.
 
  Here's the threshould's (the default ones calculated for a heap size of
  -Xmx1980M):
  ColumnFamily: idx_graphable (Super)
Key Validation Class: org.apache.cassandra.db.marshal.BytesType
Default column value validator:
  org.apache.cassandra.db.marshal.BytesType
Columns sorted by:
 
 org.apache.cassandra.db.marshal.UTF8Type/org.apache.cassandra.db.marshal.UTF8Type
Row cache size / save period in seconds: 0.0/0
Key cache size / save period in seconds: 20.0/14400
Memtable thresholds: 0.5671875/1440/121 (millions of
 ops/minutes/MB)
GC grace seconds: 864000
Compaction min/max thresholds: 4/32
Read repair chance: 1.0
Replicate on write: true
 
  In the logs it seams to me none oh the thresold is reached ( definitively
  minutes threshold is not reached ).
 
  9-08 20:12:30,136 MeteredFlusher.java (line 62) flushing high-traffic
 column
  family ColumnFamilyStore(table='graph', columnFamily='idx_graphable')
   INFO [NonPeriodicTasks:1] 2011-09-08 20:12:30,144 ColumnFamilyStore.java
  (line 1036) Enqueuing flush of
  Memtable-idx_graphable@915643571(4671498/96780112 serialized/live bytes,
  59891 ops)
   INFO [FlushWriter:111] 2011-09-08 20:12:30,145 Memtable.java (line 237)
  Writing Memtable-idx_graphable@915643571(4671498/96780112
 serialized/live
  bytes, 59891 ops)
   INFO [FlushWriter:111] 2011-09-08 20:12:30,348 Memtable.java (line 254)
  Completed flushing [...]/cassandra/data/graph/idx_graphable-g-23-Data.db
  (4673905 bytes)
 
 
  Could someone clarify it for me ?
  high-traffic column family has a special meaning ?
 
  Many thanks,
  Sorin
 



 --
 Jonathan Ellis
 Project Chair, Apache Cassandra
 co-founder of DataStax, the source for professional Cassandra support
 http://www.datastax.com



Cassandra prod environment

2011-09-02 Thread Sorin Julean
Hey,

 Currently I'm running Cassandra on Ubuntu 10.4 x86_64 in EC2.

 I'm wondering if anyone observed a better performance  / stability on other
distros ( CentOS / RHEL / ...) or OS (eg. Solaris intel/SPARC) ?
 Is anyone running prod on VMs, not cloud, but ESXi or Solaris zones ? Is
there love or hate :) ?  Any storage best-practices on VM environments ?
 I like xfs ! Any observations on xfs / ext4 / zfs, from Cassandra usage
perspective ?

Cheers,
Sorin


Re: Nodetool ring not showing all nodes in cluster

2011-08-02 Thread Sorin Julean
Hi,

 Until someone answers  with more details, few questions:
 1. did you moved the system keyspace as well ?
 2. the gossip IP of the new nodes are the same as the old ones ?
 3. which cassandra version are you running ?

If 1. is yes and 2. is no, for a quick fix: take down the cluster, remove
system keyspace, bring the cluster up and bootstrap the nodes.


Kind regards,
Sorin


On Tue, Aug 2, 2011 at 2:53 PM, Aishwarya Venkataraman cyberai...@gmail.com
 wrote:

 Hello,

 I recently migrated 400 GB of data that was on a different cassandra
 cluster (3 node with RF= 3) to a new cluster. I have a 3 node  cluster
 with replication factor set to three. When I run nodetool ring, it
 does not show me all the nodes in the cluster. It always keeps showing
 only one node and mentions that it is handling 100% of the load. But
 when I look at the logs, the nodes are able to talk to each other via
 the gossip protocol. Why does this happen ? Can you tell me what I am
 doing wrong ?

 Thanks,
 Aishwarya



Re: Cassandra auto keyspace operation using script

2011-07-29 Thread Sorin Julean
Hey,

 Try: echo *-e* connnet localhost/9160;* \n*show keyspace*;* |
bin/cassandra-cli

Regards,
Sorin

On Fri, Jul 29, 2011 at 9:54 AM, 祝海通 zhuhait...@gmail.com wrote:

 In our Cassandra test for YCSB benchmark, we want to create column family
 and drop keyspace with script automatically.
 But I fount that in our script. /bin/cassandra-cli; connect localhost/9160;
 show keyspace;  can not execute.
 Using the  does not work.
 and Using echo connnet localhost/9160; show keyspace |bin/cassandra-cli
 It doesn't work too.

 haitongz