Can Cassandra client programs use hostnames instead of IPs?

2014-05-12 Thread Huiliang Zhang
Hi, Cassandra returns ips of the nodes in the cassandra cluster for further communication between hadoop program and the casandra cluster. Is there a way to configure the cassandra cluster to return hostnames instead of ips? My cassandra cluster is on AWS and has no elastic ips which can be access

Re: Can Cassandra client programs use hostnames instead of IPs?

2014-05-16 Thread Huiliang Zhang
str<http://twitter.com/instaclustr> | > +61 415 936 359 > > > > > On 13/05/2014, at 4:31 AM, Huiliang Zhang wrote: > > Hi, > > Cassandra returns ips of the nodes in the cassandra cluster for further > communication between hadoop program and the casandra clu

A problem with truncate and bulk loader

2014-06-13 Thread Huiliang Zhang
Hi, I have a very strange problem with Cassandra bulk loader. Appreciated for explanations. I am using a local cassandra server 2.0.5 with default setting. 1. I created a table A and load 108 rows into it by using a hadoop program with "org.apache.cassandra.hadoop.BulkOutputFormat". 2. I run "tru

Use Cassnadra thrift API with collection type

2014-06-20 Thread Huiliang Zhang
Hi, I have a problem when insert data of the map type into a cassandra table. I tried all kinds of MapSerializer to serialize the Map data and did not succeed. My code is like this: Column column = new Column(); column.name=columnSerializer.toByteBuffer(colname); // the co

EC2 cassandra cluster node address problem

2014-06-24 Thread Huiliang Zhang
Hi, I am using Cassandra on EC2 instances. My cassandra always returns private ips of the instances to the thrift program. Then the program cannot connect to the private ips. I already changed the rpc_address: elastic ip rpc_address: elastic ip Then I restarted the cassandra cluster. But the sys

Re: EC2 cassandra cluster node address problem

2014-06-24 Thread Huiliang Zhang
t; > > On Tue, Jun 24, 2014 at 8:55 PM, Huiliang Zhang wrote: > >> Hi, >> >> I am using Cassandra on EC2 instances. My cassandra always returns >> private ips of the instances to the thrift program. Then the program cannot >> connect to the private ip

Re: Use Cassnadra thrift API with collection type

2014-06-24 Thread Huiliang Zhang
t encoding depends on the collection. The fact is, updating CQL > collection from thrift is technically possible but it is not recommended in > any way. I strongly advise you to stick to CQL if you want to use CQL > collections. > > -- > Sylvain > >> >> >>

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
> > On Tue, Jun 24, 2014 at 10:01 PM, Huiliang Zhang wrote: > >> Thanks. Is there a way to configure Cassandra to use elastic ip instead >> of private ip? >> >> >> On Tue, Jun 24, 2014 at 9:29 PM, Andrey Ilinykh >> wrote: >> >>> Cassandra

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
gt; It is similar to your web router. You can forward your external port to > local one, but application running on your local node doesn't know anything > about it. > > > On Wed, Jun 25, 2014 at 1:25 PM, Huiliang Zhang wrote: > >> Thanks. In fact, it is Cassandra

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
. On Wed, Jun 25, 2014 at 6:49 PM, Michael Shuler wrote: > On 06/25/2014 08:31 PM, Huiliang Zhang wrote: > >> Thanks, get it. It is working after I translate the private ip to >> elastic ip. >> > > This sounds like a nice way to work around a known networking lim

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
It should be good to use broadcast_address for my purpose. The only problem is coming from opscenter now because it cannot recognize the datacenter from the ip range. On Wed, Jun 25, 2014 at 7:13 PM, Michael Shuler wrote: > On 06/25/2014 09:05 PM, Huiliang Zhang wrote: > >> Thanks.

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Huiliang Zhang
Hi Shenghua, as I understand, each range is assigned to a mapper. Mapper will not share connections. So, it needs at least 256 connections to read all. But all 256 connections should not be set up at the same time unless you have 256 mappers running at the same time. On Tue, Jan 27, 2015 at 9:34 P

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Huiliang Zhang
es, replication factor=1, and using default number of > tokens. You will have 3*256 mappers... In that case, you will be soon out > of mappers or reach the limit. > > > On Tue, Jan 27, 2015 at 10:59 PM, Huiliang Zhang wrote: > >> Hi Shenghua, as I understand, each range is a

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-28 Thread Huiliang Zhang
If you are using replication factor 1 and 3 cassandra nodes, 256 virtual nodes should be evenly distributed on 3 nodes. So there are totally 256 virtual nodes. But in your experiment, you saw 3*257 mapper. Is that because of the setting cassandra.input.split.size=3? It is nothing with node number=3