Cassandra not listening on thrift port
Hey All, Till now I was using cassandra 0.4.2, with no issues. Today I switched to apache-cassandra-incubating-2009-12-09_12-38-58-bin.tar.gz The problem is that the Cassandra is not listening on thrift port (9160). Not sure what is going wrong, cassandra is starting properly. -- Thanks, Sunil
Re: Cassandra not listening on thrift port
Sorry. Figured out the issue. By Mistake I left: AutoBootstrap*true*/AutoBootstrap Now it's working. -- Thanks, Sunil On Mon, Dec 14, 2009 at 3:36 PM, Sunil Khedar su...@truesparrow.com wrote: Hey All, Till now I was using cassandra 0.4.2, with no issues. Today I switched to apache-cassandra-incubating-2009-12-09_12-38-58-bin.tar.gz The problem is that the Cassandra is not listening on thrift port (9160). Not sure what is going wrong, cassandra is starting properly. -- Thanks, Sunil
Re: Get_count method error?
yes, that would be a bug On 12/14/09, JKnight JKnight beukni...@gmail.com wrote: Dear all, I found method get_count still count deleted column. Is this an error? get_count - i32 get_count(keyspace, key, column_parent, consistency_level) Counts the columns present in column_parent. -- Best regards, JKnight
How to check if nodes are added in ring or not?
Hi All, I am installing Cassandra on EC2 instances. My goal is to have nodes in different data-centers. I have setup the storage configuration with public IP addresses of instances. The problem is: 1) I'm not able to use these public IP address of instances. 2) Also nodeprobe cluster is removed in 0.5. Can you please suggest how to check if nodes are added in ring or not? Thanks Sharief
Re: How to check if nodes are added in ring or not?
1- Make sure the ports that cassandra uses by default are open (7000, 7001, 9160) 2- the new command is nodeprobe ring On Mon, Dec 14, 2009 at 6:59 AM, Sharief shar...@truesparrow.com wrote: Hi All, I am installing Cassandra on EC2 instances. My goal is to have nodes in different data-centers. I have setup the storage configuration with public IP addresses of instances. The problem is: 1) I'm not able to use these public IP address of instances. 2) Also nodeprobe cluster is removed in 0.5. Can you please suggest how to check if nodes are added in ring or not? Thanks Sharief
RE: read latency creaping up
On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
Re: How to check if nodes are added in ring or not?
On Mon, 2009-12-14 at 20:29 +0530, Sharief wrote: I am installing Cassandra on EC2 instances. My goal is to have nodes in different data-centers. I have setup the storage configuration with public IP addresses of instances. The problem is: 1) I'm not able to use these public IP address of instances. 2) Also nodeprobe cluster is removed in 0.5. Can you please suggest how to check if nodes are added in ring or not? Have you checked out Circuit under contrib/? https://issues.apache.org/jira/secure/attachment/12421328/circuit.png -- Eric Evans eev...@rackspace.com
RE: read latency creaping up
thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
Re: read latency creaping up
possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
Re: read latency creaping up
Well not sure how that would affect he latency as reported by the Cassandra server using nodeprobe cfstats Jonathan Ellis jbel...@gmail.com wrote: possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
Re: read latency creaping up
hmm, me neither but, I can't think how restarting the client would, either :) On Mon, Dec 14, 2009 at 4:59 PM, Brian Burruss bburr...@real.com wrote: Well not sure how that would affect he latency as reported by the Cassandra server using nodeprobe cfstats Jonathan Ellis jbel...@gmail.com wrote: possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
RE: read latency creaping up
i agree. i don't know anything about thrift, and i don't know how it keeps connections open or manages resources from a client or server perspective, but this situation suggests that maybe killing the clients is forcing the server to free something. how's that sound :) From: Jonathan Ellis [jbel...@gmail.com] Sent: Monday, December 14, 2009 3:12 PM To: cassandra-user@incubator.apache.org Subject: Re: read latency creaping up hmm, me neither but, I can't think how restarting the client would, either :) On Mon, Dec 14, 2009 at 4:59 PM, Brian Burruss bburr...@real.com wrote: Well not sure how that would affect he latency as reported by the Cassandra server using nodeprobe cfstats Jonathan Ellis jbel...@gmail.com wrote: possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com
Re: read latency creaping up
can you make it so that the client restarts the connection every 30m or so ? It could be an issue in thrift or something with long-lived connections. On Dec 15, 2009, at 10:16 AM, Brian Burruss wrote: i agree. i don't know anything about thrift, and i don't know how it keeps connections open or manages resources from a client or server perspective, but this situation suggests that maybe killing the clients is forcing the server to free something. how's that sound :) From: Jonathan Ellis [jbel...@gmail.com] Sent: Monday, December 14, 2009 3:12 PM To: cassandra-user@incubator.apache.org Subject: Re: read latency creaping up hmm, me neither but, I can't think how restarting the client would, either :) On Mon, Dec 14, 2009 at 4:59 PM, Brian Burruss bburr...@real.com wrote: Well not sure how that would affect he latency as reported by the Cassandra server using nodeprobe cfstats Jonathan Ellis jbel...@gmail.com wrote: possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com -- Ian Holsman i...@holsman.net
Re: read latency creaping up
I plan to investigate that next. There isn't a straightforward disconnect that I could easily see. Ian Holsman i...@holsman.net wrote: can you make it so that the client restarts the connection every 30m or so ? It could be an issue in thrift or something with long-lived connections. On Dec 15, 2009, at 10:16 AM, Brian Burruss wrote: i agree. i don't know anything about thrift, and i don't know how it keeps connections open or manages resources from a client or server perspective, but this situation suggests that maybe killing the clients is forcing the server to free something. how's that sound :) From: Jonathan Ellis [jbel...@gmail.com] Sent: Monday, December 14, 2009 3:12 PM To: cassandra-user@incubator.apache.org Subject: Re: read latency creaping up hmm, me neither but, I can't think how restarting the client would, either :) On Mon, Dec 14, 2009 at 4:59 PM, Brian Burruss bburr...@real.com wrote: Well not sure how that would affect he latency as reported by the Cassandra server using nodeprobe cfstats Jonathan Ellis jbel...@gmail.com wrote: possibly the clients are running into memory pressure? On Mon, Dec 14, 2009 at 4:27 PM, Brian Burruss bburr...@real.com wrote: thx, i'm actually the B. Todd Burruss in that thread .. we changed our email system and well now, i'm just Brian .. long story. anyway, in this case it isn't compaction pendings as i can kill the clients and immediately restart and the latency is back to a reasonable number. i'm still investigating. thx! From: Eric Evans [eev...@rackspace.com] Sent: Monday, December 14, 2009 8:23 AM To: cassandra-user@incubator.apache.org Subject: RE: read latency creaping up On Sun, 2009-12-13 at 13:18 -0800, Brian Burruss wrote: if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while. Have a look at the following thread: http://thread.gmane.org/gmane.comp.db.cassandra.user/1402 -- Eric Evans eev...@rackspace.com -- Ian Holsman i...@holsman.net
Re: How to check if nodes are added in ring or not?
Hi Ramzi, Very true. The mistake was in storage-conf settings, the ClusterName must be unique which I couldn't notice and had a different name for each of the nodes. As they say, This is mainly used to prevent machines in one logical cluster from joining another. So the name which was not same for all my nodes in the cluster, actually prevented each of the nodes to identify the other. Now all my nodes are in the ring as expected. @Evan: This must be an interesting way to verify a ring. Would have really helped me in my case. Will definitely use it. Thank you! Sharief The ports are open and nodeprobe ring is able to identify only itself in the ring. On Mon, Dec 14, 2009 at 9:51 PM, Ramzi Rabah rra...@playdom.com wrote: 1- Make sure the ports that cassandra uses by default are open (7000, 7001, 9160) 2- the new command is nodeprobe ring On Mon, Dec 14, 2009 at 6:59 AM, Sharief shar...@truesparrow.com wrote: Hi All, I am installing Cassandra on EC2 instances. My goal is to have nodes in different data-centers. I have setup the storage configuration with public IP addresses of instances. The problem is: 1) I'm not able to use these public IP address of instances. 2) Also nodeprobe cluster is removed in 0.5. Can you please suggest how to check if nodes are added in ring or not? Thanks Sharief
Re: how to transfer large data?
sorry, it's my fault. I think the data can be constructed to a string. eg : string(buf, buf_len); 2009-12-15 Baidu STL 潘晓雷| (+86 10) 59926720| panxiao...@baidu.com | Hi: pan_edward | F7-BE185 发件人： XL.Pan 发送时间： 2009-12-15 13:16:39 收件人： cassandra-user 抄送： 主题： how to transfer large data? hi, I want to use the Cassandra to store pictures(about 100k ~ 3M). I don't know how to write the client, because I find the value's type in the Column class is std::string. How can I deal with this?? My key type is int and value type is raw data(about 120K). Thanks! :-) 2009-12-15 XL.Pan
Re: How to check if nodes are added in ring or not?
Hey Ramzi, Another related concern is regarding ListenAddress. In order to allow multiple DCs, I have to use the Public IP address of each instance. 1) But when I try to use the Public IP of instance, I get the error below. But I am able to ping nodes using Public IP address (machines are accessible using Public IP in same DC). Can you please let me know how to configure it? java.net.BindException: Cannot assign requested address at sun.nio.ch.Net.bind(Native Method) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) at org.apache.cassandra.net.MessagingService.listen(MessagingService.java:196) at org.apache.cassandra.service.StorageService.initServer(StorageService.java:273) at org.apache.cassandra.service.CassandraServer.start(CassandraServer.java:70) at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:94) at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:166) 2) When I using External URL (associate with the external IP address). Cassandra associate the 7000 and 7001 ports with the private IP address of that instance. The best optimal solution is it should use the Private (internal) IP address for same DC nodes and Public IP address for nodes in other DCs, so that network latency can be minimized. Please suggest how it can be achieved? -- Thanks, Sunil Sr. Software Architect Center of Excellence (COE) True Sparrow Systems On Mon, Dec 14, 2009 at 9:51 PM, Ramzi Rabah rra...@playdom.com wrote: 1- Make sure the ports that cassandra uses by default are open (7000, 7001, 9160) 2- the new command is nodeprobe ring On Mon, Dec 14, 2009 at 6:59 AM, Sharief shar...@truesparrow.com wrote: Hi All, I am installing Cassandra on EC2 instances. My goal is to have nodes in different data-centers. I have setup the storage configuration with public IP addresses of instances. The problem is: 1) I'm not able to use these public IP address of instances. 2) Also nodeprobe cluster is removed in 0.5. Can you please suggest how to check if nodes are added in ring or not? Thanks Sharief
