problem when trying to get_range_slice()

2010-06-03 Thread Shuai Yuan
Hi all, my env 6 servers with about 200GB data. data structure, 64B rowkey + (5B column)*20, rowkey and column.value are all random bytes from a-z,A-Z,0-9 problem when I tried iterate over the data in the storage, I always get org::apache::cassandra::TimedOutException

Re: [***SPAM*** ] problem when trying to get_range_slice()

2010-06-03 Thread Shuai Yuan
more info: CL = ONE, replica = 2, and when I tried to monitor the disk_io with iostat I get almost 0MB/s read 0% CPU on the machine the scan-data app started on. Thanks! ??: Shuai Yuan yuansh...@supertool.net.cn ??: user@cassandra.apache.org : [***SPAM

Re: [***SPAM*** ] Re: problem when trying to get_range_slice()

2010-06-03 Thread Shuai Yuan
@cassandra.apache.org : [***SPAM*** ] Re: problem when trying to get_range_slice() : Thu, 3 Jun 2010 19:07:28 -0700 use smaller slices and page through the data 2010/6/3 Shuai Yuan yuansh...@supertool.net.cn: Hi all, my env 6 servers with about 200GB data. data structure, 64B

Re: [***SPAM*** ] Re: [***SPAM*** ] Re: [***SPAM*** ] Re: [***SPAM*** ] Re: writing speed test

2010-06-02 Thread Shuai Yuan
?? No. But I did some capacity tests about another distributed system. Your former test cost too much MEM, it was the bottleneck. caches and JVM cost MEM, so I suggested to decrease them. What is the bottleneck of your current test now? ?? 2010??6??2?? 4:13??Shuai Yuan yuansh

Re: [***SPAM*** ] Re: writing speed test

2010-06-02 Thread Shuai Yuan
Thanks Peter! In my test application, for each record, rowkey - rand() * 4, about 64B column * 20 - rand() * 20, about 320B I use batch_insert(rowkey, col*20) in thrift. Kevin Yuan ??: Peter Sch??ller sc...@spotify.com ??: user@cassandra.apache.org :

writing speed test

2010-06-01 Thread Shuai Yuan
, have you checked the writing speed of cassandra? I feel it's quite slow currently. Could anyone confirm this is the normal writing speed of cassandra, or please provide someway of improving it? -- Shuai Yuan Supertool Corp. ?? 13810436859 yuan-sh...@yuan-shuai.info

Re: [***SPAM*** ] access a multinode cluster

2010-06-01 Thread Shuai Yuan
?? 2010-06-01 15:00 +0800??huajun qi?? If you have a multinode cluster, which node you should connect to fetch data? any one. Is there a master node in a cluster which accepts data request and dispatch it? Or every node in the cluster is completely same? no master. all the same.

question about class SlicePredicate

2010-06-01 Thread Shuai Yuan
Hi all, I don't quite understand the usage of 'class SlicePredicate' when trying to retrieve a ranged slice. How should it be initialized? Thanks! -- Kevin Yuan www.yuan-shuai.info

Re: writing speed test

2010-06-01 Thread Shuai Yuan
! Kevin 2010/6/1 ?? shiyingjie1...@gmail.com: Hi, It would be better if we know which Consistency Level did you choose, and what is the schema of test data? ?? 2010??6??1?? 4:48??Shuai Yuan yuansh...@supertool.net.cn?? Hi all, I'm testing writing speed of cassandra with 4

Re: [***SPAM*** ] Re: writing speed test

2010-06-01 Thread Shuai Yuan
? ?? 2010??6??1?? 4:48??Shuai Yuan yuansh...@supertool.net.cn?? Hi all, I'm testing writing speed of cassandra with 4 servers. I'm confused by the behavior of cassandra. ---env

Re: [***SPAM*** ] Re: [***SPAM*** ] Re: writing speed test

2010-06-01 Thread Shuai Yuan
?? 2010-06-02 10:37 +0800??lwl?? is all the 4 servers' MEM almost 100%? Yes ?? 2010??6??2?? 10:12??Shuai Yuan yuansh...@supertool.net.cn?? Thanks lwl. Then is there anyway of tuning this, faster flush to disk or else