I'm using Scala with my own Cassandra client and the splitting code was
hacked in to get around the exception. So I'm not sure if my code will help
or not but it's basically:
===========================================
var row = TheColumnFamily(key)
var count = 0
// dataToInsert is a map of column names to values
dataToInsert.foreach { case (name,value) =>
row(name) = value
count += 1
// Flush every 10,000 columns
if(count % 10000 == 0) {
row.save
row = TheColumnFamily(key)
}
}
// Flush anything that's left over
row.save
===========================================
When I get around to it I'll push the logic down to either my Row class and
have it auto-flush when it hits a column limit or modify my batchInsert
method to split the data into multiple batch_insert calls.
-Tim
On Thu, Nov 19, 2009 at 8:39 AM, <mobiledream...@gmail.com> wrote:
> can you share code on how to split columns in cassdict or batch_insert?
> thanks
>
>
> On Thu, Nov 19, 2009 at 8:15 AM, Tim Underwood <timunderw...@gmail.com>wrote:
>
>> I've seen also. Sometimes it seems random and retrying the call works (I
>> think it might have happened during a compaction). If I try doing a
>> batch_insert on a key with more than 200,000 columns (or so) I always get
>> this exception and have to break the inserts into smaller chunks.
>>
>> -Tim
>>
>>
>> On Wed, Nov 18, 2009 at 11:25 PM, <mobiledream...@gmail.com> wrote:
>>
>>> Can you plase tell what this error is ?
>>>
>>> ERROR - error writing key ruske
>>> *java.util.concurrent.TimeoutException: Operation timed out - received
>>> only 0 responses from .*
>>> at
>>> org.apache.cassandra.service.QuorumResponseHandler.get(QuorumResponseHandler.java:88)
>>> at
>>> org.apache.cassandra.service.StorageProxy.insertBlocking(StorageProxy.java:164)
>>> at
>>> org.apache.cassandra.service.CassandraServer.doInsert(CassandraServer.java:468)
>>> at
>>> org.apache.cassandra.service.CassandraServer.batch_insert(CassandraServer.java:448)
>>> at
>>> org.apache.cassandra.service.Cassandra$Processor$batch_insert.process(Cassandra.java:854)
>>> at
>>> org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:627)
>>> at
>>> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:253)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>> at java.lang.Thread.run(Thread.java:619)
>>>
>>>
>>> Errors
>>>
>>
>>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
