Re: TransportException - Consistency LOCAL_ONE - EC2

2017-03-15 Thread Frank Hughes
wrote: > I don't see what getPolicy is retrieving but you want to use TokenAware > with the shuffle false option in the ctor, it defaults to shuffle true so > that load is spread when people have horribly fat partitions. > > On Wed, Mar 15, 2017 at 9:41 AM, Frank Hughes &g

Re: TransportException - Consistency LOCAL_ONE - EC2

2017-03-15 Thread Frank Hughes
'd have to > send your work out in a token aware fashion where said work only goes to > the primary token owner of that data, and remove any shuffling of replicas > in the process (is only on by default in the java driver to my knowledge). > > On Wed, Mar 15, 2017 at 6:38 AM

TransportException - Consistency LOCAL_ONE - EC2

2017-03-15 Thread Frank Hughes
Hi there, Im running a java process on a 4 node cassandra 3.9 cluster on EC2 (instance type t2.2xlarge), the process running separately on each of the nodes (i.e. 4 running JVMs). The process is just doing reads from Cassandra and building a SOLR index and using the java driver with consistency

Re: parallel processing - splitting data

2017-01-19 Thread Frank Hughes
then all data is on every node. So you can > just slice the whole token range into 4 pieces and let each node process 1 > slice. > Determining local ranges also only helps if you read with CL_ONE. > > 2017-01-19 13:05 GMT+01:00 Frank Hughes : > >> Hello there, >> >> I

parallel processing - splitting data

2017-01-19 Thread Frank Hughes
r any help and guidance, Frank Hughes