On 13 Feb 2013, at 08:07, Bogdan Flueras <[email protected]> wrote:
> How to set the bucket to last write? Is it in the builder?
Something like:
Bucket b = client.createBucket("my_bucket").lastWriteWins(true);
Also, after you've created the bucket, do you use it from all threads? You
don't re-fetch the bucket per-insert operation, do you?
But the "withoutFecth()" option is probably going to be the biggest
performance increase, and safe if you are only doing inserts.
Cheers
Russell
> I'll have a look..
> Yes, I use more threads and the bucket is configured to spread the load
> across all nodes.
>
> Thanks, I'll have a deeper look into the API and let you know about my
> results.
>
> ing. Bogdan Flueras
>
>
>
> On Wed, Feb 13, 2013 at 10:02 AM, Russell Brown <[email protected]> wrote:
> Hi,
>
> On 13 Feb 2013, at 07:37, Bogdan Flueras <[email protected]> wrote:
>
> > Hello all,
> > I've got a 5 node cluster with Riak 1.2.1, all machines are multicore,
> > with min 4GB RAM.
> >
> > I want to insert something like 50 million records in Riak with the java
> > client (Protobuf used) with default settings. I've tried also with HTTP
> > protocol and set w = 1 but got some problems.
> >
> > However the process is very slow: it doesn't write more than 6GB/ hour or
> > aprox. 280 KB/second.
> > To have all my data filled in, it would take aprox 2 days !!
> >
> > What can I do to have the data filled into Riak ASAP?
> > How should I configure the cluster ? (vm.args/ app.config) I don't care so
> > much about consistency at this point.
>
> If you are certain to be only inserting new data setting your bucket(s) to
> last write wins will speed things up. Also, are you using multiple threads
> for the Java client insert? Spreading the load across all five nodes? Are you
> using the "withoutFetch()" option on the java client?
>
> Cheers
>
> Russell
>
> >
> > Thank you,
> > ing. Bogdan Flueras
> >
> > _______________________________________________
> > riak-users mailing list
> > [email protected]
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
