Re: Dangling keys/objects after a batch of sequential inserts (for going on 3 days)

On 07/22/2013 10:29 AM, Andrew Thompson wrote: You should be doing a GET before the PUT with the deletedvclock option. Here is an example I used to originally test (and fix) this bug: https://gist.github.com/Vagabond/965376#file-delete_bug-erl-L48 Sadly, because of backwards compatability issu

CorrugatedIron and Mono

Quick question for anyone on the list using CorrugatedIron to access Riak - Are you deploying on Mono? If so, which Mono version? Which OS/platform? We're planning some long term changes to CorrugatedIron and want to make sure that our changes don't leave anyone in the dust. Please reply off-list

Re: Performance problem: put operation takes seconds

Hi Kirill, Raw output from stats and graphs showing trends would be very useful. Access to the log files would also help. Best regards, Christian On 22 Jul 2013, at 20:36, ks wrote: > Hi Christian, > >> Are you running key or bucket listings? >> Are you running secondary index queries or

Re: Performance problem: put operation takes seconds

Thanks Vahric, Agree, we'll reconfigure the nodes as RAID 0. Still I don't believe RAID misconfiguration can be the cause of such the response times. Best, Kirill -- View this message in context: http://riak-users.197444.n3.nabble.com/Performance-problem-put-operation-takes-seconds-tp402847

Re: Performance problem: put operation takes seconds

Hi Christian, > Are you running key or bucket listings? > Are you running secondary index queries or mapreduce jobs? Nope, we only do com.basho.riak.client.bucket.Bucket.fetch() and .store(). There's no other usages of Riak client library in our code. > Can you confirm you have disabled swap?

Re: Best way to insert a collection of items at once

Re your last Q: > I have read StoreObject does a read on every write, if true, can that be disabled? Yes. If you're not worried about creating siblings you can use the withoutFetch() option in the StoreObject: storeObject.withoutFetch().execute(); The StoreObject will not attempt to fetch the

Re: Best way to insert a collection of items at once

Thank you for your reply, I gave that a shot and worked really well. -- View this message in context: http://riak-users.197444.n3.nabble.com/Best-way-to-insert-a-collection-of-items-at-once-tp4028487p4028500.html Sent from the Riak Users mailing list archive at Nabble.com.

Re: Comparing Riak MapReduce and Hadoop MapReduce

Yeah, I also read about pre-reduce and will try it out. Thanks for all the help! I really appreciate it. Xiaoming On Mon, Jul 22, 2013 at 1:43 PM, Jeremiah Peschka [via Riak Users] < ml-node+s197444n4028497...@n3.nabble.com> wrote: > Oh, I almost forgot, you can also supply the do_prereduce arg

Re: Riak-CS Question

Thanks , its working VM On Friday, July 19, 2013, Vahric Muhtaryan wrote: > Sorry i see the issue because of replication . Right > > 19 Tem 2013 19:20 tarihinde "Vahric Muhtaryan" yazdı: > > Okay i will configure it and check it. Because of i am sending request to only 245 i assume that no need

Re: Counting total items in a backend store with TTL

riak has traditionally not counted things well, if at all. recently with the 1.4 release they have announced support for distributed counters, http://basho.com/basho-announces-availability-of-riak-1-4/. Try using that to keep track of various things? -Alexander Sicular @siculars On Jul 22, 2

Re: Comparing Riak MapReduce and Hadoop MapReduce

Oh, I almost forgot, you can also supply the do_prereduce argument to your reduce phase - this performs a pre-reduce phase on the mapper. This can, depending on the workload, significantly decrease the network overhead between the mappers and the reducer. --- Jeremiah Peschka - Founder, Brent Ozar

Re: Comparing Riak MapReduce and Hadoop MapReduce

For JavaScript the number of reducers is configured in the app.config file on each node with the reduce_js_vm_count property. --- Jeremiah Peschka - Founder, Brent Ozar Unlimited MCITP: SQL Server 2008, MVP Cloudera Certified Developer for Apache Hadoop On Mon, Jul 22, 2013 at 8:07 AM, Xiaoming

Counting total items in a backend store with TTL

All, This is kind of like the last thorn before moving with riak implementation for me. My use case for now is storing 1) transient payload in memory backend with ttl 2) storing something similar to user sessions in bitcask with ttl. Since the backend stores are ttl, I need to be able to cou

Re: Performance problem: put operation takes seconds

Hi, Why need to apply raid 1 ? Apply raid 0 for each node , this should be increase the performance. Riak also keep 3 copy of each value, no need to care about redundancy. Also maybe the problem could be SATA because if its desktop one then latency could be increase and because of sata interface s

Re: Best way to insert a collection of items at once

Hi, I am not familiar with the java api but in my opinion you should not compromise on the quorums in order to gain speed, at least not in this case. Looping through each item is the collection is slow but you can divide the collection in 10 chunks (for example) and loop them using 10 different

Re: Comparing Riak MapReduce and Hadoop MapReduce

Thanks for the clarification, Jeremiah! One last question: how should I configure the MR job to have multiple reducer processes on a single node? Regards, Xiaoming On Mon, Jul 22, 2013 at 1:33 AM, Jeremiah Peschka [via Riak Users] < ml-node+s197444n402847...@n3.nabble.com> wrote: > Ah, yeah, I

Re: mapreduce timeout

Thanks Christian, I was able to modify the job code in a similar manner as you suggested and the issue is now resolved. However, I'd still like to understand the cause of these timeouts and what parameter should be raised, if possible, to mitigate them? This particular job was not expected to p

Re: Dangling keys/objects after a batch of sequential inserts (for going on 3 days)

You should be doing a GET before the PUT with the deletedvclock option. Here is an example I used to originally test (and fix) this bug: https://gist.github.com/Vagabond/965376#file-delete_bug-erl-L48 Sadly, because of backwards compatability issues, it was not possible to default deletedvclock

Re: What is the purpose of "rel" links?

Hi, Age. The Link header in HTTP as used by Riak is defined by RFC 5988. In the Link Relation Type registry (http://tools.ietf.org/html/rfc5988#section-6.2.2) you can see that the relation type "up" refers to a parent document in a hierarchy of documents. In Riak, this means the bucket a key is

Re: Performance problem: put operation takes seconds

Hi, If you do not have siblings enabled and are certain ALL values are small, there are a few other things that can cause performance problems: - Are you running key or bucket listings? - Are you running secondary index queries or mapreduce jobs? - Can you confirm you have disabled swap? - Are y

Re: riak 1.4.0 upgrade failed

That worked! Thanks! Kathleen -- View this message in context: http://riak-users.197444.n3.nabble.com/riak-1-4-0-upgrade-failed-tp4028429p4028493.html Sent from the Riak Users mailing list archive at Nabble.com. ___ riak-users mailing list riak-user

Re: What is the purpose of "rel" links?

Thanks Justin. That makes it clear. When it comes to modeling links for my Scala client library, I think I'll ignore "rel" links then, since they cannot be created (directly) by users and they cannot be walked using the link walking API. In general, it would be helpful for the docs to be a bit

Riak Recap for July 11 - 22nd

Hello all, Today's recap is coming to you from across the street of Eastern State Penitentiary in partly cloudy Philadelphia. First and foremost, we're excited to share the new Riak docs reorg and redesign. - http://docs.basho.com Jeremiah Peschka announced CorrugatedIron 1.4 with support for Ri

Best way to insert a collection of items at once

Hi All, new Riak'er here so please bear with me. I have a cluster of 5 nodes, and I have created a cluster-PCB client using the RiakFactory. My question is the following; Given a collection of 10,000 items, what is the fastest way of inserting such items. I have tried the following techniques usi

Re: Performance problem: put operation takes seconds

Thanks, There's no such a message in logs. We operate on small objects: key and values are literally less than 20 bytes. -- View this message in context: http://riak-users.197444.n3.nabble.com/Performance-problem-put-operation-takes-seconds-tp4028478p4028488.html Sent from the Riak Users maili

Re: What is the purpose of "rel" links?

Anyone? On Jul 12, 2013, at 22:52, Age Mooij wrote: > Hi > > I've been looking at links and link walking and I noticed that Riak very > often returns a special type of link with rel="up" instead of a riaktag, > which is illegal for users to create. > > What is the purpose of this link? (beyo

Re: Performance problem: put operation takes seconds

Hi, A reasonably common cause for sudden spikes in latencies is that the buffers used for internal communication gets exhausted. This tends to manifest itself through large number of 'busy_dist_port' messages in the logs. This is especially common if you have large objects or objects with lots

Re: Performance problem: put operation takes seconds

Hi Christian! Sure: vm.args app.config Thanks! ks -- View this message in context: http://riak-users.197444.n3.nabble.com/Performance-problem-put-operation-take

Re: Performance problem: put operation takes seconds

Hello, Please can you attach your app.config and vm.args files as well as a zipped up log directory from one of the nodes? Best regards, Christian On 22 Jul 2013, at 12:40, ks wrote: > Hi there, > > We're using Riak 1.3.1 cluster with 3 nodes (CentOS 64-bit, Intel® Xeon® > E3-1245 Quadcore

Performance problem: put operation takes seconds

Hi there, We're using Riak 1.3.1 cluster with 3 nodes (CentOS 64-bit, Intel® Xeon® E3-1245 Quadcore, 16 GB DDR3 RAM ECC, 2 x 3 TB SATA 6 Gb/s HDD 7200 rpm (Software-RAID 1)) connected to the same 10 Gb router. We hold lot of small key-value pairs in the database and do about 500 get operations an