MapReduceResult to JSON format

2012-02-22 Thread Rajat Mathur
On running following query IntIndex intIndex; intIndex=IntIndex.named("points"); IndexQuery iQuery = new IntRangeQuery(intIndex,"fkUsers",1100,1300); MapReduceResult result=client.mapReduce(iQuery).addMapPhase(new NamedErlangFunction("riak_kv_mapreduce", "map_object

Re: Riak for Messaging Project Question

2012-02-22 Thread charles
Thanks Alex, I'm thinking I might just have to start with 16 nodes just to reduce the number of vnodes i.e. with a partition size of 1024 and then scale up to 64 nodes. Not sure what I'm going to do when I move away from Cloud Servers where I can use a lot less servers with higher RAM and

Re: Riak for Messaging Project Question

2012-02-22 Thread Alexander Sicular
> > Actuallly, I think my math was faulty, it's actually 800 billion keys, so > that's many more servers than expected. A few billion? Pssh. You know what's cool? A Trillion. A few things jump off the page from the comments on this thread: Static allocation of ring_creation_size. Once you se

Re: Riak for Messaging Project Question

2012-02-22 Thread Aphyr
On 02/22/2012 02:10 PM, char...@contentomni.com wrote: 1. Is Riak a good fit for this solution going up to and beyond 20 million users (i.e. terabytes upon terabytes added per year)? The better question might be: what do you actually plan to do with that much data? 2. I plan to use 2i, whic

Re: 1.1 upgrade woes

2012-02-22 Thread heffergm
Here's a snippet (there are huge amounts of the errors I called out earlier). Some of this is also pre-upgrade: http://hastebin.com/cahuriveni.xml Here's the whole log (from one node) minus the fitting errors (some of which is pre upgrade and some post-rollback): http://hastebin.com/senojileqa.x

Re: 1.1 upgrade woes

2012-02-22 Thread David Smith
heffergm, Would it be possible to get a peek at your logs -- the information you provided is insufficient to make any conclusive determination. Thanks, D. On Wed, Feb 22, 2012 at 3:47 PM, heffergm wrote: > No, nothing similar in our C. No crashes either for that matter, although > non-function

Re: Riak for Messaging Project Question

2012-02-22 Thread Jeremiah Peschka
Copying the list back in, just in case someone smart has a response ;) --- Jeremiah Peschka Managing Director, Brent Ozar PLF, LLC On Wed, Feb 22, 2012 at 6:00 PM, wrote: > Thanks a lot for this Jeremiah, very insightful indeed, especially the bit > on Rackspace and I/O. I understand there wil

Riak Recap for February 17 - 22

2012-02-22 Thread Mark Phillips
Evening, Morning, Afternoon, to All - Missed the Recap on Monday but we have a great one to make up for it. Enjoy. Mark Community Manager Basho Technologies wiki.basho.com/Riak.html twitter.com/pharkmillups - Riak Recap for February 17 - 22 =

recursive/looping map-reduce

2012-02-22 Thread Michael Radford
I'm trying to figure out whether there's an easy way to accomplish something like a "recursive/looping map-reduce query" in Riak. A use case for this is when the objects in the database form a linked list, tree, or graph of some kind, and you want to look up a set of objects whose depth from the i

Re: Riak for Messaging Project Question

2012-02-22 Thread Jeremiah Peschka
Responses inline. --- Jeremiah Peschka Managing Director, Brent Ozar PLF, LLC On Wed, Feb 22, 2012 at 2:10 PM, wrote: > I'm building an online tool/app that is heavily dependent on messaging. This > messaging is simple text, nothing complicated, and it will take place > between my server back-

Re: 1.1 upgrade woes

2012-02-22 Thread heffergm
No, nothing similar in our case. No crashes either for that matter, although non-functional MR is just as bad. -- View this message in context: http://riak-users.197444.n3.nabble.com/1-1-upgrade-woes-tp3768092p3768118.html Sent from the Riak Users mailing list archive at Nabble.com.

Re: 1.1 upgrade woes

2012-02-22 Thread Aphyr
I also discovered MR issues during a rolling upgrade to 1.1.0 last night. We had so many MR errors that the 1.1 node crashed altogether, and I had to roll it back to 1.0.3. Basho support is working on that problem. 2012-02-22 00:56:16.429 [error] <0.1615.0> gen_server riak_pipe_vnode_master t

1.1 upgrade woes

2012-02-22 Thread heffergm
After upgrading to 1.1, we've had all kinds of MR issues (essentially all failing). I'm seeing tons of these in the logs. Any ideas? We've rolled back in the meantime: 2012-02-22 03:12:59.664 [error] <0.354.0>@riak_pipe_vnode:new_worker:763 Pipe worker startup failed:fitting was gone before startu

Riak for Messaging Project Question

2012-02-22 Thread charles
I'm building an online tool/app that is heavily dependent on messaging. This messaging is simple text, nothing complicated, and it will take place between my server back-end and the desktop/device. These messages would be very easy to store in Riak. Each message is created after a specific

Riak for Messaging Project Question

2012-02-22 Thread charles
I'm building an online tool/app that is heavily dependent on messaging. This messaging is simple text, nothing complicated, and it will take place between my server back-end and the desktop/device. These messages would be very easy to store in Riak. Each message is created after a specific us

Re: IndexQuery

2012-02-22 Thread Rajat Mathur
Thanks *Russel* for a very clear and detailed explanation. Also I would like to know if it is possible to query on 2 or more indices in a single indexQuery ? On Wed, Feb 22, 2012 at 10:59 PM, Russell Brown wrote: > Hi Rajat, > > Answers inline below. > > On 22 Feb 2012, at 16:44, Rajat Mathur w

Re: IndexQuery

2012-02-22 Thread Russell Brown
Hi Rajat, Answers inline below. On 22 Feb 2012, at 16:44, Rajat Mathur wrote: > I am running following IndexQuery : > > > IntIndex intIndex=IntIndex.named("points"); > > IndexQuery iQuery = new IntRangeQuery(intIndex,"fkUsers",1100,1300); > > MapReduceResult > resultIn

IndexQuery

2012-02-22 Thread Rajat Mathur
I am running following IndexQuery : IntIndex intIndex=IntIndex.named("points"); IndexQuery iQuery = new IntRangeQuery(intIndex,"fkUsers",1100,1300); MapReduceResult resultInt=client.mapReduce(iQuery).addReducePhase(NamedErlangFunction.REDUCE_IDENTITY).execute(); Collection

Re: Riak-Control problem

2012-02-22 Thread Antonio Rohman Fernandez
Thank you Jeff! Will try that tomorrow at work. Sent from my iPhone On 22/02/2012, at 17:19, Jeffrey Massung wrote: > Rohman, > > You'll also need to enable HTTPS (and SSL) in the riak_core section of the > app.config file. Also, don't forget to change the port used for HTTPS to > something

"forward_preflist" timeout error after 1.1 upgrade

2012-02-22 Thread Matthew A. Brown
Hi all, We're seeing a new timeout error after upgrading our cluster to Riak 1.1. The error message: {"phase":0,"error":"[timeout]","input":"{{<<\"service_profiles\">>,<<\"8fh/2\">>},{struct,[{<<\"key\">>,<<\"s-10925\">>}]}}","type":"forward_preflist","stack":"[]"} Sean indicates that the "forwa

Re: Riak-Control problem

2012-02-22 Thread Jeffrey Massung
Rohman, You'll also need to enable HTTPS (and SSL) in the riak_core section of the app.config file. Also, don't forget to change the port used for HTTPS to something different (I personally use 8069). Note the required changes to the app.config file in the README: https://github.com/basho/riak

Re: Avoiding false concurrency in Riak

2012-02-22 Thread Carlos Baquero
Thanks Jon and congratulations for the new release, We will be available to fill any missing info and iterate on this. I the meantime we will be progressing in the port to the new version, so that we get a more precise idea of the implications. Cheers, Carlos - Carlos Baquero HASLab / IN

RE: Querying [Filter Search]

2012-02-22 Thread Fredrik Lindström
Hi Rajat, I would construct two secondary indexes (2i) when Post objects are created in the form of * userid_timestampOfPost * timestampOfPost This gives you the ability to do a range query for posts created by a specific user and a general range query to posts by all users made within

Querying [Filter Search]

2012-02-22 Thread Rajat Mathur
Considering I have Buckets for Users and Posts and I want to get users postsin last 24 hours, how should I go about it. Post's json data has a key postTime. How to filter search based on value's key value ? -- *Rajat Mathur* ___ riak-users mailing list