Re: Options for Iterative Map Reduce

2012-12-13 Thread Alon Keren
On 13 December 2012 01:07, nicholas a. evans wrote: > Unfortunately, those TODOs and Caveats are part of what nix > couch-incarnate for us. "input validation"; I made it crash several > times (with invalid JSON) while I was testing it out. "limited > error-handling" and "tests. Does this thing r

Re: Options for Iterative Map Reduce

2012-12-12 Thread Alon Keren
Hi Nick, couch-incarnate author here. You described the way it works pretty well. Btw, I suspect also cloudant do their chaining incrementally. I started working on incarnate following my own frustration with the lack of chained-mapreduce. I'm a bit biased here, but I find the end solution to be

Re: Users' Wish-list

2012-05-10 Thread Alon Keren
hree requests seem to be: > > 1. Chained map/reduce > > 2. Partial doc updates > > 3. Native FTI > > I don't quite get #2 but #1 and #3 have been around a long time > > > On Apr 30, 2012, at 6:53 AM, Alon Keren wrote: > > > I've decided that it would

Re: Users' Wish-list

2012-04-30 Thread Alon Keren
er be exactly right to be included out of the box (like document versioning). Thoughts and feedback welcome, Alon On 26 April 2012 20:58, Alon Keren wrote: > Hi everyone, > > Following the excellent initiative by couch devs with the recent > feature-survey [1] [2], I figured it wou

Re: Users' Wish-list

2012-04-28 Thread Alon Keren
I added a couple of wishes. > > > > Kind regards, > > Hendrik Jan > > > > On 28 April 2012 16:23, Alon Keren wrote: > > > > > Hi, > > > > > > First of all, feel free to add to the list first, and ask questions > later > > > :)

Re: Users' Wish-list

2012-04-28 Thread Alon Keren
s. > > Kind regards, > Hendrik Jan > > On 28 April 2012 16:23, Alon Keren wrote: > > > Hi, > > > > First of all, feel free to add to the list first, and ask questions later > > :) > > > > I seeded it with the subset of Bob's list that I bo

Re: Users' Wish-list

2012-04-28 Thread Alon Keren
;. > Did the seeding go wrong or am I missing somehting? > > > Kind regards, > Hendrik Jan van Meerveld > > > On 26 April 2012 19:58, Alon Keren wrote: > >> Hi everyone, >> >> Following the excellent initiative by couch devs with the recent >> feature-

Re: Users' Wish-list

2012-04-27 Thread Alon Keren
For anyone not wanting to bother with yet another site to keep up with - there's now a feedburner RSS for suggestions and comments: http://feeds.feedburner.com/CouchdbWishlist. Oh, and thanks Martin, Randall, Michael and anonymous for kicking things off. Alon On 26 April 2012 20:58,

Users' Wish-list

2012-04-26 Thread Alon Keren
Hi everyone, Following the excellent initiative by couch devs with the recent feature-survey [1] [2], I figured it would be worth while to have a permanent wish-list for just user-facing features; a place for users to put their own ideas and feature-requests, and to vote on others'. Such a wish-l

Re: Help shape the future of CouchDB: your voice needed!

2012-04-16 Thread Alon Keren
Thank you guys for making this poll, and for publishing the minutes and audio. I've voted, and it would be really nice to have this (or other) list as a wish-list that couchdb users could continuously update. Alon On 16 April 2012 10:07, Mike Kimber wrote: > Good on you for trying something

Re: Reduce just N rows?

2012-04-16 Thread Alon Keren
On 16 April 2012 22:25, James Marca wrote: > On Sun, Apr 15, 2012 at 12:00:38PM +0300, Alon Keren wrote: > > On 15 April 2012 09:13, James Marca wrote: > > > > > CouchDB will compute reduced values for what you select. If you just > > > ask for values from A

Re: Reduce just N rows?

2012-04-15 Thread Alon Keren
On 15 April 2012 21:06, Mark Hahn wrote: > >would at least reach thousands, so fetching all keys is quite > demanding > > My suggestion may well be the wrong path to take, but I'd like to point out > that fetching thousands of keys is nothing. Getting 16 kbytes of data > takes a few ms. An

Re: Reduce just N rows?

2012-04-15 Thread Alon Keren
one case where I want to shuffle the order > of the keys and therefore generate an almost identical copy of the > view's data just to get a different organization of the tree. > > Hope that helps, > James > > > On Sun, Apr 15, 2012 at 02:02:21AM +0300, Alon Keren wrote: > &g

Re: Reduce just N rows?

2012-04-15 Thread Alon Keren
On 15 April 2012 03:48, Mark Hahn wrote: > IMHO, It isn't too much trouble to get just the list of all doc ids and the > do a batch query for the first 10. > Thanks. When starting out, I could very well adopt such a method. On the long run, however, I see these obstacles: 1. I would need to do t

Reduce just N rows?

2012-04-14 Thread Alon Keren
Hi, I have the following scenario: a player can play one of many types of games. After finishing a game, the player's score is kept in a new document. I'd like to list a player's average score in the latest 10 games, for all types of games. I don't see an easy way to solve this with CouchDB, unle

Re: When will BigCouch be merged into Apache Couchdb?

2012-04-09 Thread Alon Keren
On 9 April 2012 13:22, Mike Kimber wrote: > Goog, > > As Sam says the key feature is Dynamo style horizontal scaling > (masterless). It's insanely easy to set up took me less than an hour to get > a three node Centos 5.7 cluster up and running. > > The cloudant service provides a number of other

Re: Best practice for backing up CouchDB

2012-04-05 Thread Alon Keren
Hi Martin, I asked this question a while back, and the resulting discussion is quite informative: http://comments.gmane.org/gmane.comp.db.couchdb.user/11410 Alon On 5 April 2012 17:46, Martin Hewitt wrote: > Hi all, > > I was just wondering if anyone had any hints, tips or tricks for doing >

Re: iterative map reduce

2011-12-14 Thread Alon Keren
gt; project, only on our hosted service at cloudant.com. Sorry! > > > > B. > > A cryin' shame!!! > > > On 14 December 2011 09:01, Alon Keren wrote: > >> I've been working on an open-source tool with a similar approach > chaining > >> map-re

Re: iterative map reduce

2011-12-14 Thread Alon Keren
I've been working on an open-source tool with a similar approach chaining map-reduce: https://github.com/afters/Couch-Incarnate The need to pay the bills withheld me from putting more time into it lately, so I can't say it's production quality. Hopefully, this will change soon. Dominic - the meth

Re: Apache CouchDB is Alive and Kicking

2011-11-30 Thread Alon Keren
You guys are moving too slow :) http://news.ycombinator.com/item?id=3296363 On 30 November 2011 21:06, Jason Hess wrote: > +1 on the blog post. > > > On Nov 30, 2011, at 11:04 AM, Mikeal Rogers wrote: > > > you should make this a blog post so that I can link to it :) > > > > On Nov 30, 2011, at

Re: Writing Advanced Aggregate Queries -- Equivalent of SELECT COUNT(DISTINCT field) in CouchDB?

2011-11-16 Thread Alon Keren
Hi, Here's an incremental alternative, using Couch Incarnate ( https://github.com/afters/Couch-Incarnate). Keep in mind that the project is still experimental. I'd first use Couch Incarnate to create a DB holding only the unique names: { "source": YOUR_ORIGINAL_DB_URL, "map": "function (doc)

ANN: Couch Incarnate 0.1: views of views

2011-10-25 Thread Alon Keren
https://github.com/afters/Couch-Incarnate Couch Incarnate is a CouchDB tool that allows you to create views of views (AKA chaining map-reduce operations). It does so by maintaining a map-reduce DB, instead of a regular view. This is called "an incarnation", to which you can then attach regular vie

Re: noobie questions

2011-10-24 Thread Alon Keren
Hi, On 24 October 2011 08:28, Karl Seguin wrote: > Hi, > I'm just starting to learn CouchDB and I've accumulated four questions. > > First, I only found some vague references, but are views only updated on > read request? (assuming there's something to update). There's no built-in > mechanism to

Couch Incarnate: views in DB-form, to allow map-reduce chains

2011-10-19 Thread Alon Keren
Hi folks! In the last few months, between projects, I've been tinkering with ideas and implementations for making map-reduce chains work. I think my current direction is solid enough to share - and I hope to get from you guys either encouragement, insight, or a "hold it, I have a much better solut

Re: Even more fine-grained ETag support when querying views?

2011-09-13 Thread Alon Keren
which is whether this is a strong enough hash to > >> > use for an ETag. There are two types of ETags with slightly different > >> > semantics, so we'd have to figure out what we can do and where this > >> > falls on that spectrum. Secondly, computing th

Re: Even more fine-grained ETag support when querying views?

2011-09-12 Thread Alon Keren
Disclosure: I don't know much about e-tags, CouchDB internals (or bloom filters). How about maintaining an e-tag for each sub-tree in the view, similar to the way (I think) reduce works? When a row gets updated, its e-tag would be recalculated, and then its parent's e-tag would be recalculated, an