Re: Riak Search Map Reduce error

2013-11-25 Thread Roger Diller
After looking at this again, I think the real problem is that fact that I'm using map reduce. The Riak java client does not support simple search but only search map reduce. At this point, I think the only good way to really use Riak search from Java is to use a solr client and point it to the Riak

Re: Riak Search Map Reduce error

2013-11-21 Thread Roger Diller
Ok, I'm not exactly sure what will be most helpful to you, but I am attaching an example of a Key/Value. What you see in the file, we would have thousands of those. Probably would get to at least a million or so KV's like that. The bucket is search enabled, so all those JSON fields are going to b

Re: Riak Search Map Reduce error

2013-11-20 Thread Ryan Zezeski
Roger, Riak Search has a hardcoded max result set size of 100K items. It enforces this to prevent blowing out memory and causing other issues. Riak Search definitely has some issues when it comes to handling a use case like yours. That said, our new Search solution in 2.0 (code named Yokozuna) sh

Re: Riak Search Map Reduce error

2013-11-20 Thread Todd Tyree
Hi Roger, Sorry, meant to reply to the mailing list, but accidentally replied directly to you. Before I can say whether or not secondary indexes are suitable, I need to know more about your data, access patterns and query patterns. Can you share this information with me here? What kind of data

Re: Riak Search Map Reduce error

2013-11-20 Thread Roger Diller
I could dig up all our nitty gritty Riak details but I don't think that will help really. The point I think is this: Using search map reduce is not a viable way to do real time search queries. Especially ones that may have 2000+ plus results each. Couple that with search requests coming in every f

Re: Riak Search Map Reduce error

2013-11-18 Thread Alexander Sicular
More info please... Version Current config Hardware Data size Search Schema Etc. But I would probably say that your search is returning too many keys to your mr. More inline. @siculars http://siculars.posthaven.com Sent from my iRotaryPhone > On Nov 18, 2013, at 13:59, Roger Diller wrote:

Riak Search Map Reduce error

2013-11-18 Thread Roger Diller
Using the Riak Java client, I am executing a search map reduce like this: MapReduceResult result = riakClient.mapReduce(SEARCH_BUCKET, search).execute(); String search = "systemId:" + systemName + " AND indexId:" + indexId; MapReduceResult result = riakClient.mapReduce(SEARCH_BUCKET, search).exe

Riak Search Map Reduce error

2013-11-18 Thread Roger Diller
Using the Riak Java client, I am executing a search map reduce like this: MapReduceResult result = riakClient.mapReduce(SEARCH_BUCKET, search).execute(); String search = "systemId:" + systemName + " AND indexId:" + indexId; MapReduceResult result = riakClient.mapReduce(SEARCH_BUCKET, search).exe