python client map reduce bucket_type problem

2014-11-25 Thread Ali Rıza KELEŞ
Hi, I had some problem while trying to do map/reduce on a bucket of 'maps type' with official python client. My bucket name is 'cars' and bucket type is maps # bucket query = client.add(bucket.name) # bucket.name is 'cars' query.map("function(v) { var data = JSON.parse(v.values[0].data); retur

Can't enable riak_ensemble_manager

2014-11-25 Thread Igor Birman
I am starting to test consistent buckets but can't get them to work.  I built a new VM with Ubuntu 14.04 64bit, server, installed Riak using the packagecloud.io script, and am trying to run: riak attachriak_ensemble_manager:enable(). I get the following back: ** exception exit: {noproc,{gen_serve

Re: Can't enable riak_ensemble_manager

2014-11-25 Thread Steve Vinoski
On Tue, Nov 25, 2014 at 9:27 AM, Igor Birman wrote: > I am starting to test consistent buckets but can't get them to work. I > built a new VM with Ubuntu 14.04 64bit, server, installed Riak using the > packagecloud.io script, and am trying to run: > > riak attach > riak_ensemble_manager:enable()

Re: Can't enable riak_ensemble_manager

2014-11-25 Thread Igor Birman
That was it, thanks!  I didn't add strong consistency = on to my riak.conf. Igor On Tuesday, November 25, 2014 9:54 AM, Steve Vinoski wrote: On Tue, Nov 25, 2014 at 9:27 AM, Igor Birman wrote: I am starting to test consistent buckets but can't get them to work.  I built a new VM

How to update existed schema

2014-11-25 Thread Yang Zhenguo
I have an existed schema and I want to add one column in it, such as What's the steps to update it? Since there is the search_index related to the schema and a bucket type related to the search_index. I tried to update the schema by the following commands: {ok, SchemaData} = file:read_file("c

Re: How to update existed schema

2014-11-25 Thread Eric Redmond
Automatic updating of indexes due to schema changes doesn't exist yet. It'll be added soon: https://github.com/basho/yokozuna/pull/427 Eric On Nov 25, 2014, at 8:21 AM, Yang Zhenguo wrote: > I have an existed schema and I want to add one column in it, such as > > > > What's the steps to

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
Hi Eric, Any suggestion for my requirement? create a new search index? Regards, Zhenguo 2014-11-26 0:24 GMT+08:00 Eric Redmond : > Automatic updating of indexes due to schema changes doesn't exist yet. > It'll be added soon: > > https://github.com/basho/yokozuna/pull/427 > > Eric > > > On Nov

Re: How to update existed schema

2014-11-25 Thread Eric Redmond
Yes, that is one of the options. Eric On Nov 25, 2014, at 8:40 AM, Yang Zhenguo wrote: > Hi Eric, > > Any suggestion for my requirement? create a new search index? > > Regards, > Zhenguo > > > 2014-11-26 0:24 GMT+08:00 Eric Redmond : > Automatic updating of indexes due to schema changes do

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
Any other options? :) 2014-11-26 0:42 GMT+08:00 Eric Redmond : > Yes, that is one of the options. > > Eric > > > On Nov 25, 2014, at 8:40 AM, Yang Zhenguo wrote: > > Hi Eric, > > Any suggestion for my requirement? create a new search index? > > Regards, > Zhenguo > > > 2014-11-26 0:24 GMT+08:00

Data Modelling

2014-11-25 Thread Santi Kumar
I'm experimenting with Riak and trying out with some of our use cases. Our basic requirement is to have better response times with low latency and hence moving away from costly joins in RDBMS. While modelling, for some of the mappings I can model them as muitiple key-value pairs or use combination

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
Hi Eric, I did the following steps, still not work. 1. delete the old search index 2. create a new search index (first time I used the same name, and second time I used a different name) 3. sudo riak-admin bucket-type update solution_t .. I check the bucket type by "sudo riak-admin bucket-ty

Re: How to update existed schema

2014-11-25 Thread Geoff Garbers
Hey Zhenguo. I've actually just gone through something similar myself recently. ​ ​ I found that the most reliable way to do this is as follows: 1. Update the schema (as you have shown) 2. Attach to the Erlang console on each node, and run rp(yz_index:reload(<<"index_name">>)). ​3. List all keys

Re: How to update existed schema

2014-11-25 Thread Alexander Sicular
You basically need to read and re-write each key as Geoff says. Hopefully this gets automated in the future in some fashion. -Alexander @siculars http://siculars.posthaven.com Sent from my iRotaryPhone > On Nov 25, 2014, at 12:31, Geoff Garbers wrote: > > Hey Zhenguo. > > I've actually ju

Re: How to update existed schema

2014-11-25 Thread Eric Redmond
Yes, to be clear, there are currently a few options to reindex a schema change. After you update the schema, you can: 1. create a new index and reattach 2. rewrite every value inline 3. delete the index directories on every node and let AAE rebuild them The new change will create a 4th option:

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
Hi Alexander, As I understood, If I dont re-write each key, I can not search the old objects. But I did the following steps: 1. insert a new data; 2. search the new data with new field. (doesn't work) Any idea? Regards, Zhenguo 2014-11-26 1:35 GMT+08:00 Alexander Sicular : > You basically need

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
Hi Eric, Thanks a lot. Two more questions: 1. If I dont rewrite every value in Step 2, what's the result? 2. where is the index directories by default? Regards, Zhenguo 2014-11-26 1:44 GMT+08:00 Eric Redmond : > Yes, to be clear, there are currently a few options to reindex a schema > change. A

Re: How to update existed schema

2014-11-25 Thread Eric Redmond
Did you reload the index as Geoff wrote? On Nov 25, 2014, at 9:54 AM, Yang Zhenguo wrote: > Hi Alexander, > > As I understood, If I dont re-write each key, I can not search the old > objects. But I did the following steps: > 1. insert a new data; > 2. search the new data with new field. (doe

Re: Data Modelling

2014-11-25 Thread John Daily
I’ve written a bit about modeling patterns at http://basho.com/riak-development-anti-patterns/ I expanded a bit on it in contributions to the latest version of Eric Redmond’s outstanding http://littleriakbook.com (make sure to grab one of the downloads, the HTML is out of date). -John On Nov

Re: Data Modelling

2014-11-25 Thread Troy Melhase
Lots of insight here: https://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/ On Tue, Nov 25, 2014 at 1:47 PM, John Daily wrote: > I’ve written a bit about modeling patterns at > http://basho.com/riak-development-anti-patterns/ > > I expanded a bit on it in contributio

Re: Data Modelling

2014-11-25 Thread John Daily
Agreed, that’s a useful article, highly recommended. -John On Nov 25, 2014, at 2:03 PM, Troy Melhase wrote: > Lots of insight here: > > https://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/ > > > > On Tue, Nov 25, 2014 at 1:47 PM, John Daily wrote: > I’ve written

Re: python client map reduce bucket_type problem

2014-11-25 Thread Brett Hazen
Ali - Thank you for opening issue  https://github.com/basho/riak-python-client/issues/383.  I’m looking at the issue and I’ll update it with my findings, too. Brett On November 25, 2014 at 4:06:35 AM, Ali Rıza KELEŞ (ali.r.ke...@gmail.com) wrote: Hi, I had some problem while trying to do map

Re: RiakCS poor s3 upload speeds 2MB/s

2014-11-25 Thread Heinz Nikolaus Gies
If you’re evaluating RiakCS vs. Ceph you might want to toss LeoFS[1] in the mix and give it a run. Just as RiakCS it is a dynamo inspired system build in Erlang and comes with the same advantages and disadvantages. But unlike RiakCS it is pretty much exclusive a Object Store so can take a few di

Re: How to update existed schema

2014-11-25 Thread Yang Zhenguo
No, I restarted riak. 2014-11-26 1:56 GMT+08:00 Eric Redmond : > Did you reload the index as Geoff wrote? > > > > On Nov 25, 2014, at 9:54 AM, Yang Zhenguo wrote: > > Hi Alexander, > > As I understood, If I dont re-write each key, I can not search the old > objects. But I did the following steps