Re: bitcask io mode
Oops, sorry, I overlooked your question. The erlang/nif I/O setting affect all Bitcask file I/O, see https://github.com/basho/bitcask/blob/develop/src/bitcask_io.erl -Scott ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak upgrade from 1.4.10 to 2.0.2 failed
Disregard please, our patch file uses FQDN and it was pointing to the
wrong file (vm.args)
Guido.
On 13/11/14 14:43, Guido Medina wrote:
Why is it Riak assuming the node is called "nonode@nohost"?
I didn't have to set that before and somehow my vm.args ended with the
proper node name, in this case this one should be
"r...@x1.clonmel.temetra.com"
Regards,
Guido.
On 13/11/14 14:34, Guido Medina wrote:
Forgot to paste the error message:
2014-11-13 14:16:06.524 [info] <0.7.0> Application mochiweb
started on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application webmachine
started on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application basho_stats
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application bitcask
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application eleveldb
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application pbkdf2 started
on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application poolboy
started on node nonode@nohost
2014-11-13 14:16:06.819 [error] <0.144.0> Supervisor
riak_core_sup had child riak_core_broadcast started with
riak_core_broadcast:start_link() at undefined exit with reason
{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['r...@x1.clonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',['r...@x6.clonmel.temetra.com',...]}]],...},...]}}
in context start_error
2014-11-13 14:16:06.819 [error] <0.142.0> CRASH REPORT Process
<0.142.0> with 0 neighbours exited with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['riak@x1.c
lonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
in application_master:init/4 line 133
2014-11-13 14:16:06.819 [info] <0.7.0> Application riak_core
exited with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['riak@x1.clonmel
.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
On 13/11/14 14:32, Guido Medina wrote:
Hi,
Failed miserably trying to upgrade Riak 1.4.10 to 2.0.2 after
created all the patch files to use the new riak.conf, I noticed that
we don't need custom parameters any longer so the only thing we
changed was the backend to be "leveldb"
Is it level DB max open files parameter needed any longer? I
couldn't find it at the advanced config docs. Hence I'm not using it.
Any hints?
Regards,
Guido.
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak upgrade from 1.4.10 to 2.0.2 failed
Why is it Riak assuming the node is called "nonode@nohost"?
I didn't have to set that before and somehow my vm.args ended with the
proper node name, in this case this one should be
"r...@x1.clonmel.temetra.com"
Regards,
Guido.
On 13/11/14 14:34, Guido Medina wrote:
Forgot to paste the error message:
2014-11-13 14:16:06.524 [info] <0.7.0> Application mochiweb
started on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application webmachine
started on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application basho_stats
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application bitcask started
on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application eleveldb
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application pbkdf2 started
on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application poolboy started
on node nonode@nohost
2014-11-13 14:16:06.819 [error] <0.144.0> Supervisor riak_core_sup
had child riak_core_broadcast started with
riak_core_broadcast:start_link() at undefined exit with reason
{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['r...@x1.clonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',['r...@x6.clonmel.temetra.com',...]}]],...},...]}}
in context start_error
2014-11-13 14:16:06.819 [error] <0.142.0> CRASH REPORT Process
<0.142.0> with 0 neighbours exited with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['riak@x1.c
lonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
in application_master:init/4 line 133
2014-11-13 14:16:06.819 [info] <0.7.0> Application riak_core
exited with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['riak@x1.clonmel
.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
On 13/11/14 14:32, Guido Medina wrote:
Hi,
Failed miserably trying to upgrade Riak 1.4.10 to 2.0.2 after created
all the patch files to use the new riak.conf, I noticed that we don't
need custom parameters any longer so the only thing we changed was
the backend to be "leveldb"
Is it level DB max open files parameter needed any longer? I couldn't
find it at the advanced config docs. Hence I'm not using it.
Any hints?
Regards,
Guido.
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak upgrade from 1.4.10 to 2.0.2 failed
Forgot to paste the error message:
2014-11-13 14:16:06.524 [info] <0.7.0> Application mochiweb started
on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application webmachine
started on node nonode@nohost
2014-11-13 14:16:06.528 [info] <0.7.0> Application basho_stats
started on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application bitcask started
on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application eleveldb started
on node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application pbkdf2 started on
node nonode@nohost
2014-11-13 14:16:06.531 [info] <0.7.0> Application poolboy started
on node nonode@nohost
2014-11-13 14:16:06.819 [error] <0.144.0> Supervisor riak_core_sup
had child riak_core_broadcast started with
riak_core_broadcast:start_link() at undefined exit with reason
{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['r...@x1.clonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',['r...@x6.clonmel.temetra.com',...]}]],...},...]}}
in context start_error
2014-11-13 14:16:06.819 [error] <0.142.0> CRASH REPORT Process
<0.142.0> with 0 neighbours exited with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['r...@x1.clonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
in application_master:init/4 line 133
2014-11-13 14:16:06.819 [info] <0.7.0> Application riak_core exited
with reason:
{{shutdown,{failed_to_start_child,riak_core_broadcast,{'EXIT',{function_clause,[{orddict,fetch,[nonode@nohost,[{'r...@x1.clonmel.temetra.com',['r...@x2.clonmel.temetra.com','r...@x3.clonmel.temetra.com']},{'r...@x2.clonmel.temetra.com',['r...@x5.clonmel.temetra.com','r...@x6.clonmel.temetra.com']},{'r...@x3.clonmel.temetra.com',['r...@x1.clonmel.temetra.com','r...@x2.clonmel.temetra.com']},{'r...@x5.clonmel.temetra.com',['r...@x3.clonmel.temetra.com','r...@x5.clonmel.temetra.com']},{'r...@x6.clonmel.temetra.com',...}]],...},...],...}
On 13/11/14 14:32, Guido Medina wrote:
Hi,
Failed miserably trying to upgrade Riak 1.4.10 to 2.0.2 after created
all the patch files to use the new riak.conf, I noticed that we don't
need custom parameters any longer so the only thing we changed was the
backend to be "leveldb"
Is it level DB max open files parameter needed any longer? I couldn't
find it at the advanced config docs. Hence I'm not using it.
Any hints?
Regards,
Guido.
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak upgrade from 1.4.10 to 2.0.2 failed
Hi, Failed miserably trying to upgrade Riak 1.4.10 to 2.0.2 after created all the patch files to use the new riak.conf, I noticed that we don't need custom parameters any longer so the only thing we changed was the backend to be "leveldb" Is it level DB max open files parameter needed any longer? I couldn't find it at the advanced config docs. Hence I'm not using it. Any hints? Regards, Guido. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Yokozuna performance: single large index vs many smaller indexes
Hi all.
I've been looking around for a bit with some sort of guidelines as to how
best to structure search indexes within Riak 2.0 - and have yet to come up
with anything that satisfies my questions.
I came across https://github.com/basho/yokozuna/blob/develop/docs/ADMIN.md,
where it talks about the one-to-one and many-to-one ways of indexing. It
mentions in passing the potential for lower latency of queries and
efficient deletion of index data when using the one-to-one method - without
really mentioning too much about when one method could significantly
outweigh the other in performance.
However, something I'm still not sure on is *when* is it considered a good
idea to use multiple indexes, versus one massive index.
If you'll bear with me, I'll use this simple scenario:
I have lists, and I have contacts within these lists. In total, I have 100
million contacts that I am dealing with. Each of them not more than 20KB in
size, and they all follow the exact same JSON object structure. Ignoring
application design for simplicity's sake, let's say I could choose between
the following two ways of storing lists and contacts:
1. Having two buckets: *lists* and *contacts*.
All 100 million contacts are stored in the *contacts* bucket. Each
contact object is linked to its corresponding list through a *list_key*
property, and all the contacts are stored in the same single search index.
2. Having multiple buckets: *lists*, and for each list, having a
separate bucket *contacts_{listkey}*.
Using this structure, each *contact_{listkey}* bucket would have its own
search index.
With these two scenarios in mind; and making the assumption that we're
dealing with 100 million contacts:
1. Which would be the better method of implementing the search indexes?
2. At which point would one solution be far better than the other?
3. How much does Yokozuna differ from stock-standard Solr? All the
search results I could find on Solr specifically weren't talking about
indexes greater than 60,000 objects, yet Riak is required to be able to
deal with 100's of millions of rows.
Any help at all with this is really appreciated.
At some point, I do realise that I will need to set this up for myself, and
performance my own tests on it. However, I was hoping that those currently
using Riak in production might have some more insight into this.
Regards,
Geoff
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Search queries
Thanks Eric - I don't see the _yz_vtag returned in the search result set - so not sure how to tell that? [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Airport Business Park, Cork, Ireland. On 12 November 2014 17:53, Eric Redmond wrote: > > On Nov 11, 2014, at 3:55 AM, Jason Ryan wrote: > > Hi all, > > I have some quick (hopefully!) questions around Riak search. > > 1. I'm getting multiple documents returned in the search results for a > query - which I assume is based on the n_val of my bucket as I tried to > change the search index to have a n_val of 1 but got an error that it > needed to match the bucket n_val - is this expected behaviour, i.e. will > the search return multiples based from the n_val, and I need to code for > that? > > > You should only get multiple results if your values have siblings. You can > tell if they're siblings because the duplicates will have different > _yz_vtags. > > 2. What is best practice if we required to change an index (e.g. adding a > new indexed field) and wanted to re-generate the index for a particular > bucket? > > > Currently, that requires you rewriting your dataset again. However, there > is a PR in the works to allow incremental schema changes, as well as > allowing AAE to automatically update indexed documented based on schema > changes: https://github.com/basho/yokozuna/pull/427 > > > Thanks! > Jason > > > > This message is for the named person's use only. If you received this > message in error, please immediately delete it and all copies and notify > the sender. You must not, directly or indirectly, use, disclose, > distribute, print, or copy any part of this message if you are not the > intended recipient. Any views expressed in this message are those of the > individual sender and not Trustev Ltd. Trustev is registered in Ireland > No. 516425 and trades from 2100 Cork Airport Business Park, Cork, Ireland. > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > > -- This message is for the named person's use only. If you received this message in error, please immediately delete it and all copies and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. Any views expressed in this message are those of the individual sender and not Trustev Ltd. Trustev is registered in Ireland No. 516425 and trades from 2100 Cork Airport Business Park, Cork, Ireland. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
