Re: Deleting data from LevelDB backend

2013-09-26 Thread Simon Effenberg
Are we talking about http://docs.basho.com/riak/1.3.1/cookbooks/Repairing-KV-Indexes/ ? and if yes.. is this also doing a repair if data is missing? So after executing the repair on one node.. will it have afterwards: * all keys it should have (like if AAE is fixing stuff through Read Repair)

LevelDB tuning questions.

2013-09-26 Thread Guido Medina
Hi, I'm trying to tune our Riak cluster using http://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/#Parameter-Planning but I'm still lost on how to use the calculation results, here are my questions: 1. Does this calculator

Re: Invoking Python script as part of a M/R job?

2013-09-26 Thread jeffrey k eliasen
Hmmm, that's interesting. I don't quite understand why it works, but it's a step in the right direction. It surprises me that there isn't an easy way to invoke an external script from within a job. -- jeffrey k eliasen Find and follow me on: Blog: http://jeff.jke.net Twitter:

Re: Invoking Python script as part of a M/R job?

2013-09-26 Thread jeffrey k eliasen
I suppose I could just use os:cmd from Erlang, but I've never worked with this before: http://www.erlang.org/doc/man/os.html. Does anyone know if this should be expected to work? Thanks! -- jeffrey k eliasen Find and follow me on: Blog: http://jeff.jke.net Twitter:

Re: LevelDB tuning questions.

2013-09-26 Thread Matthew Von-Maszewski
Guido,The attached spreadsheet is best for 1.4. Not sure how I missed getting it posted to the web-site.Riak admin only reports memory usage as known by the Erlang virtual machine. leveldb is outside Erlang's awareness.The best memory measurement on a Linux machine is the /proc/process id/status

Re: Deleting data from LevelDB backend

2013-09-26 Thread Matthew Von-Maszewski
Simon, I queried Basho's Client Services group. They use the following as the guideline for leveldb vnode (database) repair: https://gist.github.com/gburd/b88aee6da7fee81dc036 This repair sequence is different than the one you are quoting. You do not need to manually delete the MANIFEST

init script

2013-09-26 Thread Jorge Sanchez
Hi, do you guys have some standard init script for debian ? I compiled from source (due to erlang version dependency which was installed for rabbitmq) Regards, Jorge ___ riak-users mailing list riak-users@lists.basho.com

Re: init script

2013-09-26 Thread Hector Castro
Jorge, Our packages are built using the contents of the node_package repository. [0] The init script for Debian is included. [1] --  Hector [0] https://github.com/basho/node_package [1]  https://github.com/basho/node_package/blob/develop/priv/templates/deb/init.script On September 26, 2013 at

Re: Deleting data from LevelDB backend

2013-09-26 Thread Simon Effenberg
Thanks Matthew.. but to clarify.. 1. remove big .sst files 2. trigger repair through https://gist.github.com/gburd/b88aee6da7fee81dc036 3. wait for AAE or do a repair by hand with http://docs.basho.com/riak/1.3.1/cookbooks/Repairing-KV-Indexes/ to get all missing (because deleted) keys?

Re: Deleting data from LevelDB backend

2013-09-26 Thread Matthew Von-Maszewski
Simon, The key issue is that the procedure below has only been performed a few times, and only by people outside of Basho. No complaint has surfaced, but that does not mean the procedure is safe or thoroughly tested. We have developed a plan for addressing the situation safely, but it is

Re: allow_mult vs. 2i

2013-09-26 Thread Brady Wetherington
Oh, I get what the siblings/allow_mult business is for, just wondering if I can use it off-label a little, and eventually do 'conflict resolution' which would make the results be much more reasonable. But it sounds like I shouldn't do that. That's totally fine. Since I'm doing a write-once,