Re: object_lager_event what is it ?

2019-10-22 Thread Bryan Hunt
Thanks Luke, Grep’d and ditto, seems like it’s a vestigial limb, deleting from my configs. Thanks Bryan > On 21 Oct 2019, at 18:58, Luke Bakken wrote: > > Hey Bryan, > > Something similar in the RabbitMQ code base made me go "huh" the other > day. Calls to rabbit_log_ldap module functions

Re: object_lager_event what is it ?

2019-10-21 Thread Luke Bakken
Hey Bryan, Something similar in the RabbitMQ code base made me go "huh" the other day. Calls to rabbit_log_ldap module functions when no such module exists. Turns out there's a parse transform defined that turns these calls into lager function calls to an extra sink: https://github.com/rabbitmq/r

Re: ANN: Riak KV 2.9.0 P4 - New patch update available

2019-09-09 Thread Martin Sumner
Note the link to packages was incorrect in the previous announcement. Corrected link below. The latest patch for the 2.9.0 is now available. On github the release can be found at - https://github.com/basho/riak/tree/riak-2.9.0p4. Updated packages are also available (thanks to Nick Adams at TI To

Re: File corruption after power cut

2019-09-04 Thread Fred Dushin
Just remember if you are not running AAE, you will want to do a manual repair on that partition, in order to ensure you have adequate replication: https://docs.riak.com/riak/kv/2.2.3/using/repair-recovery/repairs.1.html#repairing-partitions > On Sep 4, 2019, at 5:19 AM, Bryan Hunt > wrote: >

Re: File corruption after power cut

2019-09-04 Thread Guido Medina
Bryan* (misspelled your name), need a morning coffee :( On 04/09/2019 10:29, Guido Medina wrote: Thanks a lot Brian, I have deleted such directory and now the node started, let's see how it behaves. Guido. On 04/09/2019 10:19, Bryan Hunt wrote: Easiest solution is to just delete the vnode - a

Re: File corruption after power cut

2019-09-04 Thread Guido Medina
Thanks a lot Brian, I have deleted such directory and now the node started, let's see how it behaves. Guido. On 04/09/2019 10:19, Bryan Hunt wrote: Easiest solution is to just delete the vnode - and let it recover from replicas - vnode directory will be 844930634081928249586505293914101120738

Re: File corruption after power cut

2019-09-04 Thread Bryan Hunt
Easiest solution is to just delete the vnode - and let it recover from replicas - vnode directory will be 844930634081928249586505293914101120738586001408 > On 4 Sep 2019, at 10:01, Guido Medina wrote: > > Hi all, > > We had a power cut which caused one of the nodes to corrupt one of the >

Re: ANN: Riak 2.9.0 Urgent Patches Pending

2019-08-22 Thread DeadZen
We all appreciate it, and erring on the side of caution. Thank you. On Thu, Aug 22, 2019 at 12:22 PM Martin Sumner wrote: > Follow-up on this announcement. After further work today, it looks like > the initial diagnosis of the Issue 1707 was incorrect, and that the defect > does not obviously

Re: ANN: Riak 2.9.0 Urgent Patches Pending

2019-08-22 Thread Martin Sumner
Follow-up on this announcement. After further work today, it looks like the initial diagnosis of the Issue 1707 was incorrect, and that the defect does not obviously present a significant risk of data loss. Work will continue on providing an updated patch to Riak 2.9.0 - but there should be no im

Re: Riak 2.9.0 - Update Available

2019-08-09 Thread Martin Sumner
There is now a third update available for 2.9.0: https://github.com/basho/riak/tree/riak-2.9.0p3. Again, the fixes are related to memory management in leveled, and specifically related to references to sub-binaries. This main issue was related to a lazy-load of file metadata which occurs followin

Re: Riak 2.9.0 - Update Available

2019-06-28 Thread Martin Sumner
Russell, WRT naming. As we'd already announced at CodeBEAM that 2.9.1 was pending in September and would be adding some extra functionality (the automated repl replacement), I didn't want to call the patched versions of 2.9.0 by that name, as that might cause confusion. The whole choosing 2.9 th

Re: riak-users Digest, Vol 118, Issue 1

2019-06-28 Thread Tom Santero
with subject or body 'help' to > >riak-users-requ...@lists.basho.com > > > > You can reach the person managing the list at > >riak-users-ow...@lists.basho.com > > > > When replying, please edit your Subject line so it is more specific >

Re: riak-users Digest, Vol 118, Issue 1

2019-06-28 Thread Ben Stineman
mailman/listinfo/riak-users_lists.basho.com > or, via email, send a message with subject or body 'help' to >riak-users-requ...@lists.basho.com > > You can reach the person managing the list at >riak-users-ow...@lists.basho.com > > When replying, please edit your Subject line

Re: Riak 2.9.0 - Update Available

2019-06-28 Thread Bryan Hunt
Top quality spelunking - always fun to read - thanks Martin ! > On 28 Jun 2019, at 10:24, Martin Sumner wrote: > > Bryan, > > We saw that Riak was using much more memory than was expected at the end of > the handoffs. Using `riak-admin top` we could see that this wasn't process > memory, but

Re: Riak 2.9.0 - Update Available

2019-06-28 Thread Russell Brown via riak-users
Good job on finding and fixing so fast. I have to ask. What's with the naming scheme? Why not 2.9.2 instead of 2.9.0p2? Cheers Russell On 28/06/2019 10:24, Martin Sumner wrote: Bryan, We saw that Riak was using much more memory than was expected at the end of the handoffs.  Using `riak-ad

Re: Riak 2.9.0 - Update Available

2019-06-28 Thread Martin Sumner
Bryan, We saw that Riak was using much more memory than was expected at the end of the handoffs. Using `riak-admin top` we could see that this wasn't process memory, but binaries. Firstly did some work via attach looping over processes and running GC to confirm that this wasn't a failure to coll

Re: Riak 2.9.0 - Update Available

2019-06-28 Thread Martin Sumner
There is now a second update available for 2.9.0: https://github.com/basho/riak/tree/riak-2.9.0p2. This patch, like the patch before, resolves a memory management issue in leveled, which this time could be triggered by sending many large objects in a short period of time. The underlying problem i

Re: Riak KV 2.9.0 released at Code BEAM STO 2019

2019-05-17 Thread Tom Santero
Fantastic news! Nice work, everyone. Two questions: 1. Why the version jump all the way to 2.9? Is it because it's closer to 3.0? :) 2. Any update on getting off of R16B02? Is there an ETA to get to OTP 20+? On Fri, May 17, 2019 at 11:05 AM Nicholas Adams wrote: > Dear All, > > I am extremely

Re: Riak KV 2.9.0 released at Code BEAM STO 2019

2019-05-17 Thread DeadZen
w00t! You guys rock On Fri, May 17, 2019 at 12:27 PM Russell Brown via riak-users < riak-users@lists.basho.com> wrote: > Congratulations all! Great news! > > On 17/05/2019 16:04, Nicholas Adams wrote: > > > > Dear All, > > > > I am extremely pleased to announce with Martin Sumner at Code BEAM STO

Re: Riak KV 2.9.0 released at Code BEAM STO 2019

2019-05-17 Thread Russell Brown via riak-users
Congratulations all! Great news! On 17/05/2019 16:04, Nicholas Adams wrote: Dear All, I am extremely pleased to announce with Martin Sumner at Code BEAM STO 2019 that Riak KV 2.9.0 has officially been released! GitHub https://github.com/basho/riak/tree/riak-2.9.0 Packages https://files.t

RE: mounting leveldb with noatime problem

2019-04-26 Thread Nicholas Adams
Hi Farhad, Try this https://www.tiot.jp/riak-docs/riak/kv/2.2.1/using/performance/#mounts for a sample command. Alternately, if you are looking to set it permanently via fstab, look at https://www.tiot.jp/riak-docs/riak/kv/2.0.9/setup/planning/backend/bitcask/#tips-tricks It’s for Bitcask but t

RE: Having trouble setting up riak-cs using s3cmd to test

2019-04-23 Thread Nicholas Adams
Hi Greg, I’m guessing that something isn’t running. Try the following (without the back checks) and see if you get “pong” for each one: `riak ping` `riak-cs ping` `stanchion ping` You may or may not need `sudo` to execute the above depending on the user you are using. Incidentally, your s3cfg f

Re: riak 2.2.3, allow_mult=false but still siblings

2019-04-15 Thread Russell Brown via riak-users
That's actually very useful, I hope you are OK if that I re-add back in the list so that this thread can be indexed/used in future. On 15/04/2019 15:14, ジョハンガル wrote: After -X DELETE types/???/buckets/???/props the properties reverted to the bucket type properties! ​ Thank you

Re: riak 2.2.3, allow_mult=false but still siblings

2019-04-12 Thread Russell Brown via riak-users
Can you let us see the bucket type definition, please? Can you show me the headers from the curl command that returns siblings, please? I want to say that what you are seeing is unpossible (from what I remember of the code.) But I don't remember the 2.2.3 release process, and I'd like to s

RE: [ANN] Riak 2.9.0 - Release Candidate 7 Available

2019-04-02 Thread Nicholas Adams
Dear All, Just following on from Martin to say that package builds are available from https://files.tiot.jp/riak/kv/2.9/2.9.0rc7/ Please test well and report any issues on GitHub. Best regards, Nicholas From: riak-users On Behalf Of Martin Sumner Sent: 03 April 2019 04:13 To: riak-users@lists.

RE: [ANN] Riak 2.9.0 - Release Candidate 6 Available

2019-03-18 Thread Nicholas Adams
Dear All, Just a brief update to say that rc6 packages are available for most of the usual operating systems at https://files.tiot.jp/riak/kv/2.9/2.9.0rc6/ I will restate that all the usual caveats apply. This is a release candidate intended for testing and non-production environments only. Plea

Re: [ANN] Riak 2.9.0 - Release Candidate 5 Available

2019-03-14 Thread Bryan Hunt
Riak running without a trace of leveldb would be a truly wonderful thing - it's one of things that got me most excited about leveled in the first place. I have access to some Power 9 servers - but porting leveldb is not on my roadmap. > On 14 Mar 2019, at 10:55, Martin Sumner wrote: > I have

Re: [ANN] Riak 2.9.0 - Release Candidate 2 Available

2019-03-12 Thread Zsolt Laky
Dear All, Does anyone have experience on building RIAK on Power9 architecture? We want to have 2.2.6 built but it fails at compiling leveldb. I will appreciate a pointer to get in touch with. Thanks in advance and kind regards, Zsolt ___ riak-users

RE: [ANN] Riak 2.9.0 - Release Candidate 5 Available

2019-03-05 Thread Nicholas Adams
Dear All, Just following up to say that initial rc5 package builds for Rhel/CentOS 6/7 and Ubuntu Bionic are now available from https://files.tiot.jp/riak/kv/2.9/2.9.0rc5/ Packages for other operating systems will be available at the same link by the end of the week. Best regards, Nicholas Fr

RE: Leveled and auto-expiry (ジョハンガル)

2019-02-28 Thread Martin Sumner
Johan, Leveled does have TTL support for objects, but this is not added yet into riak_kv. I've raised an issue to look at this - https://github.com/basho/riak_kv/issues/1684. As mentioned in the issue, there is some thinking required first to make sure that expiry works well with anti-entropy.

Re: Wants/Choose claim functions

2019-02-19 Thread Guido Medina
Hi Luke, That old e-mail is what I was looking for, many thanks !!! I had already found the FAQ Guido. On 19/02/2019 14:35, Luke Bakken wrote: Hi Guido, Searching google for "riak wants_claim_fun" turns up this document. Please see the section "Q: A node left the cluster before handing off al

Re: Wants/Choose claim functions

2019-02-19 Thread Luke Bakken
Hi Guido, Searching google for "riak wants_claim_fun" turns up this document. Please see the section "Q: A node left the cluster before handing off all data. How can I resolve this?" https://docs.basho.com/riak/kv/2.2.3/developing/faq/ This may be helpful as well - http://lists.basho.com/piperm

RE: [ANN] Riak 2.9.0 - Release Candidate 2 Available

2019-02-15 Thread Nicholas Adams
Dear All, Just a follow up to Martin’s email to say that packages are now available at https://files.tiot.jp/riak/kv/2.9/2.9.0rc2/ and that more will be coming soon. Please be reminded that this is a release candidate and is probably not suitable for use in production. However, please use or abu

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-04 Thread Bryan Hunt
under the assumption that he had no additional >> resources to play with. >> >> Nicholas >> >> From: riak-users >> <mailto:riak-users-boun...@lists.basho.com> On Behalf Of Fred Dushin >> Sent: 01 February 2019 22:47 >> To: riak-users@lists.basho.com &l

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Guido Medina
ption that he had no additional resources to play with. Nicholas *From:* riak-users *On Behalf Of *Fred Dushin *Sent:* 01 February 2019 22:47 *To:* riak-users@lists.basho.com *Subject:* Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available Wouldn't it be better to do a `riak-admin

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Fred Dushin
o additional > resources to play with. > > Nicholas > > From: riak-users On Behalf Of Fred Dushin > Sent: 01 February 2019 22:47 > To: riak-users@lists.basho.com > Subject: Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available > > Wouldn't it be better to do a `riak

RE: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Nicholas Adams
If he has an extra node he can add then a replace would be much better. I provided this example under the assumption that he had no additional resources to play with. Nicholas From: riak-users On Behalf Of Fred Dushin Sent: 01 February 2019 22:47 To: riak-users@lists.basho.com Subject: Re

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Fred Dushin
Hunt > Sent: 01 February 2019 19:22 > To: Guido Medina > Cc: riak-users@lists.basho.com > Subject: Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available > > Replication would be the optimum solution - in theory anything can be > implemented - but it would be enormously painful in

RE: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Nicholas Adams
process. Best regards, Nicholas From: riak-users On Behalf Of Bryan Hunt Sent: 01 February 2019 19:22 To: Guido Medina Cc: riak-users@lists.basho.com Subject: Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available Replication would be the optimum solution - in theory anything can be implemented

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Bryan Hunt
the node-worker_pool. >> - AAE folds which allow for both cluster-wide AAE queries (e.g. produce a >> merkle tree representing all or a partial range of the cluster data), and >> administrative queries (e.g. discovering object sizes and sibling counts >> within the databa

Re: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-02-01 Thread Guido Medina
data), and administrative queries (e.g. discovering object sizes and sibling counts within the database depending on bucket name, key range and last modified date).  AAE folds depend on the Tictac AAE feature being activated. - An interface to request re-replication of an object (where

RE: [ANN] Riak 2.9.0 - Release Candidate 1 Available

2019-01-30 Thread Nicholas Adams
database depending on bucket name, key range and last modified date). AAE folds depend on the Tictac AAE feature being activated. - An interface to request re-replication of an object (where variances between clusters have been discovered). Further details of the release, and the release plan in

Re: Looking for the official repository for riak packages

2019-01-17 Thread Henning Verbeek
Thanks, that helps me! Cheers, hank On Fri, Jan 11, 2019, 14:10 Nicholas Adams Hi Hank, > We are looking into bringing new packages onto packagecloud but when this > will become available is not confirmed. In the meantime, TI Tokyo will > continue to make new packages available on https://files.

Re: Looking for the official repository for riak packages

2019-01-14 Thread Steve Roberts
Hi Hank TI Tokyo has packages for most distributions. There are also Riak CentOS packages (and the Erlang environment packages) available at: https://www.erlang-solutions.com/resources/download.html Steve On 11/01/19 13:10, Nicholas Adams wrote: Hi Hank, We are looking into bringing new pac

RE: Looking for the official repository for riak packages

2019-01-11 Thread Nicholas Adams
Hi Hank, We are looking into bringing new packages onto packagecloud but when this will become available is not confirmed. In the meantime, TI Tokyo will continue to make new packages available on https://files.tiot.jp/riak/ . There are plans underway to make everything a little more transparent

Re: High disk usage on node

2018-11-02 Thread István
Hi, 64 is a bit low, I guess 128 would be better to avoid such situation. I. On Thu, Nov 1, 2018 at 2:26 PM Travis Kirstine < tkirst...@firstbasesolutions.com> wrote: > I’m running riak (v2.14) in a 5 node cluster and for some reason one of > the nodes has higher disk usage than the other nodes

RE: High disk usage on node

2018-11-01 Thread Travis Kirstine
offline, if riak attempts to redistribute the partitions all nodes would fill and it would be a nightmare! Thanks From: riak-users [mailto:riak-users-boun...@lists.basho.com] On Behalf Of Fred Dushin Sent: Thursday, November 01, 2018 10:30 AM To: riak-users@lists.basho.com Subject: Re: High

Re: High disk usage on node

2018-11-01 Thread Fred Dushin
I think your best bet is to do a force-replace (and then a manual repair, if you are not using AAE) with a node that has higher capacity than your current standby. You are correct that replacing with your standby will fail when you run repairs and end up running out of space. I think you do NO

RE: High disk usage on node

2018-11-01 Thread Nicholas Adams
Hi Travis, I see you have encountered the disk space pickle. Just for the record, the safest way to run Riak in production is to keep all resources (CPU, RAM, Network, Disk Space, I/O etc.) below 70% utilization on all nodes at all times. The reason behind this is to compensate for when one or m

RE: RIAK Manchester Workshop

2018-10-03 Thread Martin Sumner
Andrew, It would be good at the Manchester workshop to talk about some of the work we've been doing for the next release. - A short reminder of the bugs and fixes that made it into 2.2.5 and 2.2.6; - Report on the testing and production-readiness of leveled - Quviq's work on property-based testin

Re: Node Recovery Questions

2018-09-14 Thread sean mcevoy
Hi Martin, List, Just an update to let ye know how things went and what we learned. We did the force-replace procedure to bring the new node into the cluster in place of the old one. I attached to the riak erlang shell and with a little hacking was able to get all the bitcask handles and then do

Re: Node Recovery Questions

2018-08-09 Thread sean mcevoy
Hi Martin, Thanks for taking the time. Yes, by "size of the bitcask directory" I mean I did a "du -h --max-depth=1 bitcask", so I think that would cover all the vnodes. We don't use any other backends. Those answers are helpful, will get back to this in a few days and see what I can determine about

Re: Node Recovery Questions

2018-08-08 Thread Martin Sumner
Based on a quick read of the code, compaction in bitcask is performed only on "readable" files, and the current active file for writing is excluded from that list. With default settings, that active file can grow to 2GB. So it is possible that if objects had been replaced/deleted many times within

RE: Node Recovery Questions

2018-08-08 Thread Martin Sumner
Sean, Some partial answers to your questions. I don't believe force-replace itself will sync anything up - it just reassigns ownership (hence handoff happens very quickly). Read repair would synchronise a portion of the data. So if 10% of you data is read regularly, this might explain some of w

Re: Failed to start riak_kv_multi_backend

2018-07-12 Thread Bryan Hunt
Amol, Although a repair tool exists for eleveldb the simplest solutions is to simply delete the corrupted partition and run a repair job. 1. Stop the node 2. Locate the directory you have configured for eleveldb data storage and delete the subdirectory 4795552247492025200355840857350303658246

Re: rolling upgrades riak kv OSS 2.14 to 2.2.3

2018-07-09 Thread Fred Dushin
There are some changes to the format of AAE tree data, if you have AAE enabled. IIRC, AAE tree upgrades will not kick in until all nodes in the cluster are upgraded to 2.2 or later, but they will kick in automatically, once full upgrade is detected. You can disable the new AAE format, but this

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Russell Brown
> On 1 Jun 2018, at 10:07, Guido Medina wrote: > > The last command should have been like the following: > • {ok, Ring} = riak_core_ring_manager:get_my_ring(). > • Partitions = [P || {P, 'r...@node4.domain.com'} <- > riak_core_ring:all_owners(Ring)]. > • [riak_kv_vnode:repair(

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Guido Medina
The last command should have been like the following: * {ok, Ring} = riak_core_ring_manager:get_my_ring(). * Partitions = [P || {P, 'r...@node4.domain.com'} <- riak_core_ring:all_owners(Ring)]. * *[riak_kv_vnode:repair(P) || P <- Partitions].* My bad, I think I copied the command from the

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Guido Medina
What did I copied and pasted, sorry about that, it must be that it is Friday or something...my apologies. On 01/06/18 09:37, Russell Brown wrote: I don’t see a call to `riak_search_vnode:repair` in those docs Do you still run legacy riak search (i.e. not yokozuna/solr)? On 1 Jun 2018, at 09:

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Russell Brown
I don’t see a call to `riak_search_vnode:repair` in those docs Do you still run legacy riak search (i.e. not yokozuna/solr)? > On 1 Jun 2018, at 09:35, Guido Medina wrote: > > Sorry, not repairing a single partition but all partitions per node: > https://docs.basho.com/riak/kv/2.2.3/using/repai

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Guido Medina
Sorry, not repairing a single partition but all partitions per node: https://docs.basho.com/riak/kv/2.2.3/using/repair-recovery/repairs/#repairing-all-partitions-on-a-node On 01/06/18 09:34, Guido Medina wrote: Hi Russell, I was repairing each node as specified in this guide https://docs.basho

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Guido Medina
Hi Russell, I was repairing each node as specified in this guide https://docs.basho.com/riak/kv/2.2.3/using/repair-recovery/repairs/#repairing-a-single-partition Guido. On 01/06/18 09:16, Russell Brown wrote: riak_search has been removed from riak-2.2.5. Looks like some vestige survived. Ca

RE: Partitions repair isn't working anymore?

2018-06-01 Thread Nicholas Adams
8 17:16 To: Guido Medina Cc: riak-users Subject: Re: Partitions repair isn't working anymore? riak_search has been removed from riak-2.2.5. Looks like some vestige survived. Can you tell me what command you ran, it looks to me from the output below that you’re connected to node and typing

Re: Partitions repair isn't working anymore?

2018-06-01 Thread Russell Brown
riak_search has been removed from riak-2.2.5. Looks like some vestige survived. Can you tell me what command you ran, it looks to me from the output below that you’re connected to node and typing commands in the console? Is this some snippet that you attach and run? Cheers Russell > On 1 Jun

RE: [ANN] Riak 2.2.6 release

2018-05-31 Thread Nicholas Adams
a tag `2.1.7-225` for riak_kv. I created a new tag with the same name. Thankfully all the build/release tools used the new tag, but there is still risk, and confusion, due to the duplicate tag on riak_kv. Our options were to delete both tags, and re-create the latter tag, which seemed wrong, or c

RE: Riak One partition handoff stall

2018-05-28 Thread Nicholas Adams
-users On Behalf Of Gaurav Sood Sent: 28 May 2018 22:11 To: Bryan Hunt Cc: riak-users@lists.basho.com Subject: Re: Riak One partition handoff stall Thanks Bryan Below is the ouput of command riak-admin vnode_status. May be data transfer has stopped on the claimant node. Output of all commands is

Re: Riak One partition handoff stall

2018-05-28 Thread Gaurav Sood
Thanks Bryan Below is the ouput of command riak-admin vnode_status. May be data transfer has stopped on the claimant node. Output of all commands is constant. 1) VNode: 342539446249430371453988632667878832731859189760 Backend: riak_kv_eleveldb_backend Status: [{stats,<<"

Re: Riak One partition handoff stall

2018-05-28 Thread Bryan Hunt
Are you constantly executing a particular riak command, in your system monitoring scripts, for example: `riak-admin vnode-status` ? What size is your data per server ? How many objects are you storing ? --- Erlang Solutions cares about your data and privacy; please find all details about th

RE: RIAK repl enhancements

2018-05-24 Thread Andrew.Deane
) Limited andrew.de...@bet365.com bet365.com From: Bryan Hunt [mailto:bryan.h...@erlang-solutions.com] Sent: 23 May 2018 13:39 To: Andrew Deane Cc: riak-users@lists.basho.com Subject: Re: RIAK repl enhancements Andrew, Your proposed changes sound like very well considered and welcome

Re: RIAK repl enhancements

2018-05-23 Thread Bryan Hunt
Andrew, Your proposed changes sound like very well considered and welcome improvements. What is going to be the strategy for merging? Do you intend to publish to feature branches and make pull requests main development branches with community review? Are the changes going to be targeted at

RE: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Nicholas Adams
partitions that register less than 3 copies. Best regards, Nicholas From: riak-users On Behalf Of Guido Medina Sent: 18 May 2018 22:52 To: riak-users Subject: Re: N = 3 and RW = 2 not finding some keys Yes, but we haven't set back R = 2, we are currently with R = 3 until we resolve the issue. I

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Guido Medina
Yes, but we haven't set back R = 2, we are currently with R = 3 until we resolve the issue. I'm in the middle of writing something that will read every single key for the cluster using our relation DB IDs (each key has a counterpart on DB) I'm guessing that 2i streaming won't help? we need to m

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Bryan Hunt
Russell, Good question. I’m guessing they are iterating, and requesting a different object for each request? Guido, given the behaviour you initially described, before applying the configuration I suggested - did you receive a successful response upon subsequent requests for the same object ?

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Guido Medina
A force replace done wrong causing some partitions to only have one copy. And the cluster running extremely slow have forced us to disable AAE for now. Guido. On 18/05/18 13:13, Russell Brown wrote: But why isn’t read repair “working”? On 18 May 2018, at 11:07, Bryan Hunt wrote: Of course

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Russell Brown
But why isn’t read repair “working”? > On 18 May 2018, at 11:07, Bryan Hunt wrote: > > Of course, AAE will eventually repair the missing object replicas but it > seems like you need something more immediate. > >> On 18 May 2018, at 11:00, Bryan Hunt wrote: >> >> Hi Guido, >> >> You should

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Bryan Hunt
Of course, AAE will eventually repair the missing object replicas but it seems like you need something more immediate. > On 18 May 2018, at 11:00, Bryan Hunt wrote: > > Hi Guido, > > You should attempt to change the bucket property ‘notfound_ok’ from the > default of ‘true' to ‘false'. > >

Re: N = 3 and RW = 2 not finding some keys

2018-05-18 Thread Bryan Hunt
Hi Guido, You should attempt to change the bucket property ‘notfound_ok’ from the default of ‘true' to ‘false'. I.e curl -XPUT 127.0.0.1:10018/buckets/foo/props -H "Content-Type: application/json" -d '{"props":{"notfound_ok": false}}' This makes GET operations for non-existent keys slower a

RE: Riak CS Backup Solutions

2018-04-29 Thread Nicholas Adams
ate to another cluster. 3. Create something yourself to work at the application level that would mirror all commands. Hope this helps, Nicholas From: riak-users On Behalf Of Bryan Hunt Sent: 25 April 2018 22:50 To: riak-users Subject: Re: Riak CS Backup Solutions Anthony, Your snapshot solution is

RE: [ANN] Riak 2.2.5 release

2018-04-26 Thread Nicholas Adams
Dear All, Just a follow up to Russell's email to say the initial builds of Riak KV 2.2.5 by TI Tokyo are now available at https://files.tiot.jp/riak/kv/2.2/2.2.5/ The same machines that built 2.2.5rc2 were used to build 2.2.5 so if rc2 worked for you, this should too. As always, please offer fe

Re: Riak CS Backup Solutions

2018-04-25 Thread Bryan Hunt
you wanted to do something more sophisticated, you could try : 1. Re-building your cluster using the soon to be released Riak 2.2.5. 2. Replicate off site to a physically remote location 3. More regularly perform snapshots there (as they won’t impact latencies on your main Riak CS cluster) Does

Re: Riak-2.2.5 progress update

2018-04-17 Thread Damien Krotkine
sell Brown > Sent: 10 April 2018 18:53 > To: Bryan Hunt > Cc: Damien Krotkine ; riak-users us...@lists.basho.com> > Subject: Re: Riak-2.2.5 progress update > > More update. > > There were some minor changes that missed the rc1, so we added them > > * yokoz

RE: Riak-2.2.5 progress update

2018-04-11 Thread Nicholas Adams
and please share your feedback. Best regards, Nicholas -Original Message- From: riak-users On Behalf Of Russell Brown Sent: 10 April 2018 18:53 To: Bryan Hunt Cc: Damien Krotkine ; riak-users Subject: Re: Riak-2.2.5 progress update More update. There were some minor changes that

Re: Riak-2.2.5 progress update

2018-04-10 Thread Russell Brown
More update. There were some minor changes that missed the rc1, so we added them * yokozuna/746: [remove -XX:+UseStringCache](https://github.com/basho/yokozuna/pull/746) * yokozuna/747: [Remove jvm directive from test too](https://github.com/basho/yokozuna/pull/747) * riak_repl/782: [Change ETS

Re: Riak-2.2.5 progress update

2018-03-29 Thread Bryan Hunt
From our side, it’s bank holiday weekend now, so we shall start building packages on Monday/Tuesday and share them out via package cloud. Will keep you updated. B > On 29 Mar 2018, at 16:15, Russell Brown wrote: > > ___ riak-users mailing list ria

Re: Riak-2.2.5 progress update

2018-03-29 Thread Russell Brown
C and share results >> when completed - probably in the following week. >> >> Cheers >> >> From: riak-users [riak-users-boun...@lists.basho.com] on behalf of >> Russell Brown [russell.br...@icloud.com] >> Sent: 27 March 2018 19

Re: Riak-2.2.5 progress update

2018-03-29 Thread Damien Krotkine
the following week. > > Cheers > > From: riak-users [riak-users-boun...@lists.basho.com] on behalf of > Russell Brown [russell.br...@icloud.com] > Sent: 27 March 2018 19:04 > To: Fred Dushin > Cc: riak-users > Subject: Re: Riak-2.2.5 progress update > > Hey

Re: Riak-2.2.5 progress update

2018-03-27 Thread Russell Brown
Hey Fred, I can probably share my configs, yes. I have 4 configs! current is riak-2.2.5, the develop-2.2 branch of basho/riak for all configs previous is either riak-2.2.3 or riak-2.0.5 (and I have 4 configs as there has to be an EE config, for the repl upgrade tests, since riak-2.2.3 didn’t hav

Re: Riak-2.2.5 progress update

2018-03-27 Thread Fred Dushin
@russeldb do you have ordained values for `current`, `previous`, and `legacy` to test against? Always the :bane: of riak_test -Fred > On Mar 27, 2018, at 1:47 PM, Russell Brown wrote: > > Giddyup died when basho was shuttered. These test runs have all been on > private infrastructure that do

Re: Riak-2.2.5 progress update

2018-03-27 Thread Russell Brown
Giddyup died when basho was shuttered. These test runs have all been on private infrastructure that doesn’t have a public facing interface. I guess I could probably cut and paste logs into a gist for you. But I’d have to take the time to sanitize them, just in case. I’d rather not take that time

Re: Riak-2.2.5 progress update

2018-03-27 Thread Bryan Hunt
Could you share URL for those outstanding failures please. B > On 27 Mar 2018, at 16:37, Russell Brown wrote: > > Hi Again, > > More progress update. All the PRs are merged (thanks Bryan Hunt (ESL) > and Nick/Martin (bet365)). > > I’m planning on tagging Riak with riak-2.2.5RC1 this week. > >

Re: Riak-2.2.5 progress update

2018-03-27 Thread Russell Brown
Hi Again, More progress update. All the PRs are merged (thanks Bryan Hunt (ESL) and Nick/Martin (bet365)). I’m planning on tagging Riak with riak-2.2.5RC1 this week. We haven’t been able to run load tests. I’m not 100% sure that all basho’s releases had extensive load tests run, though I know th

Re: OTP20+ and rebar3 for Riak 3.0

2018-02-05 Thread DeadZen
et it sent out. > > Thanks > > Martin > > From: riak-users [riak-users-boun...@lists.basho.com] on behalf of > martin@bet365.com [martin@bet365.com] > Sent: 01 February 2018 11:57 > To: russell.br...@mac.com; riak-users@lists.basho.com > Subject: RE: OTP20+ a

Re: Meetup at ESL offices riak_core vs partisan

2018-01-16 Thread Bryan Hunt
It will be - the talks are posted under Erlang Solutions channel on YouTube - I’ll post the link afterward. Bryan > On 16 Jan 2018, at 15:55, Nick Marino wrote: > > That sounds like a great talk, any chance of it being videoed and p

Re: K8n Riak statefulset ?

2017-12-15 Thread Bryan Hunt
Excellent. Thank you so much Deepthi. > On 15 Dec 2017, at 12:50, Deepthi Devaki wrote: > > We have done a test deployment of Antidote on AWS with kubernetes. Here is > the setup https://github.com/deepthidevaki/antidote-aws > . > > On Fri, Dec

Re: K8n Riak statefulset ?

2017-12-15 Thread Bryan Hunt
Thanks Chris. Much appreciated ! > On 14 Dec 2017, at 21:57, Christopher Meiklejohn > wrote: > > I believe the Antidote folks (Riak Core application) have. I can forward > this message on to them. > > On Thu, Dec 14, 2017, 22:38 Bryan Hunt > wrote: > Anyone

Re: WARNING: Not all replicas will be on distinct nodes

2017-12-14 Thread Martin Sumner
The error is through whenever >> the cluster cannot guarantee a "target_n_val" of 4. So if you have an >> n_val of 3 - you're not necessarily at risk of data loss.To know you >> will have to look at your ring via riak attach (see bullet point 2 in >> http

Re: WARNING: Not all replicas will be on distinct nodes

2017-12-14 Thread Daniel Miller
arily at risk of data loss.To know you > will have to look at your ring via riak attach (see bullet point 2 in > http://docs.basho.com/riak/kv/2.2.3/using/running-a-clust > er/#add-a-second-node-to-your-cluster). > > If you can figure out the violations from your ring, you may b

Re: K8n Riak statefulset ?

2017-12-14 Thread Christopher Meiklejohn
I believe the Antidote folks (Riak Core application) have. I can forward this message on to them. On Thu, Dec 14, 2017, 22:38 Bryan Hunt wrote: > Anyone done any work with Riak and k8n statefulset ? I see people already > doing stuff with rabbitmq HA > https://kubernetes.io/docs/concepts/worklo

Re: WARNING: Not all replicas will be on distinct nodes

2017-12-14 Thread Martin Sumner
luster/#add-a-second-node-to-your-cluster). If you can figure out the violations from your ring, you may be able to resolve by leaving the node that has the violations, and then re-adding it. Sorry, I'm a bit rushed - but I hope this helps get you started. Martin On 14 December 2017 at 19

Re: riak_repl integration

2017-12-05 Thread Bryan Hunt
> From: Bryan Hunt [mailto:bryan.h...@erlang-solutions.com] > Sent: Tuesday, December 05, 2017 12:59 PM > To: Raghavendra Sayana > Cc: Dan Sweeney ; riak-users > > Subject: Re: riak_repl integration > > Raghu, > > What bistro are you running? > >

  1   2   3   4   5   6   7   8   9   10   >