Re: Seeking Backup solution for live nodes

Here are notes on the new hot backup: https://github.com/basho/leveldb/wiki/mv-hot-backup This sound like what you need? Matthew Sent from my iPad > On Sep 26, 2016, at 5:39 AM, Niels Christian Sorensen > wrote: > > Hi, > > We use Riak-kv Enterprise Edition as base for Riak CS to store fil

Re: Using cursorMark with '_yz_rk'

Okay, I probably spoke too soon. While Solr 4.7 supports cursor marks, we do have an issue in Riak (or Yokozuna) whereby it is actually impractical to use cursor marks for query. The problem is that while Yokozuna uses coverage plans generate a filter query that will guarantee that we get no r

Re: Solr search performance

Hi Fred, Thanks for the pointer! 'cursorMark' is a lot more performant alright, though apparently it doesn't suit our use case. I've written a loop function using OTP's httpc that reads each page, gets the cursorMark and repeats, and it returns all 147 pages with consistent times in the 40-60ms b

Re: Using cursorMark with '_yz_rk'

I'm very curious of your cursorMark implementation, I'm in deep need of that feature. From my experience I wasn't even able to trigger a query with my riak version as it was not yet supported by the Solr bundled with it. But I might missed a point with that. I'm using 2.1.2. Guillaume On 2

Re: Joining node answers to requests

Well, I guess that's on me. Solr is unable to create my index due to an extension I'm using, thus Riak-4 don't know a working index for the bucket-type. Guillaume On 20/09/2016 14:48, Guillaume Boddaert wrote: Hi, I'm currently adding two new node to my production. Yet, they seems to answer

Re: Solr search performance

All great questions, Sean. A few things. First off, for result sets that are that large, you are probably going to want to use Solr cursor marks [1], which are supported in the current version of Solr we ship. Riak allows queries using cursor marks through the HTTP interface. At present, it

Re: app.config missing?

Nope, app.config is actually generated by riak.conf, through an obscure process known as cuttlefishing ;p On Mon, Sep 19, 2016 at 3:44 AM, Alex De la rosa wrote: > Ok, documentation was confusing, i thought i had to add the data in both > riak.conf and app.config > > Thanks, > Alex > > On Mon, Se

Re: app.config missing?

Ok, documentation was confusing, i thought i had to add the data in both riak.conf and app.config Thanks, Alex On Mon, Sep 19, 2016 at 11:42 AM, Magnus Kessler wrote: > On 18 September 2016 at 07:51, Alex De la rosa > wrote: > >> Hi there, >> >> I'm trying to locate the app.config file in Riak

Re: app.config missing?

On 18 September 2016 at 07:51, Alex De la rosa wrote: > Hi there, > > I'm trying to locate the app.config file in Riak 2.1.4-1 to add the > following: > > { kernel, [ > {inet_dist_listen_min, 6000}, > {inet_dist_listen_max, 7999} > ]}, > > as explained at http://

Re: Riak cluster protected by firewall

Looks right, jmx not imx ;), and yes provided the erlang kernel options are given to limit dist comm range to 6000-7999 you can check this from the node (to make sure) with: > [ application:get_env(kernel, X) || X <- > [inet_dist_listen_min,inet_dist_listen_max] ]. [{ok,6000},{ok,7999}] On Sun,

Re: Riak cluster protected by firewall

So mainly the ports are: epmd listener: TCP:4369 handoff_port listener: TCP:8099 http: TCP:8098 protocol buffers: TCP: 8087 solr: TCP:8093 solr imx: TCP:8985 erlang range: TCP:6000~7999 (if configured in riak's configuration) Is that alright? am I missing any? or is there any of them that is not

Re: Riak cluster protected by firewall

You should find most of what you need here: http://docs.basho.com/riak/kv/2.1.4/using/security/ Sent from my iPhone On Sep 17, 2016, at 1:26 PM, Alex De la rosa wrote: Hi all, I have a cluster of 5 nodes connected to each other and now I want to use UFW to deny any external incoming traffic i

Re: Riak 2.1.3 - Multiple indexes created by Solr for the same Riak object

dently. So yes, it is >> possible to find several additional objects in Solr for each KV object. >> When querying Solr through Riak/Yokozuna, the internal queries are >> structured in a way that only one replica is returned. Quering Solr nodes >> directly will typically lack t

RE: RIAK TS installed nodes not connecting

spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:219) ... Thanks for the help! Kind Regards, Joris van Agtmaal +(0) 6 25 39 39 06 From: Stephen Etheridge [mailto:setheri...@basho.com] Sent: 13 September 2016 14:45 To: Agtmaal, Joris van Cc: riak-users@lists.basho.

RE: RIAK TS installed nodes not connecting

patience with my rookie mistakes. ;-) Kind Regards, Joris van Agtmaal +(0) 6 25 39 39 06 From: Alex Moore [mailto:amo...@basho.com] Sent: 13 September 2016 15:35 To: Stephen Etheridge Cc: Agtmaal, Joris van ; riak-users@lists.basho.com; Manu Marchal Subject: Re: RIAK TS installed nodes not

Re: RIAK TS installed nodes not connecting

Joris, One thing to check - since you are using a downloaded jar, are you using the Uber jar that contains all the dependencies? http://search.maven.org/remotecontent?filepath=com/basho/riak/spark-riak-connector_2.10/1.6.0/spark-riak-connector_2.10-1.6.0-uber.jar Thanks, Alex On Tue, Sep 13, 201

Re: RIAK TS installed nodes not connecting

Hi Joris, I have looked at the tutorial you have been following but I confess I am confused. In the example you are following I do not see where the spark and sql contexts are created. I use PySpark through the Jupyter notebook and I have to specify a path to the connector on invoking the jupyte

Re: Riak 2.1.3 - Multiple indexes created by Solr for the same Riak object

Solr nodes directly will typically lack these filters and may return more than one copy of an object. > > 2) Is there a way to tell Solr to re-index one single item and get rid of > all other indexes of that item? > You can perform a GET/PUT cycle through Riak KV on an object. This will

Re: Riak KV memory backend did't discarding oldest objects when met max memory

Dear friends, Any idea about this? Best Regards & Thanks John 2016-09-01 11:58 GMT+08:00 周磊 : > Dear Friends, > I'm sorry to disturb you, could you help on this? > > ENV > > OS: CenterOS 6.5 > Riak KV:2.1.4 > Installed by: > > wget http://s3.amazonaws.com/downloads.basho.com/riak/2.1/ > 2.1.4/

Re: Riak 2.1.3 - Multiple indexes created by Solr for the same Riak object

an running .update on that object. > > I have basically 2 questions: > > 1) Is what I'm describing something that is possible? > > 2) Is there a way to tell Solr to re-index one single item and get rid of all > other indexes of that item? > > Considering RiakTS

Re: a weird error while post request to server for store object

n > > -- 原始邮件 -- > *发件人:* "Luke Bakken";; > *发送时间:* 2016年9月7日(星期三) 晚上9:27 > *收件人:* "HQS^∞^"; > *抄送:* "riak-users"; > *主题:* Re: a weird error while post request to server for store object > > Hello Alan - > > Which PHP client

Re: Spaces in the search string

Hi Alexander, Unfortunately it didn't shake with any satisfaction. I'm sure there's an easy answer, and I hope I'll get back to search for it some day. But for now me & my pragmatic overlords have gone for a work-around solution that avoids the problem. //Sean. On Wed, Sep 7, 2016 at 2:06 PM, Ale

Re: Using Riak KV with Amazon ML

Hi Ricardo, Full bucket read is not supported yet by Riak KV. If you're able to upgrade, Riak TS does support that feature. Otherwise, with Riak KV, you could use a range of 2i indexes. See https://github.com/basho/spark-riak-connector/blob/master/docs/using-connector.md#reading-data-from-kv-buck

Re: a weird error while post request to server for store object

Hello Alan - Which PHP client library are you using? -- Luke Bakken Engineer lbak...@basho.com On Tue, Sep 6, 2016 at 10:29 PM, HQS^∞^ wrote: > dear everyone: > I follow the tutorial at > http://docs.basho.com/riak/kv/2.1.4/developing/usage/document-store/ , > Step by Step Practice ,

Re: Spaces in the search string

Hi Sean, Familiarize yourself with the default schema[0], if that is what you're using. Also check details around this specific type of search around the web[1]. Let us know how it shakes out, -Alexander [0] https://raw.githubusercontent.com/basho/yokozuna/develop/priv/default_schema.xml [1] htt

Re: Spaces in the search string

Hi again! Apologies for the premature post earlier. I thought I had a solution when I didn't get the error but when I got around to plugging it into my application it's still not doing everything that I need. I've narrowed it down to this minimal testcase, first setup the index & insert the data:

Re: Spaces in the search string

Hi Jason, Thanks for the kick, I just needed to look closer! Yes, had tried escaping but one of my utility functions for dynamically building the search string had been stripping it out again. D'oh! Curiously, just escaping the space doesn't work as in the example in the stackoverflow post. Putti

Re: speeding up bulk loading

AM *To:* Travis Kirstine *Cc:* Magnus Kessler ; riak-users@lists.basho.com *Subject:* Re: speeding up bulk loading Hi Travis, I also want to confirm that you are spreading your load amongst all nodes in the cluster. You should be connecting your C client to Riak via a proxy like nginx/HApro

RE: speeding up bulk loading

Thank Alexander, we’re using HAproxy From: Alexander Sicular [mailto:sicul...@basho.com] Sent: September-06-16 11:09 AM To: Travis Kirstine Cc: Magnus Kessler ; riak-users@lists.basho.com Subject: Re: speeding up bulk loading Hi Travis, I also want to confirm that you are spreading your load

Re: speeding up bulk loading

th reason: no function clause > matching webmachine_request:peer_from_peername({error,enotconn}, > {webmachine_request,{wm_reqstate,#Port<0.2817336>,[], > undefined,undefined,undefined,{wm_reqdata,'GET',...},...}}) line 150 > > > > Regards > > > > *Fr

Re: Spaces in the search string

Hi Sean, Have you tried escaping the space in your query? http://stackoverflow.com/questions/10023133/solr-wildcard-query-with-whitespace > On Sep 5, 2016, at 6:24 PM, sean mcevoy wrote: > > Hi List, > > We have a solr index where we store something like: > <<"{\"key_s\":\"ID\",\"body_s\":\"

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Kyle - Verify return code: 19 (self signed certificate in certificate chain) Since your server cert is self-signed, there's not much more that can be done at this point I believe. My security tests use a dedicated CA where the Root cert is available for validation (https://github.com/basho/riak-c

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

nt: None SRP username: None Start Time: 1472681389 Timeout : 300 (sec) Verify return code: 19 (self signed certificate in certificate chain) --- -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: Tuesday, August 30, 2016 2:21 PM To: Nguyen, Kyle Cc: Riak Us

Re: speeding up bulk loading

e 150 > > Regards > > From: Magnus Kessler [mailto:mkess...@basho.com <mailto:mkess...@basho.com>] > Sent: August-31-16 4:08 AM > To: Travis Kirstine <mailto:tkirst...@firstbasesolutions.com>> > Cc: riak-users@lists.basho.com <mailto:riak-users@lists.basho.com> &

RE: speeding up bulk loading

r [mailto:mkess...@basho.com] Sent: August-31-16 4:08 AM To: Travis Kirstine Cc: riak-users@lists.basho.com Subject: Re: speeding up bulk loading On 26 August 2016 at 22:20, Travis Kirstine mailto:tkirst...@firstbasesolutions.com>> wrote: Is there any way to speed up bulk loading? I wond

RE: Using Riak CS with Hadoop

thony Cc: riak-users@lists.basho.com Subject: Re: Using Riak CS with Hadoop Riak CS provides an S3 capable API, so theoretically it could work. Have you tried? If so and you're having issues, follow up here. -- Luke Bakken Engineer lbak...@basho.com On Wed, Aug 31, 2016 at 7:38 AM, Valent

Re: [ANN] Riak TS v1.4 is released

Hey Eric, Very cool. Thank you! From: riak-users on behalf of Eric Johnson Date: Monday, August 29, 2016 at 8:34 AM To: "riak-users@lists.basho.com" Subject: Re: [ANN] Riak TS v1.4 is released Hey Chris, thanks for the heads up. We’re looking into issues #2 and #4, but we went

Re: Using Riak CS with Hadoop

Riak CS provides an S3 capable API, so theoretically it could work. Have you tried? If so and you're having issues, follow up here. -- Luke Bakken Engineer lbak...@basho.com On Wed, Aug 31, 2016 at 7:38 AM, Valenti, Anthony wrote: > Has anyone setup Hadoop to be able use Raik CS as an S3 source/

Re: speeding up bulk loading

On 26 August 2016 at 22:20, Travis Kirstine < tkirst...@firstbasesolutions.com> wrote: > Is there any way to speed up bulk loading? I wondering if I should be > tweeking the erlang, aae or other config options? > > > > > Hi Travis, Excuse the late reply; your message had been stuck in the modera

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

asho.com] > Sent: Tuesday, August 30, 2016 2:14 PM > To: Nguyen, Kyle > Cc: Riak Users > Subject: Re: Need help with Riak-KV (2.1.4) certificate based authentication > using Java client > > Kyle, > > I would be interested to see the output of this command run on the sam

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Hi Luke, I am using TLS for protocol buffer - not sure if you're thinking of HTTP only. Thanks -Kyle- -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: Tuesday, August 30, 2016 2:14 PM To: Nguyen, Kyle Cc: Riak Users Subject: Re: Need help with Riak-KV (

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Kyle, I would be interested to see the output of this command run on the same server as your Riak node: openssl s_client -debug -connect localhost:8098 Please replace "8098" with the HTTPS port used in this configuration setting in your /etc/riak.conf file: listener.https.internal -- Luke Bakk

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

ilder().withRemoteAddress("127.0.0.1").withRemotePort(8087); builder.withAuth(username, password, trustStore, keyStore, keyPasswd); Thanks -Kyle- -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: Tuesday, August 30, 2016 7:14 AM To: Nguyen, Ky

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Kyle - The CN should be either the DNS-resolvable host name of the Riak node, or its IP address (without "riak@"). Then, the Java client should be configured to use that to connect to the node (either DNS or IP). Without doing that, I really don't have any idea how the Java client is validating th

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

e Bakken [mailto:lbak...@basho.com] Sent: Monday, August 29, 2016 2:20 PM To: Nguyen, Kyle Cc: Riak Users Subject: Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client Hi Kyle - Thanks for the info. Just so you know, setting check_clr = off means that Riak wi

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

> From: Luke Bakken [mailto:lbak...@basho.com] > Sent: Monday, August 29, 2016 7:59 AM > To: Nguyen, Kyle > Cc: Riak Users > Subject: Re: Need help with Riak-KV (2.1.4) certificate based authentication > using Java client > > Kyle - > > What is the output of these com

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

59 AM To: Nguyen, Kyle Cc: Riak Users Subject: Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client Kyle - What is the output of these commands? riak-admin security print-users riak-admin security print-sources http://docs.basho.com/riak/kv/2.1.4/using/security/b

Re: Riak search, post schema change reindexation

g need to occur across the entire cluster, or just on one node? What are the expectations about query-ability while re-indexing is going on? If you can afford to take a node out of commission for query, then one approach would be to delete your YZ data and YZ AAE trees, and let AAE sync your 30 mi

Re: [ANN] Riak TS v1.4 is released

Hey Chris, thanks for the heads up. We’re looking into issues #2 and #4, but we went ahead and fixed #1 and #3 here . Let us know if anything else comes up! On Fri, Aug 26, 2016 at 2:03 PM, wrote: > We ran this rolling upgrade yesterday and

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Kyle - What is the output of these commands? riak-admin security print-users riak-admin security print-sources http://docs.basho.com/riak/kv/2.1.4/using/security/basics/#user-management Please note that setting up certificate authentication *requires* that you have set up SSL / TLS in Riak as w

Re: Riak search, post schema change reindexation

Hi Guillame, A few questions. What version of Riak? Does the reindexing need to occur across the entire cluster, or just on one node? What are the expectations about query-ability while re-indexing is going on? If you can afford to take a node out of commission for query, then one approach

RE: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

PM To: Nguyen, Kyle Cc: Riak Users Subject: Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client Try adding the following Java property setting when launching your java client in order to see SSL Handshake related debug information: -Djavax.net.debug

Re: [ANN] Riak TS v1.4 is released

We ran this rolling upgrade yesterday and it seemed to mostly work! A couple problems we encountered: 1. The command under item 6 on this page http://docs.basho.com/riak/ts/1.4.0/setup/upgrading/ did not work for us. We had to replace “riak_ts” with “riak_kv”. 2. There were some tr

Re: Need help with Riak-KV (2.1.4) certificate based authentication using Java client

Try adding the following Java property setting when launching your java client in order to see SSL Handshake related debug information: -Djavax.net.debug=ssl:handshake Or to see all ssl related debug output: -Djavax.net.debug=ssl On Thu, Aug 25, 2016 at 4:24 PM, Nguyen, Kyle wrote: > Hi all

Re: Issues with the Go client

[DEBUG] [connectionManager] (127.0.0.1:26420) >> expiring connections at 2016-08-16 22:06:36.85518287 +0200 CEST >> 2016/08/16 22:06:36 [DEBUG] [connectionManager] (127.0.0.1:26420) >> expired 0 connections. >> 2016/08/16 22:06:36 [DEBUG] [DefaultNodeManager] executed 'Pi

Re: Issues with the Go client

26420) expired > 0 connections. > 2016/08/16 22:06:36 [DEBUG] [DefaultNodeManager] executed 'Ping-1' on node > '127.0.0.1:26420|0|0', err 'read tcp 127.0.0.1:49998->127.0.0.1:26420: > i/o timeout' > 2016/08/16 22:06:36 [DEBUG] [Cluster] executed cm

Re: Migrating to riak 2.1.4, selecting a specific multi-backend from the Java Client

Good morning Alex, On Tue, Aug 9, 2016 at 8:47 PM, Alex Moore wrote: >> >> Is this equivalent to specifying a bucket type? > > > Not exactly, that code will set the backend for that bucket, which is in the > default bucket type. > If you need to specify a bucket-type, it's just an extra parameter

Re: Migrating to riak 2.1.4, selecting a specific multi-backend from the Java Client

t; cluster. Each time a node is added or removed from the ring, the claim > algorithm will re-assign partitions to/from all nodes. Please consider > updating the existing nodes in place. Thanks. We anticipated that, and it's basically two ring changes (add all new nodes, remove all old

Re: Migrating to riak 2.1.4, selecting a specific multi-backend from the Java Client

ater removing the seven Riak KV 1.4 nodes from the ring. > For a few days, the cluster will consist of a mix. > Hi Henning, This plan will generate a lot of unnecessary data shuffling in the entire cluster. Each time a node is added or removed from the ring, the claim algorithm will re-assign

Re: Rick Time-Series and time to live, ttl

Anatoly, The first time series TTL feature is due in Riak TS 1.4. That release is looking good for late August. The 1.4 release establishes a global TTL (also known as expiry policy) for all data. A future release will allow individual policies per Riak TS table (yeah, I am coding on that no

Re: Migrating to riak 2.1.4, selecting a specific multi-backend from the Java Client

Hey Henning, Almost everything is stored in bitcask, but for some > progress-information-items, we are using the memory backend with > automatic expiration. Thus, the multibackend is being configured > (app.config for the old nodes, riak.conf for the new nodes). In the > past, I have configured bu

Re: Riak Elixir limit fetch on bucket

Hi churcho, LIMIT has not yet been implemented in Riak TS. It is on the roadmap for a future release. -Alexander On Thu, Jul 28, 2016 at 5:25 AM, churcho wrote: > Due to the nature of what I want to build, I would like to be able to limit > the keys I fetch from a bucket. Is there a facility si

Re: Playing with / understanding Riak configurations

Thanks Tom... On Wed, Jul 27, 2016 at 6:27 PM, Tom Santero wrote: > Vikram, > > I apologize, I initially just skimmed your question and thought you were > asking something entirely different. > > While increasing your N value is safe, decreasing it on a bucket with > pre-existing data, as you ha

Re: riak TS max concurrent queries + overload error

On Thu, Jul 28, 2016 at 6:10 AM, wrote: > Thank you! I should've mentioned in my initial email that I thought we were > experiencing the same bug you called out (in fact the 2nd comment on that > github issue is actually from me). > Aha, cool. :o) > So, what I'm really curious about is whether

Re: riak TS max concurrent queries + overload error

rease the overall TS query capacity of our cluster with a simple configuration change. I'm suspicious that we have a very conservative value at the moment. Chris From: Cian Synnott Sent: Wednesday, July 27, 2016 6:03 PM To: Johnson Chris CJOH Cc: ri

Re: riak TS max concurrent queries + overload error

Hi Chris, This sounds like the issue described at https://github.com/basho/riak_kv/issues/1418 On Wed, Jul 27, 2016 at 11:19 PM, wrote: > Also, does anyone have any recommendations on query pooling so we can > guarantee that multiple clients will not generate more queries than the > cluster c

Re: Playing with / understanding Riak configurations

Vikram, I apologize, I initially just skimmed your question and thought you were asking something entirely different. While increasing your N value is safe, decreasing it on a bucket with pre-existing data, as you have, is not-recommended and the source of your inconsistent results. Tom On Wed,

Re: Playing with / understanding Riak configurations

Thanks Tom... Yes I did read that but I couldn't deduce the outcome if n is decreased. John talks about data loss, but am actually observing a different result... perhaps am missing something! On Wed, Jul 27, 2016 at 6:11 PM, Tom Santero wrote: > Vikram, > > John Daily wrote a fantastic blog se

Re: Playing with / understanding Riak configurations

Vikram, John Daily wrote a fantastic blog series that places your question in context and then answers it. http://basho.com/posts/technical/understanding-riaks-configurable-behaviors-part-1/ Tom On Wed, Jul 27, 2016 at 4:07 PM, Vikram Lalit wrote: > Hi - I have a Riak node with n_val=3, r=2,

Re: Riak Search: cursormark support

Hello Guillaume, We’re definitely working on it for a future release and there is still an open ticket regarding it: https://github.com/basho/yokozuna/issues/309 . Thanks. Zeeshan Lakhani programmer | software engineer at @basho | org. member/fou

Re: Detecting Hinted Handoff

Agreed rolling your own 2i is likely your best bet here, I too am wondering what purpose it would serve you. On Monday, July 25, 2016, Russell Brown wrote: > But I still don’t understand _why_? What is the aim, ‘cos I’m not sure > it’s possible. > > For quorum reads on indexes then Sargun’s “ro

Re: Detecting Hinted Handoff

But I still don’t understand _why_? What is the aim, ‘cos I’m not sure it’s possible. For quorum reads on indexes then Sargun’s “roll your own” idea is the better answer at the moment. On 25 Jul 2016, at 11:25, DeadZen wrote: > Hinted handoff from adding a node, removing a node or failing a n

Re: Detecting Hinted Handoff

Hinted handoff from adding a node, removing a node or failing a node? Could probably get some idea from a ring handler, hinted handoff could likely very well trigger its own event as well without a large modification to riak_core On Sunday, July 24, 2016, Sargun Dhillon wrote: > It might also m

Re: Detecting Hinted Handoff

It might also make a lot of sense to roll your own secondary indices. That is, have a CRDT set represent the primary key of the rows which meet the 2i condition. In that, you can query the CRDT set, and ensure some level of consistency. There are further tricks to be played here if interested. I'm

Re: Detecting Hinted Handoff

Take a look at the "pw" and "pr" tunable consistency options for gets and puts. The base level of abstraction in Riak is the virtual node - not the physical machine. When data is replicated it is replicated to a replica set of virtual nodes. Those virtual nodes have primary and secondary (due to

Re: How to best store arbitrarily large Java objects

On 22 Jul 2016, at 09:12, Henning Verbeek wrote: > Alex, > thanks for the very quick response. > > On Thu, Jul 21, 2016 at 5:36 PM, Alex Moore wrote: >>> I'm beginning to think that I'll need to remodel my data and use CRDTs >>> for individual fields such as the `TreeMap`. Would that be a bett

Re: How to best store arbitrarily large Java objects

Alex, thanks for the very quick response. On Thu, Jul 21, 2016 at 5:36 PM, Alex Moore wrote: >> I'm beginning to think that I'll need to remodel my data and use CRDTs >> for individual fields such as the `TreeMap`. Would that be a better >> way? > > > This sounds like a plausible idea. If you do

RE: riak bitcask calculation

Thanks Luke for your help! -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: July-21-16 1:55 PM To: Travis Kirstine Cc: riak-users@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis, The memory used by Riak (beam.smp) is for more

Re: riak bitcask calculation

> Sent: July-18-16 11:35 AM > To: Travis Kirstine > Cc: riak-users@lists.basho.com; ac...@jdbarnes.com > Subject: Re: riak bitcask calculation > > Hi Travis - > > The calculation provided for bitcask memory consumption is only a rough > guideline. Using more memory than th

Re: How to best store arbitrarily large Java objects

Hi Henning, Responses inline: ... > However, depending on the size of the `TreeMap`, the serialization > output can become rather large, and this limits the usefulness of my > object. In our tests, dealing with Riak-objects >2MB proved to be > significantly slower than dealing with objects <200k

RE: riak bitcask calculation

@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis - The calculation provided for bitcask memory consumption is only a rough guideline. Using more memory than the calculation suggests is normal and expected with Riak. As you increase load on this cluster memory use m

RE: riak bitcask calculation

:lbak...@basho.com] Sent: July-18-16 11:14 AM To: Travis Kirstine Cc: riak-users@lists.basho.com; ac...@jdbarnes.com Subject: Re: riak bitcask calculation Hi Travis, Could you go into detail about how you're coming up with 9GiB per node? Is this from the output of the "free" co

Re: riak bitcask calculation

Hi Travis - The calculation provided for bitcask memory consumption is only a rough guideline. Using more memory than the calculation suggests is normal and expected with Riak. As you increase load on this cluster memory use may go up further as the operating system manges disk operations and buff

Re: riak bitcask calculation

Hi Travis, Could you go into detail about how you're coming up with 9GiB per node? Is this from the output of the "free" command? Bitcask uses the operating system's buffers for file operations, and will happily use as much free ram as it can get to speed up operations. However, the OS will use t

Re: Create Bucket failed

Hi Salman, Please re-read the Riak CS instructions carefully. You *must* only have one Stanchion service running in your entire cluster: https://docs.basho.com/riak/cs/2.1.1/cookbooks/installing/#installing-stanchion-on-a-node Based on your latest email, it sounds as though Stanchion is running

Re: Create Bucket failed

Salman - Please use "reply all" to include the mailing list in the discussion. This is the first time you have mentioned a "failed server". Can you go into more detail? How many servers are in this cluster? -- Luke Bakken Engineer lbak...@basho.com On Mon, Jul 18, 2016 at 2:39 AM, Salman Khale

Re: Riak high IO usage

Hi "!" Could you please sign with a name, so that we know how to address you? On 15 July 2016 at 07:45, ！ wrote: > hi all, > there is a program comfusing me that Riak produce continuous high IO > [graph showing IO spikes reaching 100% for minutes at a time removed] Unfortunately you don't

Re: Docker support

Adam, I'll have someone give you a call to discuss your requirements. -- *Justin Pease* VP, Services Basho Technologies, Inc. On Fri, Jul 15, 2016 at 10:24 AM, Adam Winter wrote: > Jon, > > Is there anyone I can talk to to confirm that the licensed commercial > version with a support contra

Re: Docker support

Jon, Is there anyone I can talk to to confirm that the licensed commercial version with a support contract is or is not supported running in a Docker container in production environments, assuming the technical challenges you describe can be addressed? Adam Winter 614-446-9033 Delivery Lead P

Re: java client: overload leads to BlockingOperationException

Thanks, Luke! https://github.com/basho/riak-java-client/issues/638 On Thu, Jul 14, 2016 at 2:42 PM, Luke Bakken wrote: > Hi Henning, > > The best place to continue discussion would be to file an issue in > GitHub. This sounds like a bug or at least a place for improvement. > > https://github.com/

Re: Create Bucket failed

Salman - Can you provide more detailed debugging logs from s3cmd or some way to reproduce this? -- Luke Bakken Engineer lbak...@basho.com On Wed, Jul 13, 2016 at 3:34 AM, Salman Khaleghian wrote: > Hello > I use cloudberry and s3cmd both. Both of them show internal server error. > Bests > > >

Re: java client: overload leads to BlockingOperationException

Hi Henning, The best place to continue discussion would be to file an issue in GitHub. This sounds like a bug or at least a place for improvement. https://github.com/basho/riak-java-client/issues > How many active, busy connections does Riak KV support? You're correct that "it depends" is the r

Re: Docker support

On Wed, Jul 13, 2016 at 10:08 PM, Jon Brisbin wrote: > I guess to answer at least one part of your question on whether it's > "encouraged" or not: it depends on what you want to do with it. > > I can't speak for the support side of things but on the engineering side > anyway we're using Docker con

Re: Docker support

I guess to answer at least one part of your question on whether it's "encouraged" or not: it depends on what you want to do with it. I can't speak for the support side of things but on the engineering side anyway we're using Docker containers fairly happily to do things like create ephemeral clust

Re: Docker support

I would discourage running Riak in Docker. If you use Docker in bridge mode, then it becomes fairly difficult to deal with networking across machines. If you run it in host mode, you run into issues with epmd in the host network namespace. There are some workarounds to this, like using third party

Re: Recovering Riak data if it can no longer load in memory

Many thanks again, Matthew... this is very educative and helpful...! I'm now giving a shot with higher performance nodes... Thanks again! On Tue, Jul 12, 2016 at 4:18 PM, Matthew Von-Maszewski wrote: > You can further reduce memory used by leveldb with the following setting > in riak.conf: > >

Re: Recovering Riak data if it can no longer load in memory

You can further reduce memory used by leveldb with the following setting in riak.conf: leveldb.threads = 5 The value "5" needs to be a prime number. The system defaults to 71. Many Linux implementations will allocate 8Mbytes per thread for stack. So bunches of threads lead to bunches of

Re: Recovering Riak data if it can no longer load in memory

Thanks much Matthew. Yes the server is low-memory given only development right now - I'm using an AWS micro instance, so 1 GB RAM and 1 vCPU. Thanks for the tip - let me try move the manifest file to a larger instance and see how that works. More than reducing the memory footprint in dev, my conce

Re: Recovering Riak data if it can no longer load in memory

It would be helpful if you described the physical characteristics of the servers: memory size, logical cpu count, etc. Google created leveldb to be highly reliable in the face of crashes. If it is not restarting, that suggests to me that you have a low memory condition that is not able to loa

Re: Riak on Solaris/OmniOS/illumos

Hi Henrik, Sorry for the delay in responding to you via this channel. Solaris / Illumos support will be dropped in a future Riak release, as will FreeBSD. However, this does not preclude the community continuing support for these platforms. All the necessary code to build platform-specific Riak pa

<    3   4   5   6   7   8   9   10   11   12   >