Hi Massimiliano, As a first step I would recommend setting pb_backlog to 64 or 128 in your app.config
How are you distributing the load from your python clients to the Riak cluster? Is every python client connecting directly to one Riak node or do you have a pool of Riak servers configured in each client? Thanks, Ciprian On Tue, Mar 18, 2014 at 8:49 AM, Massimiliano Ciancio < massimili...@ciancio.net> wrote: > I tried to raise each param in sysctl.con (now the configuration is a > bit strange with all that 9s :-) > But I still get many "RiakError: timeout" :( > Have you any suggestion, please? > Thanks in advance > Massimiliano > > fs.file-max = 999999 > vm.swappiness = 0 > net.ipv4.tcp_max_syn_backlog = 999999 > net.core.somaxconn = 999999 > net.ipv4.tcp_timestamps = 0 > net.ipv4.tcp_sack = 1 > net.ipv4.tcp_window_scaling = 1 > net.ipv4.tcp_fin_timeout = 15 > net.ipv4.tcp_keepalive_intvl = 30 > net.ipv4.tcp_tw_reuse = 1 > net.ipv4.tcp_tw_recycle = 1 > vm.max_map_count = 32000000 > net.core.rmem_default = 8388608 > net.core.rmem_max = 8388608 > net.core.wmem_default = 8388608 > net.core.wmem_max = 8388608 > net.core.netdev_max_backlog = 999999 > > 2014-03-17 21:15 GMT+01:00 Michael Dillon <mdillon...@pagefreezer.com>: > > On the server which is sending write requests to the Riak cluster, you > may > > have run into some network limits, possibly max sockets or one of the > > network buffer settings. I would try to tune your kernel for a high > level of > > network traffic and try again. Or just split your load across more than > one > > server. > > > > If you are going to have very high loads of requests going to a Riak > cluster > > it is a good idea to put a load balancer in front of it so that you > spread > > the requests across nodes in the cluster. Riak's clustering only > distributes > > work AFTER Riak receives the requests. If you sent all your Riak > requests to > > just one member of the cluster, then you can potentially create an > incoming > > network bottleneck on that server. > > > > > > > > On Mon, Mar 17, 2014 at 11:34 AM, Massimiliano Ciancio > > <massimili...@ciancio.net> wrote: > >> > >> Hi list, > >> I'm in troubles... > >> I'm getting many timeout errors from Riak (see traceback at end of > mail). > >> I'm using a 5 node Debian cluster. Riak version is 1.4.8. Riak Python > >> client is installed with 'pip install riak' and is up to date. > >> The errors come from different processes on the same machine trying to > >> write intensively on Riak, using each one their own connection. > >> The errors start after some time the processes are running. > >> What can I check? > >> Thanks in advance > >> Massimiliano > >> > >> > >> Traceback (most recent call last): > >> ... > >> File "/usr/local/lib/python2.7/dist-packages/riak/bucket.py", line > >> 206, in get > >> return obj.reload(r=r, pr=pr, timeout=timeout) > >> File "/usr/local/lib/python2.7/dist-packages/riak/riak_object.py", > >> line 307, in reload > >> self.client.get(self, r=r, pr=pr, timeout=timeout) > >> File > "/usr/local/lib/python2.7/dist-packages/riak/client/transport.py", > >> line 127, in wrapper > >> return self._with_retries(pool, thunk) > >> File > "/usr/local/lib/python2.7/dist-packages/riak/client/transport.py", > >> line 69, in _with_retries > >> return fn(transport) > >> File > "/usr/local/lib/python2.7/dist-packages/riak/client/transport.py", > >> line 125, in thunk > >> return fn(self, transport, *args, **kwargs) > >> File > "/usr/local/lib/python2.7/dist-packages/riak/client/operations.py", > >> line 333, in get > >> return transport.get(robj, r=r, pr=pr, timeout=timeout) > >> File > >> > "/usr/local/lib/python2.7/dist-packages/riak/transports/pbc/transport.py", > >> line 146, in get > >> MSG_CODE_GET_RESP) > >> File > >> > "/usr/local/lib/python2.7/dist-packages/riak/transports/pbc/connection.py", > >> line 43, in _request > >> return self._recv_msg(expect) > >> File > >> > "/usr/local/lib/python2.7/dist-packages/riak/transports/pbc/connection.py", > >> line 55, in _recv_msg > >> raise RiakError(err.errmsg) > >> RiakError: 'timeout' > >> > >> _______________________________________________ > >> riak-users mailing list > >> riak-users@lists.basho.com > >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > > > > > > > > > -- > > PageFreezer.com > > #200 - 311 Water Street > > Vancouver, BC V6B 1B8 > > _______________________________________________ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >
_______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
