Re: Increase number of partitions above 1024

[Chathuri Gunawardhana]

Yeah It worked. Thank you vey much!

On Tue, Feb 23, 2016 at 9:54 AM, Magnus Kessler  wrote:

> On 22 February 2016 at 16:10, Chathuri Gunawardhana <
> lanch.gunawardh...@gmail.com> wrote:
>
>> I'm using riak master version on riak github (riak_kv_version :
>> <<"2.1.1-38-ga8bc9e0">>)
>> . I don't use coverage queries.
>>
>> When I try to set the partition count over 1024, it suggest me to do it
>> via advanced config (in cuttlefish schema for riak core, there is a
>> validation to see whether it is above 1024 and if so they give this
>> suggestion). But I don't know how I can add this parameter to
>> advanced.config.
>>
>> Thank you very much!
>>
>
> Hi Chaturi,
>
> $ riak config describe ring_size
> Documentation for ring_size
> Number of partitions in the cluster (only valid when first
> creating the cluster). Must be a power of 2, minimum 8 and maximum
> 1024.
>
>Valid Values:
>  - an integer
>Default Value : 64
>Value not set in /etc/riak/riak.conf
>Internal key  : riak_core.ring_creation_size
>
> Cuttlefish configuration schemas are self-describing (via the riak config
> describe command). You can use the name of the internal key in
> advanced.config. If there's nothing else in advanced.config yet, the
> setting looks like
>
> [
>  {riak_core,
>   [
>{ring_creation_size, 2048}
>   ]
>  }
> ].
>
> Also see
> http://docs.basho.com/riak/latest/ops/advanced/configs/configuration-files/#Advanced-Configuration
> for more details about using the advanced configuration file.
>
> I hope this helps.
>
> Kind Regards,
>
> Magnus
>
>
> --
> Magnus Kessler
> Client Services Engineer
> Basho Technologies Limited
>
> Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
>



-- 
Chathuri Gunawardhana
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Increase number of partitions above 1024

[Magnus Kessler]

On 22 February 2016 at 16:10, Chathuri Gunawardhana <
lanch.gunawardh...@gmail.com> wrote:

> I'm using riak master version on riak github (riak_kv_version :
> <<"2.1.1-38-ga8bc9e0">>)
> . I don't use coverage queries.
>
> When I try to set the partition count over 1024, it suggest me to do it
> via advanced config (in cuttlefish schema for riak core, there is a
> validation to see whether it is above 1024 and if so they give this
> suggestion). But I don't know how I can add this parameter to
> advanced.config.
>
> Thank you very much!
>

Hi Chaturi,

$ riak config describe ring_size
Documentation for ring_size
Number of partitions in the cluster (only valid when first
creating the cluster). Must be a power of 2, minimum 8 and maximum
1024.

   Valid Values:
 - an integer
   Default Value : 64
   Value not set in /etc/riak/riak.conf
   Internal key  : riak_core.ring_creation_size

Cuttlefish configuration schemas are self-describing (via the riak config
describe command). You can use the name of the internal key in
advanced.config. If there's nothing else in advanced.config yet, the
setting looks like

[
 {riak_core,
  [
   {ring_creation_size, 2048}
  ]
 }
].

Also see
http://docs.basho.com/riak/latest/ops/advanced/configs/configuration-files/#Advanced-Configuration
for more details about using the advanced configuration file.

I hope this helps.

Kind Regards,

Magnus


-- 
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Increase number of partitions above 1024

[Chathuri Gunawardhana]

I'm using riak master version on riak github (riak_kv_version :
<<"2.1.1-38-ga8bc9e0">>)
. I don't use coverage queries.

When I try to set the partition count over 1024, it suggest me to do it via
advanced config (in cuttlefish schema for riak core, there is a validation
to see whether it is above 1024 and if so they give this suggestion). But I
don't know how I can add this parameter to advanced.config.

Thank you very much!

On Mon, Feb 22, 2016 at 5:05 PM, Alex Moore <amo...@basho.com> wrote:

> Ok, what does `riak-admin status | grep riak_kv_version` return?  The
> config files are different for Riak 1.x and 2.x.
>
> Also for your tests, are you using any "coverage query" features like
> MapReduce or 2i queries?
>
> Thanks,
> Alex
>
>
>
>
> On Mon, Feb 22, 2016 at 10:43 AM, Chathuri Gunawardhana <
> lanch.gunawardh...@gmail.com> wrote:
>
>> For my experiment I will be using 100 nodes.
>>
>> Thank you!
>>
>> On Mon, Feb 22, 2016 at 4:40 PM, Alex Moore <amo...@basho.com> wrote:
>>
>>> Hi Chathuri,
>>>
>>> Larger ring sizes are not usually recommended, you can overload disk I/O
>>> if the number of vnodes to nodes is too high.
>>> Similarly you can underload other system resources if the vnode/node
>>> ratio is too low.
>>>
>>> How many nodes are you planning on running?
>>>
>>> Thanks,
>>> Alex
>>>
>>> On Mon, Feb 22, 2016 at 5:42 AM, Chathuri Gunawardhana <
>>> lanch.gunawardh...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> It is not possible to increase the number of partitions above 1024 and
>>>> has been disabled via cuttlefish in riak.config. When I try to increase
>>>> ring_size via riak.config, the error suggest that I should configure
>>>> partition size>1024 via advanced config file. But I couldn't find a way of
>>>> how I can specify this in advanced.config file. Can you please suggest me
>>>> how I can do this?
>>>>
>>>> Thank you very much!
>>>>
>>>> --
>>>> Chathuri Gunawardhana
>>>>
>>>>
>>>> ___
>>>> riak-users mailing list
>>>> riak-users@lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>>
>>>
>>
>>
>> --
>> Chathuri Gunawardhana
>>
>>
>


-- 
Chathuri Gunawardhana
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Increase number of partitions above 1024

[Alex Moore]

Ok, what does `riak-admin status | grep riak_kv_version` return?  The
config files are different for Riak 1.x and 2.x.

Also for your tests, are you using any "coverage query" features like
MapReduce or 2i queries?

Thanks,
Alex




On Mon, Feb 22, 2016 at 10:43 AM, Chathuri Gunawardhana <
lanch.gunawardh...@gmail.com> wrote:

> For my experiment I will be using 100 nodes.
>
> Thank you!
>
> On Mon, Feb 22, 2016 at 4:40 PM, Alex Moore <amo...@basho.com> wrote:
>
>> Hi Chathuri,
>>
>> Larger ring sizes are not usually recommended, you can overload disk I/O
>> if the number of vnodes to nodes is too high.
>> Similarly you can underload other system resources if the vnode/node
>> ratio is too low.
>>
>> How many nodes are you planning on running?
>>
>> Thanks,
>> Alex
>>
>> On Mon, Feb 22, 2016 at 5:42 AM, Chathuri Gunawardhana <
>> lanch.gunawardh...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> It is not possible to increase the number of partitions above 1024 and
>>> has been disabled via cuttlefish in riak.config. When I try to increase
>>> ring_size via riak.config, the error suggest that I should configure
>>> partition size>1024 via advanced config file. But I couldn't find a way of
>>> how I can specify this in advanced.config file. Can you please suggest me
>>> how I can do this?
>>>
>>> Thank you very much!
>>>
>>> --
>>> Chathuri Gunawardhana
>>>
>>>
>>> ___
>>> riak-users mailing list
>>> riak-users@lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>>
>
>
> --
> Chathuri Gunawardhana
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Increase number of partitions above 1024

[Chathuri Gunawardhana]

For my experiment I will be using 100 nodes.

Thank you!

On Mon, Feb 22, 2016 at 4:40 PM, Alex Moore <amo...@basho.com> wrote:

> Hi Chathuri,
>
> Larger ring sizes are not usually recommended, you can overload disk I/O
> if the number of vnodes to nodes is too high.
> Similarly you can underload other system resources if the vnode/node ratio
> is too low.
>
> How many nodes are you planning on running?
>
> Thanks,
> Alex
>
> On Mon, Feb 22, 2016 at 5:42 AM, Chathuri Gunawardhana <
> lanch.gunawardh...@gmail.com> wrote:
>
>> Hi,
>>
>> It is not possible to increase the number of partitions above 1024 and
>> has been disabled via cuttlefish in riak.config. When I try to increase
>> ring_size via riak.config, the error suggest that I should configure
>> partition size>1024 via advanced config file. But I couldn't find a way of
>> how I can specify this in advanced.config file. Can you please suggest me
>> how I can do this?
>>
>> Thank you very much!
>>
>> --
>> Chathuri Gunawardhana
>>
>>
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
>


-- 
Chathuri Gunawardhana
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Increase number of partitions above 1024

[Chathuri Gunawardhana]

Hi,

It is not possible to increase the number of partitions above 1024 and has
been disabled via cuttlefish in riak.config. When I try to increase
ring_size via riak.config, the error suggest that I should configure
partition size>1024 via advanced config file. But I couldn't find a way of
how I can specify this in advanced.config file. Can you please suggest me
how I can do this?

Thank you very much!

-- 
Chathuri Gunawardhana
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com