Re: map reduce on multiple buckets

2016-01-28 Thread Alex Moore 
Hi Eugene,

MR is limited to one bucket for inputs, and the Solr inputs to a map phase
have this restriction too.

How many buckets are you trying to MR across, and also what type of MR
operation are you trying to do? There may be another way to get around this
restriction.

Thanks,
Alex

On Thu, Jan 28, 2016 at 8:10 AM, Eugene Shubin  wrote:

> Is it possible to run mapreduce job on two or more buckets?
> I see from documentation that it might be possible if I specify inputs as
> list of {bucket, key} pairs,
> although list of secondary index inputs causes an error:
> riakc_pb_socket:mapred(P, [
> {index, Bucket1, Index1, From, To},
> {index, Bucket2, Index2, From, To}
>   ], ...
>  {error,<<"{inputs,{\"Inputs target tuples must be {B,K} or
> {{B,K},KeyData}:\",\n
>
> Is it possible using Solr (riak search) indexes?
>
> Evgenii Shubin
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: map reduce on multiple buckets

2016-01-28 Thread Eugene Shubin 
I want to keep daily and weekly data in different buckets, and generate
monthly report using map reduce on these two.
so 2 buckets and MR operations are custom.

Best,
Eugene

2016-01-28 17:29 GMT+01:00 Alex Moore :

> Hi Eugene,
>
> MR is limited to one bucket for inputs, and the Solr inputs to a map phase
> have this restriction too.
>
> How many buckets are you trying to MR across, and also what type of MR
> operation are you trying to do? There may be another way to get around this
> restriction.
>
> Thanks,
> Alex
>
> On Thu, Jan 28, 2016 at 8:10 AM, Eugene Shubin  wrote:
>
>> Is it possible to run mapreduce job on two or more buckets?
>> I see from documentation that it might be possible if I specify inputs as
>> list of {bucket, key} pairs,
>> although list of secondary index inputs causes an error:
>> riakc_pb_socket:mapred(P, [
>> {index, Bucket1, Index1, From, To},
>> {index, Bucket2, Index2, From, To}
>>   ], ...
>>  {error,<<"{inputs,{\"Inputs target tuples must be {B,K} or
>> {{B,K},KeyData}:\",\n
>>
>> Is it possible using Solr (riak search) indexes?
>>
>> Evgenii Shubin
>>
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

High CPU usage by beam.smp

2016-01-28 Thread Fasil K 
Hello, I am using riak 2.1.1 for saving some datas (5 datas).
I am running riak with a single node so far. my problem is riak is
consuming almost 40% of CPU in idle state. Can any one help me to solve
this issue.?


With Regards,

Fasil K
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

map reduce on multiple buckets

2016-01-28 Thread Eugene Shubin 
Is it possible to run mapreduce job on two or more buckets?
I see from documentation that it might be possible if I specify inputs as
list of {bucket, key} pairs,
although list of secondary index inputs causes an error:
riakc_pb_socket:mapred(P, [
{index, Bucket1, Index1, From, To},
{index, Bucket2, Index2, From, To}
  ], ...
 {error,<<"{inputs,{\"Inputs target tuples must be {B,K} or
{{B,K},KeyData}:\",\n

Is it possible using Solr (riak search) indexes?

Evgenii Shubin
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: High CPU usage by beam.smp

2016-01-28 Thread Magnus Kessler 
On 28 January 2016 at 09:05, Fasil K  wrote:

>
> Hello, I am using riak 2.1.1 for saving some datas (5 datas).
> I am running riak with a single node so far. my problem is riak is
> consuming almost 40% of CPU in idle state. Can any one help me to solve
> this issue.?
>
>
> With Regards,
>
> Fasil K
>


Hi Fasil,

The CPU usage you observe is due to the way Erlang schedulers work. When
they run out of work, they don't go to sleep immediately, but perform a
busy wait for some time instead. This increases responsiveness. For a nice,
detailed discussion of this please see
http://jlouisramblings.blogspot.co.uk/2013/01/how-erlang-does-scheduling.html

On a single node with the default ring size of 64, you also have a lot more
VNodes than on a typical production node. A VNode is handled by an Erlang
process, and all these processes require their own share of CPU and memory.

I hope this answers your question.

Regards,

Magnus

-- 
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: High CPU usage by beam.smp

2016-01-28 Thread Fasil K 
Thank you Magnus. Your answer helps.

With Regards,

Fasil K

On Thu, Jan 28, 2016 at 3:53 PM, Magnus Kessler  wrote:

> On 28 January 2016 at 09:05, Fasil K  wrote:
>
>>
>> Hello, I am using riak 2.1.1 for saving some datas (5 datas).
>> I am running riak with a single node so far. my problem is riak is
>> consuming almost 40% of CPU in idle state. Can any one help me to solve
>> this issue.?
>>
>>
>> With Regards,
>>
>> Fasil K
>>
>
>
> Hi Fasil,
>
> The CPU usage you observe is due to the way Erlang schedulers work. When
> they run out of work, they don't go to sleep immediately, but perform a
> busy wait for some time instead. This increases responsiveness. For a nice,
> detailed discussion of this please see
> http://jlouisramblings.blogspot.co.uk/2013/01/how-erlang-does-scheduling.html
>
> On a single node with the default ring size of 64, you also have a lot
> more VNodes than on a typical production node. A VNode is handled by an
> Erlang process, and all these processes require their own share of CPU and
> memory.
>
> I hope this answers your question.
>
> Regards,
>
> Magnus
>
> --
> Magnus Kessler
> Client Services Engineer
> Basho Technologies Limited
>
> Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com