Re: [IE] [IE] Re: [IE] Re: merge_contents error

[Russell Brown]

Good news.

No problem.

Cheers

Russell

On 26 Jun 2017, at 12:48, Mark Richard Thomas  wrote:

> Thanks Russell.
> 
> You're a star.
> 
> Right again - dvv_enabled property on a bucket.
> 
> My cluster is finally looking stable.
> 
> Mark
> Equifax Limited is registered in England with Registered No. 2425920. 
> Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax 
> Limited is authorised and regulated by the Financial Conduct Authority.
> Equifax Touchstone Limited is registered in Scotland with Registered No. 
> SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 
> 8EH.
> Equifax Commercial Services Limited is registered in the Republic of Ireland 
> with Registered No. 215393. Registered Office: IDA Business & Technology 
> Park, Rosslare Road, Drinagh, Wexford.
> 
> This message contains information from Equifax which may be confidential and 
> privileged. If you are not an intended recipient, please refrain from any 
> disclosure, copying, distribution or use of this information and note that 
> such actions are prohibited. If you have received this transmission in error, 
> please notify by e-mail postmas...@equifax.com.


___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

RE: [IE] Re: [IE] Re: [IE] Re: merge_contents error

[Mark Richard Thomas]

Thanks Russell.

You're a star.

Right again - dvv_enabled property on a bucket.

My cluster is finally looking stable.

Mark
Equifax Limited is registered in England with Registered No. 2425920. 
Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax 
Limited is authorised and regulated by the Financial Conduct Authority.
Equifax Touchstone Limited is registered in Scotland with Registered No. 
SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 
8EH.
Equifax Commercial Services Limited is registered in the Republic of Ireland 
with Registered No. 215393. Registered Office: IDA Business & Technology Park, 
Rosslare Road, Drinagh, Wexford.

This message contains information from Equifax which may be confidential and 
privileged. If you are not an intended recipient, please refrain from any 
disclosure, copying, distribution or use of this information and note that such 
actions are prohibited. If you have received this transmission in error, please 
notify by e-mail postmas...@equifax.com.

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: [IE] Re: [IE] Re: merge_contents error

[Russell Brown]

Same thing (<<“false”>> is 3rd param). Is this the same bucket?

How big is the cluster?

On 26 Jun 2017, at 11:31, Mark Richard Thomas  wrote:

> Hello
> 
> The number of crashes has dropped dramatically with the property 
> (dvv_enabled) updated. Now, I'm periodically seeing crash messages like:
> 
> 2017-06-26 10:05:56 =CRASH REPORT
>  crasher:
>initial call: riak_kv_get_fsm:init/1
>pid: <0.20060.107>
>registered_name: []
>exception exit: 
> {{function_clause,[{riak_object,merge_contents,[{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"charset">>,117,116,102,45,56],[<<"X-Riak-Meta">>]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":\"TCS
>  0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
> C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
> C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
> 1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false}}">>}],[{<<90,0,32,188,84,53,62,41>>,{1,63662149406}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":\"TCS
>  0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
> C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
> C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
> 1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false}}">>}],[{<<90,0,32,188,84,53,62,41>>,{1,63662149406}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},<<"false">>],[{file,"src/riak_object.erl"},{line,306}]},{timer,tc,2,[{file,"timer.erl"},{line,179}]},{riak_object,merge,2,[{file,"src/riak_object.erl"},{line,279}]},{lists,foldl,3,[{file,"lists.erl"},{line,1248}]},{riak_object,reconcile,2,[{file,"src/riak_object.erl"},{line,208}]},{riak_kv_get_core,merge,2,[{file,"src/riak_kv_get_core.erl"},{line,262}]},{riak_kv_get_core,response,1,[{file,"src/riak_kv_get_core.erl"},{line,140}]},{riak_kv_get_fsm,waiting_vnode_r,2,[{file,"src/riak_kv_get_fsm.erl"},{line,334}]}]},[{gen_fsm,terminate,7,[{file,"gen_fsm.erl"},{line,622}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,239}]}]}
>ancestors: 
> [riak_kv_get_fsm_sj_4,riak_kv_get_fsm_sj_worker_sup,riak_kv_get_fsm_sj,sidejob_sup,<0.372.0>]
>messages: 
> [{'$gen_event',{r,{ok,{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":\"TCS
>  0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
> C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
> C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
> 1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccount

RE: [IE] Re: [IE] Re: merge_contents error

[Mark Richard Thomas]

Hello

The number of crashes has dropped dramatically with the property (dvv_enabled) 
updated. Now, I'm periodically seeing crash messages like:

2017-06-26 10:05:56 =CRASH REPORT
  crasher:
initial call: riak_kv_get_fsm:init/1
pid: <0.20060.107>
registered_name: []
exception exit: 
{{function_clause,[{riak_object,merge_contents,[{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"charset">>,117,116,102,45,56],[<<"X-Riak-Meta">>]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":\"TCS
 0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\
 
":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false}}">>}],[{<<90,0,32,188,84,53,62,41>>,{1,63662149406}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":
 \"TCS 0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false}}">>}],[{<<90,0,32,188,84,53,62,41>>,{1,63662149406}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},<<"false">>],[{file,"src/riak_object.erl"},{line,306}]},{timer,tc,2,[{file,"timer.erl"},{line,179}]},{riak_object,merge,2,[{file,"src/riak_object.erl"},{line,279}]},{lists,foldl,3,[{file,"lists.erl"},{line,1248}]},{riak_object,reconcile,2,[{file,"src/riak_obje
 
ct.erl"},{line,208}]},{riak_kv_get_core,merge,2,[{file,"src/riak_kv_get_core.erl"},{line,262}]},{riak_kv_get_core,response,1,[{file,"src/riak_kv_get_core.erl"},{line,140}]},{riak_kv_get_fsm,waiting_vnode_r,2,[{file,"src/riak_kv_get_fsm.erl"},{line,334}]}]},[{gen_fsm,terminate,7,[{file,"gen_fsm.erl"},{line,622}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,239}]}]}
ancestors: 
[riak_kv_get_fsm_sj_4,riak_kv_get_fsm_sj_worker_sup,riak_kv_get_fsm_sj,sidejob_sup,<0.372.0>]
messages: 
[{'$gen_event',{r,{ok,{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"02565069">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,54,110,74,113,77,100,117,79,84,109,119,78,110,119,120,84,48,51,106,119,79,103]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,930206,640553}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"02565069\",\"identification\":{\"companyNo\":\"02565069\",\"name\":\"TCS
 0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\
 
":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false}}">>}],[{<<90,0,32,188,84,53,62,41>>,{1,6366

Re: Riak Intermittent Read Failures

[sean mcevoy]

Hi Mark,

I've observed timeouts too but always on serach operation, you might have
seen my thread "Solr search response time spikes".

I'm getting stats by polling this every minute:
http://docs.basho.com/riak/kv/2.2.3/developing/api/http/status/

The 99 & 100% response times are most interesting for debugging our
problems.
What client & timeout value are you using? I'm using the erlang client
where the default timeout is 60 seconds, but I've over ridden that and am
using 2 seconds.

Interestingly, over the weekend I've started to see a few put & get
timeouts on the application side, but the longest 100% response time is
just under a second which points to a network delay.

I'd start by polling these stats and then examining when you get an
application side timeout. Maybe check the size stats too, if you can catch
which key the operation timed out on it'd be worth checking the object size
& sibling count for it. If nothing else this would eliminate the
possibility that it's unique to a particular object.

//Sean.


On Sat, Jun 24, 2017 at 12:57 PM, markrthomas 
wrote:

> Hello
>
> I'm getting intermiitent read failures in my cluster, i.e. timeout
>
> Sometimes an object returns immediately.
>
> Other times, nothing at all and I get a read-timeout.
>
> Any ideas on where I start debugging this issue?
>
> Thanks
>
> Mark
>
>
>
> --
> View this message in context: http://riak-users.197444.n3.
> nabble.com/Riak-Intermittent-Read-Failures-tp4035229.html
> Sent from the Riak Users mailing list archive at Nabble.com.
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: [IE] Re: merge_contents error

[Russell Brown]

The crash report is for the same reason, the 3rd argument to 
riak_object:merge_contents/3 is <<"false”>> when it should be the atom ‘false’.

Is that crash report from _after_ you updated the bucket properties?

Cheers

Russell

On 26 Jun 2017, at 10:50, Mark Richard Thomas  wrote:

> Hello
> 
> Riak version 2.2.3
> 
> Yes, this is related to a cluster restore from backup.
> 
> .../types/commercial/props
> 
> {"props":{"name":"commercial_systest","active":true,"allow_mult":false,"basic_quorum":true,"big_vclock":50,"chash_keyfun":{"mod":"riak_core_util","fun":"chash_std_keyfun"},"claimant":"r...@wrkd1lrkd002.app.c9.equifax.com","dvv_enabled":false,"dw":"quorum","last_write_wins":true,"linkfun":{"mod":"riak_kv_wm_link_walker","fun":"mapreduce_linkfun"},"n_val":3,"notfound_ok":false,"old_vclock":86400,"postcommit":[],"pr":0,"precommit":[],"pw":0,"r":"quorum","rw":"quorum","small_vclock":50,"w":"quorum","young_vclock":20}}
> 
> 
> I modified the commercial bucket properties. Good spot on the dvv_enabled. I 
> updated with:
> 
> riak-admin bucket-type update commercial '{"props":{"last_write_wins":true, 
> "allow_mult":false, "dvv_enabled":false, "basic_quorum":true, 
> "notfound_ok":false}}'
> 
> Any idea on what this crash report means?
> 
> And how do I merge locally?
> 
> 2017-06-26 09:39:17 =CRASH REPORT
>  crasher:
>initial call: riak_kv_get_fsm:init/1
>pid: <0.29113.100>
>registered_name: []
>exception exit: 
> {{function_clause,[{riak_object,merge_contents,[{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"SC412063">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,50,51,118,107,78,122,101,98,57,52,73,81,65,87,100,112,109,86,102,99,97,82]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,933827,646892}]],[],[[<<"charset">>,117,116,102,45,56],[<<"X-Riak-Meta">>]]}}},<<"{\"company\":\"SC412063\",\"identification\":{\"companyNo\":\"SC412063\",\"name\":\"TCS
>  0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
> C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
> C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
> 1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false},
>\"groupstructure\": {\"shareholder\": [{\"shareholderType\": 
> \"P\",\"title\": \"MR\",\"forename\": \"Veronica\",\"initial\": 
> \"J\",\"surname\": \"DEF\",\"percentageOfOrdinary\": 
> 15.5},{\"shareholderType\": \"P\",\"title\": \"MR\",\"forename\": \"NICHOLAS 
> ANTHONY\",\"initial\": \"J\",\"surname\": \"VIS\",\"percentageOfOrdinary\": 
> 15.5}]}}">>}],[{<<90,0,32,188,84,53,62,38>>,{1,63662153027}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"SC412063">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,50,51,118,107,78,122,101,98,57,52,73,81,65,87,100,112,109,86,102,99,97,82]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,933827,646892}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"SC412063\",\"identification\":{\"companyNo\":\"SC412063\",\"name\":\"TCS
>  0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
> C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
> C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
> 1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false},
>\"groupstructure\": {\"shareholder\": [{\"shareholderType\": 
> \"P\",\"title\": \"MR\",\"forename\": \"Veronica\",\"initial\": 
> \"J\",\"surname\": \"DEF\",\"percentageOfOrdinary\": 
> 15.5},{\"shareholderType\": \"P\",\"title\": \"MR\",\"forename\": \"NICHOLAS 
> ANTHONY\",\"initial\": \"J\",\"surname\": \"VIS\",\"percentageOfOrdinary\": 
> 15.5}]}}">>}],[{<<90,0,32,188,84,53,62,38>>,{1,63662153027}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},<<"false">>],[{file,"src/riak_object.erl"},{line,306}]},{timer,tc,2,[{file,"timer.erl"},{line

RE: [IE] Re: merge_contents error

[Mark Richard Thomas]

Hello

Riak version 2.2.3

Yes, this is related to a cluster restore from backup.

.../types/commercial/props

{"props":{"name":"commercial_systest","active":true,"allow_mult":false,"basic_quorum":true,"big_vclock":50,"chash_keyfun":{"mod":"riak_core_util","fun":"chash_std_keyfun"},"claimant":"r...@wrkd1lrkd002.app.c9.equifax.com","dvv_enabled":false,"dw":"quorum","last_write_wins":true,"linkfun":{"mod":"riak_kv_wm_link_walker","fun":"mapreduce_linkfun"},"n_val":3,"notfound_ok":false,"old_vclock":86400,"postcommit":[],"pr":0,"precommit":[],"pw":0,"r":"quorum","rw":"quorum","small_vclock":50,"w":"quorum","young_vclock":20}}


I modified the commercial bucket properties. Good spot on the dvv_enabled. I 
updated with:

riak-admin bucket-type update commercial '{"props":{"last_write_wins":true, 
"allow_mult":false, "dvv_enabled":false, "basic_quorum":true, 
"notfound_ok":false}}'

Any idea on what this crash report means?

And how do I merge locally?

2017-06-26 09:39:17 =CRASH REPORT
  crasher:
initial call: riak_kv_get_fsm:init/1
pid: <0.29113.100>
registered_name: []
exception exit: 
{{function_clause,[{riak_object,merge_contents,[{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"SC412063">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<"X-Riak-VTag">>,50,51,118,107,78,122,101,98,57,52,73,81,65,87,100,112,109,86,102,99,97,82]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,933827,646892}]],[],[[<<"charset">>,117,116,102,45,56],[<<"X-Riak-Meta">>]]}}},<<"{\"company\":\"SC412063\",\"identification\":{\"companyNo\":\"SC412063\",\"name\":\"TCS
 0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"
 
2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false},
   \"groupstructure\": {\"shareholder\": [{\"shareholderType\": 
\"P\",\"title\": \"MR\",\"forename\": \"Veronica\",\"initial\": 
\"J\",\"surname\": \"DEF\",\"percentageOfOrdinary\": 
15.5},{\"shareholderType\": \"P\",\"title\": \"MR\",\"forename\": \"NICHOLAS 
ANTHONY\",\"initial\": \"J\",\"surname\": \"VIS\",\"percentageOfOrdinary\": 
15.5}]}}">>}],[{<<90,0,32,188,84,53,62,38>>,{1,63662153027}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},{r_object,{<<"commercial">>,<<"commercial_danda">>},<<"SC412063">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,97,112,112,108,105,99,97,116,105,111,110
 
,47,106,115,111,110],[<<"X-Riak-VTag">>,50,51,118,107,78,122,101,98,57,52,73,81,65,87,100,112,109,86,102,99,97,82]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1494,933827,646892}]],[],[[<<"X-Riak-Meta">>],[<<"charset">>,117,116,102,45,56]]}}},<<"{\"company\":\"SC412063\",\"identification\":{\"companyNo\":\"SC412063\",\"name\":\"TCS
 0\",\"alpha\":\"TCS\",\"roAddress\":{\"line1\":\"st cross street 
C\",\"line2\":\"ross Road T\",\"line3\":\"hiruvanmayur 
C\",\"line4\":\"hennai\",\"postCode\":\"cb6 
1ad\",\"kpostcode\":\"cb61ad\"},\"accountReferenceDate\":\"3004\",\"incorporationDate\":\"2009-01-01\",\"returnMadeUpDate\":\"2009-03-03\",\"latestAccountsFiledDate\":\"2009-02-02\",\"accountsType\":5,\"latestAnalysedAccountDate\":\"2008-04-30\",\"nextAnnualReturnDue\":\"2010-03-31\",\"companyType\":\"0\",\"companyTypeDescription\":\"Other\",\"dissolved\":false},
   \"groupstructure\": {\"shareholder\": [{\"shareholderType\": 
\"P\",\"title\": \"MR\",\"forename\": \"Veronica\",\"initial\": 
 \"J\",\"surname\": \"DEF\",\"percentageOfOrdinary\": 
15.5},{\"shareholderType\": \"P\",\"title\": \"MR\",\"forename\": \"NICHOLAS 
ANTHONY\",\"initial\": \"J\",\"surname\": \"VIS\",\"percentageOfOrdinary\": 
15.5}]}}">>}],[{<<90,0,32,188,84,53,62,38>>,{1,63662153027}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},<<"false">>],[{file,"src/riak_object.erl"},{line,306}]},{timer,tc,2,[{file,"timer.erl"},{line,179}]},{riak_object,merge,2,[{file,"src/riak_object.erl"},{line,279}]},{lists,foldl,3,[{file,"lists.erl"},{line,1248}]},{riak_object,reconcile,2,[{file,"src/riak_object.erl"},{line,208}]},{riak_kv_get_core,merge,2,[{file,"src/riak_kv_get_core.erl"},{line,262}]},{riak_kv_get_core,final_action,1,[{file,"src/riak_kv_get_core.erl"},{line,193}]},{riak_kv_get_fsm,finalize,1

Re: merge_contents error

[Russell Brown]

Ah wait, no, I see it, you seem to have set the DVV enabled bucket property to 
the binary <<“false”>>, it should be a boolean atom, either ‘true' or ‘false’.

Something weird has gone on in your bucket props validation, though, as that 
should have been caught or coerced to binary long before this point. How did 
you set that bucket property on this bucket?

Cheers

Russell

On 26 Jun 2017, at 10:03, Russell Brown  wrote:

> Hi Mark,
> It’s an error that means there is no function clause in 
> riak_object:merge_contents that matches the given arguments. It is hard to 
> tell from the snippet of log you posted what the issue is here since the 
> arguments are truncated. Is this related to you cluster restore from a 
> backup? It looks like it is related to your periodic read timeouts. 
> 
> What version of Riak are you running, and what are the bucket properties for 
> this object? Is there more information in the error log, any messages about 
> hd([]) for example?
> 
> Can you grab the actual object in questions from each of the primary vnodes 
> and in some console manually run the merge function and see what the results 
> are? If you need help with how to do this let me know.
> 
> Cheers
> 
> Russell
> 
> On 26 Jun 2017, at 09:34, Mark Richard Thomas  wrote:
> 
>> Hello
>> 
>> I'm seeing the following error message for a number of objects:
>> 
>> console.log:2017-06-26 02:06:00.351 [error] <0.12343.73> gen_fsm 
>> <0.12343.73> in state waiting_vnode_r terminated with reason: no function 
>> clause matching 
>> riak_object:merge_contents({r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
>>  
>> {r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
>>  <<"false">>) line 306
>> 
>> What does "no function clause matching riak_object:merge_contents" mean?
>> 
>> Thanks
>> 
>> Mark
>> 
>> Mark Thomas 
>> Technical Lead, UK IT
>> Equifax Inc.
>> 
>> O +44 (0)7908 798 270
>> mark.tho...@equifax.com 
>> 
>>  
>> 
>> Equifax Limited is registered in England with Registered No. 2425920. 
>> Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax 
>> Limited is authorised and regulated by the Financial Conduct Authority.
>> Equifax Touchstone Limited is registered in Scotland with Registered No. 
>> SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, 
>> EH3 8EH.
>> Equifax Commercial Services Limited is registered in the Republic of Ireland 
>> with Registered No. 215393. Registered Office: IDA Business & Technology 
>> Park, Rosslare Road, Drinagh, Wexford.
>> 
>> This message contains information from Equifax which may be confidential and 
>> privileged. If you are not an intended recipient, please refrain from any 
>> disclosure, copying, distribution or use of this information and note that 
>> such actions are prohibited. If you have received this transmission in 
>> error, please notify by e-mail postmas...@equifax.com.
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> 
> 
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: merge_contents error

[Russell Brown]

Hi Mark,
It’s an error that means there is no function clause in 
riak_object:merge_contents that matches the given arguments. It is hard to tell 
from the snippet of log you posted what the issue is here since the arguments 
are truncated. Is this related to you cluster restore from a backup? It looks 
like it is related to your periodic read timeouts. 

What version of Riak are you running, and what are the bucket properties for 
this object? Is there more information in the error log, any messages about 
hd([]) for example?

Can you grab the actual object in questions from each of the primary vnodes and 
in some console manually run the merge function and see what the results are? 
If you need help with how to do this let me know.

Cheers

Russell

On 26 Jun 2017, at 09:34, Mark Richard Thomas  wrote:

> Hello
>  
> I'm seeing the following error message for a number of objects:
>  
> console.log:2017-06-26 02:06:00.351 [error] <0.12343.73> gen_fsm <0.12343.73> 
> in state waiting_vnode_r terminated with reason: no function clause matching 
> riak_object:merge_contents({r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
>  
> {r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
>  <<"false">>) line 306
>  
> What does "no function clause matching riak_object:merge_contents" mean?
>  
> Thanks
>  
> Mark
>  
> Mark Thomas 
> Technical Lead, UK IT
> Equifax Inc.
>  
> O +44 (0)7908 798 270
> mark.tho...@equifax.com 
> 
>  
>  
> Equifax Limited is registered in England with Registered No. 2425920. 
> Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax 
> Limited is authorised and regulated by the Financial Conduct Authority.
> Equifax Touchstone Limited is registered in Scotland with Registered No. 
> SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 
> 8EH.
> Equifax Commercial Services Limited is registered in the Republic of Ireland 
> with Registered No. 215393. Registered Office: IDA Business & Technology 
> Park, Rosslare Road, Drinagh, Wexford.
>  
> This message contains information from Equifax which may be confidential and 
> privileged. If you are not an intended recipient, please refrain from any 
> disclosure, copying, distribution or use of this information and note that 
> such actions are prohibited. If you have received this transmission in error, 
> please notify by e-mail postmas...@equifax.com.
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

merge_contents error

[Mark Richard Thomas]

Hello

I'm seeing the following error message for a number of objects:

console.log:2017-06-26 02:06:00.351 [error] <0.12343.73> gen_fsm <0.12343.73> 
in state waiting_vnode_r terminated with reason: no function clause matching 
riak_object:merge_contents({r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
 
{r_object,{<<"commercial">>,<<"precalculatedchar">>},<<"2065">>,[{r_content,{dict,7,16,16,8,...},...}],...},
 <<"false">>) line 306

What does "no function clause matching riak_object:merge_contents" mean?

Thanks

Mark

Mark Thomas
Technical Lead, UK IT
Equifax Inc.

O +44 (0)7908 798 270
mark.tho...@equifax.com
[cid:image001.png@01D2EE5F.67181120]
[cid:image005.png@01D2C8D0.9963C110] 
[cid:image006.png@01D2C8D0.9963C110] 


Equifax Limited is registered in England with Registered No. 2425920. 
Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax 
Limited is authorised and regulated by the Financial Conduct Authority.
Equifax Touchstone Limited is registered in Scotland with Registered No. 
SC113401. Registered Office: Exchange Tower,19 Canning Street, Edinburgh, EH3 
8EH.
Equifax Commercial Services Limited is registered in the Republic of Ireland 
with Registered No. 215393. Registered Office: IDA Business & Technology Park, 
Rosslare Road, Drinagh, Wexford.

This message contains information from Equifax which may be confidential and 
privileged. If you are not an intended recipient, please refrain from any 
disclosure, copying, distribution or use of this information and note that such 
actions are prohibited. If you have received this transmission in error, please 
notify by e-mail postmas...@equifax.com.
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com