Re: [akka-user] Issue with Smallest Mailbox router pool introduced in akka 2.4.2

2016-03-04 Thread Viktor Klang 
I think: regression?

On Fri, Mar 4, 2016 at 1:44 PM, Chris Baxter  wrote:

> Should I create a separate ticket for this?  It appeared to me like the
> issue with AbstractNodeQueue was fixed though.  Am I reading this wrong?
>
> On Friday, March 4, 2016 at 7:38:47 AM UTC-5, √ wrote:
>>
>> Could be related to: https://github.com/akka/akka/issues/19216
>>
>> On Fri, Mar 4, 2016 at 1:26 PM, Chris Baxter  wrote:
>>
>>> I have noticed a strange issue after we upgraded to akka 2.4.2 that
>>> appears sporadically but once it rears its ugly head it basically causes
>>> the server to consume a ton of CPU and we have to restart.  This issue
>>> appears to be with the smallest mailbox pool router.  It gets hung up in
>>> peekNode in AbstractNodeQueue, in that do/while loop:
>>>
>>> protected final Node peekNode() {
>>>
>>> final Node tail = ((Node)Unsafe.instance
>>> .getObjectVolatile(this, tailOffset));
>>>
>>> Node next = tail.next();
>>>
>>> if (next == null && get() != tail) {
>>>
>>> // if tail != head this is not going to change until
>>> producer makes progress
>>>
>>> // we can avoid reading the head and just spin on next
>>> until it shows up
>>>
>>> do {
>>>
>>> next = tail.next();
>>>
>>> } while (next == null);
>>>
>>> }
>>>
>>> return next;
>>>
>>> }
>>>
>>>
>>> I have attached a screenshot of the thread dump from jconsole.  I'm
>>> still in the early stages of debugging this, but would appreciate any info
>>> from the akka team on this.
>>>
>>> --
>>> >> Read the docs: http://akka.io/docs/
>>> >> Check the FAQ:
>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>> >> Search the archives:
>>> https://groups.google.com/group/akka-user
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Akka User List" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to akka-user+...@googlegroups.com.
>>> To post to this group, send email to akka...@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/akka-user.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>>
>> --
>> Cheers,
>> √
>>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Cheers,
√

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Issue with Smallest Mailbox router pool introduced in akka 2.4.2

2016-03-04 Thread Chris Baxter 
Should I create a separate ticket for this?  It appeared to me like the 
issue with AbstractNodeQueue was fixed though.  Am I reading this wrong?  

On Friday, March 4, 2016 at 7:38:47 AM UTC-5, √ wrote:
>
> Could be related to: https://github.com/akka/akka/issues/19216
>
> On Fri, Mar 4, 2016 at 1:26 PM, Chris Baxter  > wrote:
>
>> I have noticed a strange issue after we upgraded to akka 2.4.2 that 
>> appears sporadically but once it rears its ugly head it basically causes 
>> the server to consume a ton of CPU and we have to restart.  This issue 
>> appears to be with the smallest mailbox pool router.  It gets hung up in 
>> peekNode in AbstractNodeQueue, in that do/while loop:
>>
>> protected final Node peekNode() {
>>
>> final Node tail = ((Node)Unsafe.instance.getObjectVolatile(
>> this, tailOffset));
>>
>> Node next = tail.next();
>>
>> if (next == null && get() != tail) {
>>
>> // if tail != head this is not going to change until 
>> producer makes progress
>>
>> // we can avoid reading the head and just spin on next until 
>> it shows up
>>
>> do {
>>
>> next = tail.next();
>>
>> } while (next == null);
>>
>> }
>>
>> return next;
>>
>> }
>>
>>
>> I have attached a screenshot of the thread dump from jconsole.  I'm still 
>> in the early stages of debugging this, but would appreciate any info from 
>> the akka team on this.
>>
>> -- 
>> >> Read the docs: http://akka.io/docs/
>> >> Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>> >> Search the archives: https://groups.google.com/group/akka-user
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to akka-user+...@googlegroups.com .
>> To post to this group, send email to akka...@googlegroups.com 
>> .
>> Visit this group at https://groups.google.com/group/akka-user.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> -- 
> Cheers,
> √
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Issue with Smallest Mailbox router pool introduced in akka 2.4.2

2016-03-04 Thread Viktor Klang 
Could be related to: https://github.com/akka/akka/issues/19216

On Fri, Mar 4, 2016 at 1:26 PM, Chris Baxter  wrote:

> I have noticed a strange issue after we upgraded to akka 2.4.2 that
> appears sporadically but once it rears its ugly head it basically causes
> the server to consume a ton of CPU and we have to restart.  This issue
> appears to be with the smallest mailbox pool router.  It gets hung up in
> peekNode in AbstractNodeQueue, in that do/while loop:
>
> protected final Node peekNode() {
>
> final Node tail = ((Node)Unsafe.instance.getObjectVolatile(
> this, tailOffset));
>
> Node next = tail.next();
>
> if (next == null && get() != tail) {
>
> // if tail != head this is not going to change until producer
> makes progress
>
> // we can avoid reading the head and just spin on next until
> it shows up
>
> do {
>
> next = tail.next();
>
> } while (next == null);
>
> }
>
> return next;
>
> }
>
>
> I have attached a screenshot of the thread dump from jconsole.  I'm still
> in the early stages of debugging this, but would appreciate any info from
> the akka team on this.
>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Cheers,
√

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

[akka-user] Issue with Smallest Mailbox router pool introduced in akka 2.4.2

2016-03-04 Thread Chris Baxter 
I have noticed a strange issue after we upgraded to akka 2.4.2 that appears 
sporadically but once it rears its ugly head it basically causes the server 
to consume a ton of CPU and we have to restart.  This issue appears to be 
with the smallest mailbox pool router.  It gets hung up in peekNode in 
AbstractNodeQueue, in that do/while loop:

protected final Node peekNode() {

final Node tail = ((Node)Unsafe.instance.getObjectVolatile(
this, tailOffset));

Node next = tail.next();

if (next == null && get() != tail) {

// if tail != head this is not going to change until producer 
makes progress

// we can avoid reading the head and just spin on next until it 
shows up

do {

next = tail.next();

} while (next == null);

}

return next;

}


I have attached a screenshot of the thread dump from jconsole.  I'm still 
in the early stages of debugging this, but would appreciate any info from 
the akka team on this.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.