Re: Reproducible InternalError in lambda stuff
On Sep 16, 2013, at 2:59 AM, Charles Oliver Nutter wrote: > On Mon, Sep 16, 2013 at 2:36 AM, John Rose wrote: >> I have refreshed mlvm-dev and pushed some patches to it which may address >> this problem. > > I'll get a build put together and see if I can get users to test it. > >> If you have time, please give them a try. Do "hg qgoto meth-lfc.patch". >> >> If this stuff helps we would like to work towards a fix in 7u. >> >> What is your time frame for JRuby 1.7.5? > > It is on hold indefinitely while we work out user-reported issues > (most are not 7u40-related, but we'd like to have an answer for those > before release too). > > I've attached one user's hs_err dump. This was with a 4GB heap. Code > cache full You mean perm gen, right? > and failing spectacularly? > > - Charlie > ___ > mlvm-dev mailing list > mlvm-dev@openjdk.java.net > http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
On Mon, Sep 16, 2013 at 2:36 AM, John Rose wrote: > I have refreshed mlvm-dev and pushed some patches to it which may address > this problem. I'll get a build put together and see if I can get users to test it. > If you have time, please give them a try. Do "hg qgoto meth-lfc.patch". > > If this stuff helps we would like to work towards a fix in 7u. > > What is your time frame for JRuby 1.7.5? It is on hold indefinitely while we work out user-reported issues (most are not 7u40-related, but we'd like to have an answer for those before release too). I've attached one user's hs_err dump. This was with a 4GB heap. Code cache full and failing spectacularly? - Charlie hs_err_pid1184.log Description: Binary data ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
On Sep 14, 2013, at 12:55 PM, Charles Oliver Nutter wrote: > We are getting many reports of memory issues under u40 running appear with > indy support. Some seem to go away with bigger heaps, but others are still > eventually failing. This is a very high priority for us because we had hoped > to release JRuby 1.7.5 with indy enabled (finally) and that may not be > possible. > I have refreshed mlvm-dev and pushed some patches to it which may address this problem. If you have time, please give them a try. Do "hg qgoto meth-lfc.patch". If this stuff helps we would like to work towards a fix in 7u. What is your time frame for JRuby 1.7.5? — John___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
We are getting many reports of memory issues under u40 running appear with indy support. Some seem to go away with bigger heaps, but others are still eventually failing. This is a very high priority for us because we had hoped to release JRuby 1.7.5 with indy enabled (finally) and that may not be possible. On Sep 14, 2013 3:07 PM, "David Chase" wrote: > I am not sure, but it seemed like "something" bad floated into jdk8 for a > little while, and then floated back out again. > I haven't kept close enough track of the gc-dev mailing list, but for a > few days I was frequently running out of memory when I had not been before > (i.e., doing a build, or simply initializing some of the internal tests) -- > this on a machine where when I checked, at least 4G was free for the taking. > > Something happened, and the problems went away. > > On 2013-09-13, at 6:59 PM, Charles Oliver Nutter > wrote: > > > On Sat, Sep 14, 2013 at 12:57 AM, Charles Oliver Nutter > > wrote: > >> * More memory required when running with indy versus without, all > >> other things kept constant (reproduced by two people, one of them me) > > > > I should say *significantly more* memory here. The app Alex was > > running had to go from 1GB heap / 256MB permgen to 2G/512M when it was > > running *fine* before...and this is just for running the *tests*. > > > > - Charlie > > ___ > > mlvm-dev mailing list > > mlvm-dev@openjdk.java.net > > http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev > > > ___ > mlvm-dev mailing list > mlvm-dev@openjdk.java.net > http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev > > ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
I've been trying our app/language runtime on 7u40 and we're seeing a similar increase needed in PermGen, and some increase needed to heap memory. Seem to have taken about a 10% performance hit on large application benchmarks as well, but I'd need to do some more runs to be really sure of that. On 13/09/2013 23:59, "Charles Oliver Nutter" wrote: >On Sat, Sep 14, 2013 at 12:57 AM, Charles Oliver Nutter > wrote: >> * More memory required when running with indy versus without, all >> other things kept constant (reproduced by two people, one of them me) > >I should say *significantly more* memory here. The app Alex was >running had to go from 1GB heap / 256MB permgen to 2G/512M when it was >running *fine* before...and this is just for running the *tests*. > >- Charlie >___ >mlvm-dev mailing list >mlvm-dev@openjdk.java.net >http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
I am not sure, but it seemed like "something" bad floated into jdk8 for a little while, and then floated back out again. I haven't kept close enough track of the gc-dev mailing list, but for a few days I was frequently running out of memory when I had not been before (i.e., doing a build, or simply initializing some of the internal tests) -- this on a machine where when I checked, at least 4G was free for the taking. Something happened, and the problems went away. On 2013-09-13, at 6:59 PM, Charles Oliver Nutter wrote: > On Sat, Sep 14, 2013 at 12:57 AM, Charles Oliver Nutter > wrote: >> * More memory required when running with indy versus without, all >> other things kept constant (reproduced by two people, one of them me) > > I should say *significantly more* memory here. The app Alex was > running had to go from 1GB heap / 256MB permgen to 2G/512M when it was > running *fine* before...and this is just for running the *tests*. > > - Charlie > ___ > mlvm-dev mailing list > mlvm-dev@openjdk.java.net > http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev signature.asc Description: Message signed with OpenPGP using GPGMail ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
I've been working on footprint all August. Will post a patch to mlvm this weekend to see if it helps. -- John (on my iPhone) On Sep 13, 2013, at 3:59 PM, Charles Oliver Nutter wrote: > On Sat, Sep 14, 2013 at 12:57 AM, Charles Oliver Nutter > wrote: >> * More memory required when running with indy versus without, all >> other things kept constant (reproduced by two people, one of them me) > > I should say *significantly more* memory here. The app Alex was > running had to go from 1GB heap / 256MB permgen to 2G/512M when it was > running *fine* before...and this is just for running the *tests*. > > - Charlie > ___ > mlvm-dev mailing list > mlvm-dev@openjdk.java.net > http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
On Sat, Sep 14, 2013 at 12:57 AM, Charles Oliver Nutter wrote: > * More memory required when running with indy versus without, all > other things kept constant (reproduced by two people, one of them me) I should say *significantly more* memory here. The app Alex was running had to go from 1GB heap / 256MB permgen to 2G/512M when it was running *fine* before...and this is just for running the *tests*. - Charlie ___ mlvm-dev mailing list mlvm-dev@openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
I do not...but it appears to be tied to getting an OOM when inside lambda code.
We now have a third-party report of the same issue. Because the
internal error appears to nuke the original exception, we don't know
for sure that this is memory-related, but the user did see *other*
threads raise OOM and increasing memory solved it.
https://github.com/jruby/jruby/issues/1014
So...there's two things that are bad things here...
* More memory required when running with indy versus without, all
other things kept constant (reproduced by two people, one of them me)
* InternalError bubbling out and swallowing the cause (reproduced by
the same two people)...this may count as two issues.
My original reproduction did not appear to fire on Java 8, but it also
appeared to run forever...so it's possible that we were at a specific
memory threshold (permgen? normal heap? meatspace?) or Java 8 may be
failing more gracefully.
Feel free to discuss or offer suggestions to Alex on the bug report
above. I will be monitoring.
- Charlie
On Mon, Sep 9, 2013 at 6:21 PM, Christian Thalinger
wrote:
>
> On Sep 6, 2013, at 11:11 PM, Charles Oliver Nutter
> wrote:
>
>> I can reproduce this by running a fairly normalish command in JRuby:
>>
>> (Java::JavaLang::InternalError)
>>guard=Lambda(a0:L,a1:L,a2:L,a3:L,a4:L)=>{
>>
>> t5:I=MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)boolean(a1:L,a2:L,a3:L,a4:L);
>>
>> t6:L=MethodHandleImpl.selectAlternative(t5:I,(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject),(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject));
>>t7:L=MethodHandle.invokeBasic(t6:L,a1:L,a2:L,a3:L,a4:L);t7:L}
>>
>> I think it's happening at an OutOfMemory event (bumping up memory
>> makes it go away), so it may not be a critical issue, but I thought
>> I'd toss it out here.
>
> Do know where it's coming from? -- Chris
>
>>
>> - Charlie
>> ___
>> mlvm-dev mailing list
>> mlvm-dev@openjdk.java.net
>> http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
>
> ___
> mlvm-dev mailing list
> mlvm-dev@openjdk.java.net
> http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
___
mlvm-dev mailing list
mlvm-dev@openjdk.java.net
http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Re: Reproducible InternalError in lambda stuff
On Sep 6, 2013, at 11:11 PM, Charles Oliver Nutter wrote:
> I can reproduce this by running a fairly normalish command in JRuby:
>
> (Java::JavaLang::InternalError)
>guard=Lambda(a0:L,a1:L,a2:L,a3:L,a4:L)=>{
>
> t5:I=MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)boolean(a1:L,a2:L,a3:L,a4:L);
>
> t6:L=MethodHandleImpl.selectAlternative(t5:I,(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject),(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject));
>t7:L=MethodHandle.invokeBasic(t6:L,a1:L,a2:L,a3:L,a4:L);t7:L}
>
> I think it's happening at an OutOfMemory event (bumping up memory
> makes it go away), so it may not be a critical issue, but I thought
> I'd toss it out here.
Do know where it's coming from? -- Chris
>
> - Charlie
> ___
> mlvm-dev mailing list
> mlvm-dev@openjdk.java.net
> http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
___
mlvm-dev mailing list
mlvm-dev@openjdk.java.net
http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
Reproducible InternalError in lambda stuff
I can reproduce this by running a fairly normalish command in JRuby:
(Java::JavaLang::InternalError)
guard=Lambda(a0:L,a1:L,a2:L,a3:L,a4:L)=>{
t5:I=MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)boolean(a1:L,a2:L,a3:L,a4:L);
t6:L=MethodHandleImpl.selectAlternative(t5:I,(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject),(MethodHandle(ThreadContext,IRubyObject,IRubyObject,IRubyObject)IRubyObject));
t7:L=MethodHandle.invokeBasic(t6:L,a1:L,a2:L,a3:L,a4:L);t7:L}
I think it's happening at an OutOfMemory event (bumping up memory
makes it go away), so it may not be a critical issue, but I thought
I'd toss it out here.
- Charlie
___
mlvm-dev mailing list
mlvm-dev@openjdk.java.net
http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev
