Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
thank you very much for running an analysis Bruno.  i appreciate the time you have put into it i redeploy the apps but always have to restart the server afterwards as some apps get jammed.  i was considering deploying using tomee-maven-plugin if possible to start new instance directly from

Re: heap dump bval

2018-12-27 Thread Bruno Baptista
I see 20 org.apache.bval.cdi.BValExtension instances. This seems consistent with the apps you are deploying in there. Do you do redeploys of running apps? Most of the usage is in cached objects: Class Name | Objects | Shallow Heap | Retained Heap | Percentage

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
11 datasources and 21 webapps.  i have been considering merging everything into around 5 webapps.  it was useful to split it up at one point of the development but now it seems unnecessary.  does having lots of webapps have a bad effect on performance? On 27/12/2018 17:18, Bruno Baptista

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
is there a way to clear sensitive data out of a heap dump? On 27/12/2018 16:35, German Gonzalez-Morris wrote: Ok. I understand. I can delete it so there is no misunderstanding about it. Regards, German Gonzalez-Morris ``Antes de imprimir este e-mail piense bien si es realmente

Re: heap dump bval

2018-12-27 Thread Bruno Baptista
This has all the memory contents. Yes, will delete afterwards. Visual VM in useless with this, Eclipse Memory Analyzer works and it seems a lot faster. There is definitely an issue around "org.apache.bval.cdi.BValExtension" and "org.apache.webbeans.container.BeanManagerImpl". How many

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
yes please On 27/12/2018 16:35, German Gonzalez-Morris wrote: Ok. I understand. I can delete it so there is no misunderstanding about it. Regards, German Gonzalez-Morris ``Antes de imprimir este e-mail piense bien si es realmente necesario'' ``Before printing think about the

Re: heap dump bval

2018-12-27 Thread German Gonzalez-Morris
Ok. I understand. I can delete it so there is no misunderstanding about it. Regards, German Gonzalez-Morris ``Antes de imprimir este e-mail piense bien si es realmente necesario'' ``Before printing think about the Environment'' On Thu, Dec 27, 2018 at 12:27 PM Matthew Broadhead wrote:

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
it is just dawning on me how much sensitive information is in these heap dumps.  i probably should have asked before but will you keep it private?  i thought there was only object sizes and stuff but it is all in there... On 27/12/2018 15:43, German Gonzalez-Morris wrote: I see a lot of

Re: heap dump bval

2018-12-27 Thread German Gonzalez-Morris
I see a lot of org.apache.bval.MetaBeanCache that handles org.apache.bval.cdi.BValExtension With EclipseMAT can show the retained heap. Regards, German Gonzalez-Morris ``Antes de imprimir este e-mail piense bien si es realmente necesario'' ``Before printing think about the Environment''

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
i wondered if it was actually doing anything because activity monitor wasn't showing visualvm using the processor or memory.  so i checked the log file and got this WARNING [org.netbeans.modules.progress.spi.InternalHandle]: Cannot call progress on a task that was never started at

Re: heap dump bval

2018-12-27 Thread Matthew Broadhead
thanks Bruno.  i have started doing it this end as well as i didn't realise it was important to compute the retained values.  eclipse memory analyser seems to have the retained values after loading but maybe doesn't drill far enough in On 27/12/2018 10:23, Bruno Baptista wrote: Hi Matthew,

Re: heap dump bval

2018-12-27 Thread Bruno Baptista
Hi Matthew, I've loaded the heap profile here but its taking hours to compute the retained values. I'm tempted to cancel and try the Java 11 version to see if it's faster... Cheers Bruno Baptista https://twitter.com/brunobat_ On 26/12/18 12:17, Matthew Broadhead wrote: whoops...i sent my

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
thanks Jon On 26/12/2018 14:28, Jonathan Gallimore wrote: It would be tomorrow before I can take a look, but feel free to add me to that share and I'll take a look when I can. Jon On Wed, 26 Dec 2018, 13:27 Matthew Broadhead thanks German. i added you to the google drive share. i have got

Re: heap dump bval

2018-12-26 Thread Jonathan Gallimore
It would be tomorrow before I can take a look, but feel free to add me to that share and I'll take a look when I can. Jon On Wed, 26 Dec 2018, 13:27 Matthew Broadhead thanks German. i added you to the google drive share. > i have got visualvm working now and it seems i already have a lot of >

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
thanks German.  i added you to the google drive share. i have got visualvm working now and it seems i already have a lot of memory leaks with using @ViewScoped MyFaces managed beans. uk.me.kissy.database.entities.jpa.extras.Testimonial looks like the worst offender On 26/12/2018 13:35,

Re: heap dump bval

2018-12-26 Thread German Gonzalez-Morris
It would be nice to take a look to that heap dump. Regards, German Gonzalez-Morris ``Antes de imprimir este e-mail piense bien si es realmente necesario'' ``Before printing think about the Environment'' On Wed, Dec 26, 2018 at 9:19 AM Bruno Baptista wrote: > Thanks Matthew! > > Bruno

Re: heap dump bval

2018-12-26 Thread Bruno Baptista
Thanks Matthew! Bruno Baptista https://twitter.com/brunobat_ On 26/12/18 12:01, Matthew Broadhead wrote: hi Bruno, no i am not directly using BVal as far as i am aware i zipped it to under 600MB.  i shared you and Jean-Louis a link via google drive.  let me know if there are any problems

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
whoops...i sent my localhost version by mistake.  i am uploading the production one now which zipped to 900MB On 26/12/2018 13:01, Matthew Broadhead wrote: hi Bruno, no i am not directly using BVal as far as i am aware i zipped it to under 600MB.  i shared you and Jean-Louis a link via google

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
hi Bruno, no i am not directly using BVal as far as i am aware i zipped it to under 600MB.  i shared you and Jean-Louis a link via google drive.  let me know if there are any problems On 26/12/2018 12:31, Bruno Baptista wrote: Hi Mathew, Thanks. Are you including some bval dependency in the

Re: heap dump bval

2018-12-26 Thread Bruno Baptista
Hi Mathew, Thanks. Are you including some bval dependency in the code of your own app? You can zip that file. It will get much smaller. If you could share it, it would be nice indeed. Cheers! Bruno Baptista https://twitter.com/brunobat_ On 26/12/18 11:27, Matthew Broadhead wrote: the

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
the top 4 classes on the dominator table are class - objects - retained heap - percentage org.apache.bval.cdi.BValExtension - 27 - 785,781,368 - 50.38% org.apache.webbeans.container.BeanManagerImpl - 27 - 262,583,784 - 16.84% org.apache.openjpa.kernel.FinalizingBrokerImpl - 6,643 - 81,369,760 -

Re: heap dump bval

2018-12-26 Thread Bruno Baptista
Hi Matthew It comes with the JDK, just type: $ jvisualvm But that BValExtension usage is intriguing. Can you please let us know the top 4 classes in the retained list? This is on 7.0.5 plus with Oracle JDK 8? Cheers Bruno Baptista https://twitter.com/brunobat_ On 26/12/18 11:10, Matthew

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
it is TomEE plus 7.0.5.  shows BVal 1.1.2 in my maven dependencies i did wonder if  7.1.0 might have some improvements. On 26/12/2018 12:14, Jean-Louis Monteiro wrote: Can you provide us with the version? BVal I mean ... -- Jean-Louis Monteiro http://twitter.com/jlouismonteiro

Re: heap dump bval

2018-12-26 Thread Matthew Broadhead
thanks Jean-Louis. i used gdb to get a jvm.core on the live system as it is much faster.  then i used jmap to convert it to a jvm.hprof. (https://www.atlassian.com/blog/archives/so-you-want-your-jvms-heap) then i used eclipse memory analyser to get the dominator table, and paths to GC root

Re: heap dump bval

2018-12-26 Thread Jean-Louis Monteiro
Can you provide us with the version? BVal I mean ... -- Jean-Louis Monteiro http://twitter.com/jlouismonteiro http://www.tomitribe.com On Wed, Dec 26, 2018 at 12:10 PM Matthew Broadhead wrote: > hi Bruno, > > i can't find visualvm in centos. i had it in ubuntu but i don't know > which centos

Re: heap dump bval

2018-12-26 Thread Jean-Louis Monteiro
I'd say probably before going too deep, I would just use the verbose:gc option piped into a log file so it can be further analyzed. It should show a memory increase to confirm. Also when it gets slow, probably a jstack could also help to see where the threads are. As for the head dump, I also

Re: heap dump bval

2018-12-26 Thread Bruno Baptista
Thant's interesting Matthew. Usually I open those in jvisualvm. I go to classes and activate the retained column. That column will calculate the retained (effective) memory usage by class. Usually it takes a while to calculate, that's why it's not on by default. Cheers Bruno Baptista

heap dump bval

2018-12-26 Thread Matthew Broadhead
TomEE 7.0.5 plus i had a recent memory leak which was stalling the server every couple of days.  so i did a heap dump and solved that problem. then i decided to do another heap dump because the server is running pretty slowly.  each page is taking a few seconds to load on a 32GB system.  (i