Jacques, I will look into it at some point this week, as it is a side project I might not get time to do it until later in the week, and as I am not overly familiar with Java profiling I will need to work out that part too!
Will get back to you when I know more. -- Stefan On Sat, May 14, 2016 at 4:49 PM Jacques Nadeau <jacq...@dremio.com> wrote: > Any chance you can do a jmap/jhat combo and take a look at what is holding > the most memory? I'm guessing we're not managing the Postgres JDBC cursor > or backpressure correctly. > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Fri, May 13, 2016 at 9:07 AM, Stefan Sedich <stefan.sed...@gmail.com> > wrote: > > > Just trying to do a CTAS on a postgres table, it is not huge and only has > > 16 odd million rows, I end up with an out of memory after a while. > > > > Unable to handle out of memory condition in FragmentExecutor. > > > > java.lang.OutOfMemoryError: GC overhead limit exceeded > > > > > > Is there a way to avoid this without needing to do the CTAS on a subset > of > > my table? > > >
