We fixed a similar issue as part of Drill 1.2. Can you give it a try to see
if your problem is effectively resolved ?

Thanks

On Thu, Oct 8, 2015 at 8:33 AM, John Omernik <[email protected]> wrote:

> I am on the MapR Packaged version of 1.1.  Do you still need the
> sys.version?
>
> On Thu, Oct 8, 2015 at 10:13 AM, Abdel Hakim Deneche <
> [email protected]>
> wrote:
>
> > Hey John,
> >
> > The error you are seeing is a memory leak. Drill's allocator found that
> > about 1MB of allocated memory wasn't released at the end of the
> fragment's
> > execution.
> >
> > What version of Drill are you using ? can you share the result of:
> >
> > select * from sys.version;
> >
> > Thanks
> >
> > On Thu, Oct 8, 2015 at 7:35 AM, John Omernik <[email protected]> wrote:
> >
> > > I am trying to complete a test case on some data. I took a schema and
> > used
> > > log-synth (thanks Ted) to create fairly wide table.  (89 columns).  I
> > then
> > > outputted my data as csv files, and created a drill view, so far so
> good.
> > >
> > > One of the columns is a "date" column, (YYYY-MM-DD) format and has 1216
> > > unique values. To me this would be like a 4 ish years of daily
> > partitioned
> > > data in hive, so tried to created my data partiioning on that field.
> > >
> > > If I create a Parquet table based on that, eventually things hork on me
> > and
> > > I get the error below.  If I don't use the PARTITION BY clause, it
> > creates
> > > the table just fine with 30 files.
> > >
> > > Looking in the folder it was supposed to create the PARTITIONED table,
> it
> > > has over 20K files in there.  Is this expected? Would we expect
> > #Partitions
> > > * #Fragment files? Could this be what the error is trying to tell me?
>  I
> > > guess I am just lost on what the error means, and what I should/could
> > > expect on something like this.  Is this a bug or expected?
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Error:
> > >
> > > java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR:
> > > IllegalStateException: Failure while closing accountor.  Expected
> private
> > > and shared pools to be set to initial values.  However, one or more
> were
> > > not.  Stats are
> > >
> > > zone init allocated delta
> > >
> > > private 1000000 1000000 0
> > >
> > > shared 9999000000 9997806954 1193046.
> > >
> > >
> > > Fragment 1:25
> > >
> > >
> > > [Error Id: cad06490-f93e-4744-a9ec-d27cd06bc0a1 on
> > > hadoopmapr1.mydata.com:31010]
> > >
> > > at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
> > >
> > > at
> > >
> > >
> >
> sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:87)
> > >
> > > at sqlline.TableOutputFormat.print(TableOutputFormat.java:118)
> > >
> > > at sqlline.SqlLine.print(SqlLine.java:1583)
> > >
> > > at sqlline.Commands.execute(Commands.java:852)
> > >
> > > at sqlline.Commands.sql(Commands.java:751)
> > >
> > > at sqlline.SqlLine.dispatch(SqlLine.java:738)
> > >
> > > at sqlline.SqlLine.begin(SqlLine.java:612)
> > >
> > > at sqlline.SqlLine.start(SqlLine.java:366)
> > >
> > > at sqlline.SqlLine.main(SqlLine.java:259)
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> >   <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>



-- 

Abdelhakim Deneche

Software Engineer

  <http://www.mapr.com/>


Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>

Reply via email to