I am working on a fix for Drill-4203 that I would like to have included in 1.5. A user trying to read dates out of a Drill produced parquet file from spark was getting back incorrect data. Unfortunately we have been writing a non-standard format for dates that we have just been reading correctly in our implementation. I am working on correcting the dates automatically if we know that the file was written by Drill. Will be opening a discussion on the parquet list as well to see if they would be okay with including the workaround in parquet-mr so other libraries could read the old files correctly as well.
https://issues.apache.org/jira/browse/DRILL-4203 On Mon, Jan 4, 2016 at 3:59 PM, Abdel Hakim Deneche <adene...@maprtech.com> wrote: > We are seeing an IllegalStateException in one of functional tests > (flatten), I already reported it in DRILL-4246, I think this should be > fixed as part of 1.5 release [1] > > [1] https://issues.apache.org/jira/browse/DRILL-4246 > > On Mon, Jan 4, 2016 at 1:52 PM, Amit Hadke <amit.ha...@gmail.com> wrote: > > > https://issues.apache.org/jira/browse/DRILL-4190 > > https://issues.apache.org/jira/browse/DRILL-4196 > > > > I'm working on a fix for both of these. > > > > On Mon, Jan 4, 2016 at 1:48 PM, Jason Altekruse < > altekruseja...@gmail.com> > > wrote: > > > > > Hello All, > > > > > > With the allocator changes merged and about a month since the last > > release > > > I think it would be good to start a vote soon. I would like to > volunteer > > to > > > be release manager. > > > > > > I know that there were some issues that were identified after the > > transfer > > > patch was merged. I think that these issues should be fixed before we > > cut a > > > release candidate. > > > > > > From looking at the associated JIRAs it looked like there was a > possible > > > short term fix just adjusting the max_query_memory_per_node option, and > > > some more involved work to change how we determine the correct time to > > > spill during external sort. I believe it makes sense to make external > > sort > > > work well with the newly improved memory accounting before cutting a > > > release, but I'm not sure how much work is left to be done there. [1] > > > > > > Please respond with your thoughts on a release soon and any JIRAs you > > would > > > like to include in the release. > > > > > > [1] - https://issues.apache.org/jira/browse/DRILL-4243 > > > > > > Thanks, > > > Jason > > > > > > > > > -- > > Abdelhakim Deneche > > Software Engineer > > <http://www.mapr.com/> > > > Now Available - Free Hadoop On-Demand Training > < > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > >
