Re: Time for the 1.6 Release

[Parth Chandra]

Done - Version in master branch updated to 1.7.0-SNAPSHOT


On Thu, Mar 10, 2016 at 4:46 PM, Jacques Nadeau  wrote:

> You want to roll forward the current branch to 1.7.0-SNAPSHOT so we can
> continue developing/merging stuff?
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
>
>

Re: Time for the 1.6 Release

[Jacques Nadeau]

You want to roll forward the current branch to 1.7.0-SNAPSHOT so we can
continue developing/merging stuff?

--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Thu, Mar 10, 2016 at 4:09 PM, Parth Chandra  wrote:

> Hi guys,
>
>   I've created the 1.6.0 branch and will be rolling out the first release
> candidate as soon as I get the go ahead from the QA team, in the next
> couple of hours.
>
> Thanks
>
> Parth
>
> On Thu, Mar 10, 2016 at 3:20 PM, Parth Chandra 
> wrote:
>
> > It is usually not a good idea to try to rush in a patch at the last
> > minute. One of the reasons for having monthly releases is so people don't
> > have to wait too long for fixes and developers don't rush fixes in.
> > QA is almost done with their validation, so I'm afraid this might have to
> > go into the next release.
> >
> > On Thu, Mar 10, 2016 at 1:19 PM, Jason Altekruse 
> wrote:
> >
> >> I hadn't actually tested out the patch, what I had said was that I could
> >> add a flag to make avro files behave like parquet and JSON, without
> schema
> >> validation. The patch made it so the behavior of directories would be
> >> different from that of individual files, removing the schema
> validation. I
> >> tried applying it just now and it still doesn't appear to make the dirN
> >> columns work, but I don't understand why. I will try to take a look
> >> tonight
> >> and post a patch. It will be up to Parth if he wants to put it in the
> >> release once the full fix is merged.
> >>
> >> Jason Altekruse
> >> Software Engineer at Dremio
> >> Apache Drill Committer
> >>
> >> On Thu, Mar 10, 2016 at 1:09 AM, Stefán Baxter <
> ste...@activitystream.com
> >> >
> >> wrote:
> >>
> >> > Hi,
> >> >
> >> > This issue is still unresolved:
> >> > https://issues.apache.org/jira/browse/DRILL-4120
> >> >
> >> > It would mean a great deal to us if it was.
> >> > The solution is, as I understood Jason and Jacques, ready and only
> >> needs to
> >> > be merged.
> >> >
> >> > Regards,
> >> >  -Stefán
> >> >
> >> > On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra 
> >> wrote:
> >> >
> >> > > Hi everyone,
> >> > >
> >> > >   Just a note to  update everyone that the QA team is testing out
> the
> >> > build
> >> > > from master.
> >> > >   There are no further commits expected for the 1.6.0 release.
> >> > >   The repo is open for commits but try not to break anything :)
> >> > >
> >> > >
> >> > > Parth
> >> > >
> >> > > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra 
> >> wrote:
> >> > >
> >> > > > Okay we are down to the final one -
> >> > > >
> >> > > > DRILL-4482 - Avro no longer selects data correctly from a
> >> > > > sub-structure.(Jason)
> >> > > >
> >> > > > Note that MapR QA team is going to start testing 1.6 snapshot now
> >> > before
> >> > > I
> >> > > > roll out the release candidate. DRILL-4482 can be merged in later
> >> as it
> >> > > is
> >> > > > not likely to affect the  Hopefully there will be no show stoppers
> >> (.
> >> > > >
> >> > > > The plan is to roll out the release candidate by Thursday.
> >> > > >
> >> > > > Thanks
> >> > > >
> >> > > > Parth
> >> > > >
> >> > > >
> >> > > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> >> > wrote:
> >> > > >
> >> > > >> OK, let's leave it out then.
> >> > > >>
> >> > > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> >> > > altekruseja...@gmail.com
> >> > > >> > wrote:
> >> > > >>
> >> > > >>> To be honest I was expecting a longer review cycle so I hadn't
> run
> >> > the
> >> > > >>> unit
> >> > > >>> tests before posting it for review. There were only very minor
> >> > > functional
> >> > > >>> changes, so I wasn't thinking it would be an issue, and I was
> >> > > >>> anticipating
> >> > > >>> having to update the patch before merging it. I could update the
> >> test
> >> > > >>> that
> >> > > >>> is failing but I don't see much sense in trying to get it into
> the
> >> > > >>> release
> >> > > >>> because it only introduces new tests and some small core
> >> refactoring.
> >> > > >>>
> >> > > >>> I'm all for getting it merged so everyone can start using it, I
> >> just
> >> > > >>> think
> >> > > >>> it doesn't really matter if it happens on the release branch or
> >> back
> >> > on
> >> > > >>> master once we cut a release branch.
> >> > > >>>
> >> > > >>> I would rather try to focus on getting the Avro issues resolved,
> >> > which
> >> > > is
> >> > > >>> what I'm working on right now.
> >> > > >>>
> >> > > >>> - Jason
> >> > > >>>
> >> > > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra <
> par...@apache.org>
> >> > > wrote:
> >> > > >>>
> >> > > >>> > Sounds good Jason. Let's finalize this in the hangout.
> >> > > >>> > Do you have the expected plans for the failing tests? If so
> can
> >> you
> >> > > >>> update
> >> > > >>> > those and put in a pull request and we'll merge and run the
> >> tests.
> >> > > >>> > Any reason for the operator test framework to be 

Re: Time for the 1.6 Release

[Parth Chandra]

Hi guys,

  I've created the 1.6.0 branch and will be rolling out the first release
candidate as soon as I get the go ahead from the QA team, in the next
couple of hours.

Thanks

Parth

On Thu, Mar 10, 2016 at 3:20 PM, Parth Chandra 
wrote:

> It is usually not a good idea to try to rush in a patch at the last
> minute. One of the reasons for having monthly releases is so people don't
> have to wait too long for fixes and developers don't rush fixes in.
> QA is almost done with their validation, so I'm afraid this might have to
> go into the next release.
>
> On Thu, Mar 10, 2016 at 1:19 PM, Jason Altekruse  wrote:
>
>> I hadn't actually tested out the patch, what I had said was that I could
>> add a flag to make avro files behave like parquet and JSON, without schema
>> validation. The patch made it so the behavior of directories would be
>> different from that of individual files, removing the schema validation. I
>> tried applying it just now and it still doesn't appear to make the dirN
>> columns work, but I don't understand why. I will try to take a look
>> tonight
>> and post a patch. It will be up to Parth if he wants to put it in the
>> release once the full fix is merged.
>>
>> Jason Altekruse
>> Software Engineer at Dremio
>> Apache Drill Committer
>>
>> On Thu, Mar 10, 2016 at 1:09 AM, Stefán Baxter > >
>> wrote:
>>
>> > Hi,
>> >
>> > This issue is still unresolved:
>> > https://issues.apache.org/jira/browse/DRILL-4120
>> >
>> > It would mean a great deal to us if it was.
>> > The solution is, as I understood Jason and Jacques, ready and only
>> needs to
>> > be merged.
>> >
>> > Regards,
>> >  -Stefán
>> >
>> > On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra 
>> wrote:
>> >
>> > > Hi everyone,
>> > >
>> > >   Just a note to  update everyone that the QA team is testing out the
>> > build
>> > > from master.
>> > >   There are no further commits expected for the 1.6.0 release.
>> > >   The repo is open for commits but try not to break anything :)
>> > >
>> > >
>> > > Parth
>> > >
>> > > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra 
>> wrote:
>> > >
>> > > > Okay we are down to the final one -
>> > > >
>> > > > DRILL-4482 - Avro no longer selects data correctly from a
>> > > > sub-structure.(Jason)
>> > > >
>> > > > Note that MapR QA team is going to start testing 1.6 snapshot now
>> > before
>> > > I
>> > > > roll out the release candidate. DRILL-4482 can be merged in later
>> as it
>> > > is
>> > > > not likely to affect the  Hopefully there will be no show stoppers
>> (.
>> > > >
>> > > > The plan is to roll out the release candidate by Thursday.
>> > > >
>> > > > Thanks
>> > > >
>> > > > Parth
>> > > >
>> > > >
>> > > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
>> > wrote:
>> > > >
>> > > >> OK, let's leave it out then.
>> > > >>
>> > > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
>> > > altekruseja...@gmail.com
>> > > >> > wrote:
>> > > >>
>> > > >>> To be honest I was expecting a longer review cycle so I hadn't run
>> > the
>> > > >>> unit
>> > > >>> tests before posting it for review. There were only very minor
>> > > functional
>> > > >>> changes, so I wasn't thinking it would be an issue, and I was
>> > > >>> anticipating
>> > > >>> having to update the patch before merging it. I could update the
>> test
>> > > >>> that
>> > > >>> is failing but I don't see much sense in trying to get it into the
>> > > >>> release
>> > > >>> because it only introduces new tests and some small core
>> refactoring.
>> > > >>>
>> > > >>> I'm all for getting it merged so everyone can start using it, I
>> just
>> > > >>> think
>> > > >>> it doesn't really matter if it happens on the release branch or
>> back
>> > on
>> > > >>> master once we cut a release branch.
>> > > >>>
>> > > >>> I would rather try to focus on getting the Avro issues resolved,
>> > which
>> > > is
>> > > >>> what I'm working on right now.
>> > > >>>
>> > > >>> - Jason
>> > > >>>
>> > > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
>> > > wrote:
>> > > >>>
>> > > >>> > Sounds good Jason. Let's finalize this in the hangout.
>> > > >>> > Do you have the expected plans for the failing tests? If so can
>> you
>> > > >>> update
>> > > >>> > those and put in a pull request and we'll merge and run the
>> tests.
>> > > >>> > Any reason for the operator test framework to be punted? You
>> have a
>> > > +1
>> > > >>> to
>> > > >>> > merge it.
>> > > >>> >
>> > > >>> >
>> > > >>> >
>> > > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
>> > kfar...@maprtech.com
>> > > >
>> > > >>> > wrote:
>> > > >>> >
>> > > >>> > > We should update the expected results (i.e. the expected query
>> > plan
>> > > >>> in
>> > > >>> > this
>> > > >>> > > case) and not mark them as Failing. We do not have a Failing
>> test
>> > > >>> > directory
>> > > >>> > > today.
>> > > >>> > >
>> > > >>> > > If 

Re: Time for the 1.6 Release

[Parth Chandra]

It is usually not a good idea to try to rush in a patch at the last minute.
One of the reasons for having monthly releases is so people don't have to
wait too long for fixes and developers don't rush fixes in.
QA is almost done with their validation, so I'm afraid this might have to
go into the next release.

On Thu, Mar 10, 2016 at 1:19 PM, Jason Altekruse  wrote:

> I hadn't actually tested out the patch, what I had said was that I could
> add a flag to make avro files behave like parquet and JSON, without schema
> validation. The patch made it so the behavior of directories would be
> different from that of individual files, removing the schema validation. I
> tried applying it just now and it still doesn't appear to make the dirN
> columns work, but I don't understand why. I will try to take a look tonight
> and post a patch. It will be up to Parth if he wants to put it in the
> release once the full fix is merged.
>
> Jason Altekruse
> Software Engineer at Dremio
> Apache Drill Committer
>
> On Thu, Mar 10, 2016 at 1:09 AM, Stefán Baxter 
> wrote:
>
> > Hi,
> >
> > This issue is still unresolved:
> > https://issues.apache.org/jira/browse/DRILL-4120
> >
> > It would mean a great deal to us if it was.
> > The solution is, as I understood Jason and Jacques, ready and only needs
> to
> > be merged.
> >
> > Regards,
> >  -Stefán
> >
> > On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra 
> wrote:
> >
> > > Hi everyone,
> > >
> > >   Just a note to  update everyone that the QA team is testing out the
> > build
> > > from master.
> > >   There are no further commits expected for the 1.6.0 release.
> > >   The repo is open for commits but try not to break anything :)
> > >
> > >
> > > Parth
> > >
> > > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra 
> wrote:
> > >
> > > > Okay we are down to the final one -
> > > >
> > > > DRILL-4482 - Avro no longer selects data correctly from a
> > > > sub-structure.(Jason)
> > > >
> > > > Note that MapR QA team is going to start testing 1.6 snapshot now
> > before
> > > I
> > > > roll out the release candidate. DRILL-4482 can be merged in later as
> it
> > > is
> > > > not likely to affect the  Hopefully there will be no show stoppers (.
> > > >
> > > > The plan is to roll out the release candidate by Thursday.
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > >
> > > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> > wrote:
> > > >
> > > >> OK, let's leave it out then.
> > > >>
> > > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> > > altekruseja...@gmail.com
> > > >> > wrote:
> > > >>
> > > >>> To be honest I was expecting a longer review cycle so I hadn't run
> > the
> > > >>> unit
> > > >>> tests before posting it for review. There were only very minor
> > > functional
> > > >>> changes, so I wasn't thinking it would be an issue, and I was
> > > >>> anticipating
> > > >>> having to update the patch before merging it. I could update the
> test
> > > >>> that
> > > >>> is failing but I don't see much sense in trying to get it into the
> > > >>> release
> > > >>> because it only introduces new tests and some small core
> refactoring.
> > > >>>
> > > >>> I'm all for getting it merged so everyone can start using it, I
> just
> > > >>> think
> > > >>> it doesn't really matter if it happens on the release branch or
> back
> > on
> > > >>> master once we cut a release branch.
> > > >>>
> > > >>> I would rather try to focus on getting the Avro issues resolved,
> > which
> > > is
> > > >>> what I'm working on right now.
> > > >>>
> > > >>> - Jason
> > > >>>
> > > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> > > wrote:
> > > >>>
> > > >>> > Sounds good Jason. Let's finalize this in the hangout.
> > > >>> > Do you have the expected plans for the failing tests? If so can
> you
> > > >>> update
> > > >>> > those and put in a pull request and we'll merge and run the
> tests.
> > > >>> > Any reason for the operator test framework to be punted? You
> have a
> > > +1
> > > >>> to
> > > >>> > merge it.
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
> > kfar...@maprtech.com
> > > >
> > > >>> > wrote:
> > > >>> >
> > > >>> > > We should update the expected results (i.e. the expected query
> > plan
> > > >>> in
> > > >>> > this
> > > >>> > > case) and not mark them as Failing. We do not have a Failing
> test
> > > >>> > directory
> > > >>> > > today.
> > > >>> > >
> > > >>> > > If we are sure the expected query plans for these tests are
> > > incorrect
> > > >>> > > (today), we should go ahead and update the expected results
> files
> > > >>> with
> > > >>> > the
> > > >>> > > correct query plans.
> > > >>> > >
> > > >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > > >>> > > pruning/hierarchical/plan/count2_MD-185.q
> > > >>> > > 

Re: Time for the 1.6 Release

[Stefán Baxter]

thank you

On Thu, Mar 10, 2016 at 9:19 PM, Jason Altekruse  wrote:

> I hadn't actually tested out the patch, what I had said was that I could
> add a flag to make avro files behave like parquet and JSON, without schema
> validation. The patch made it so the behavior of directories would be
> different from that of individual files, removing the schema validation. I
> tried applying it just now and it still doesn't appear to make the dirN
> columns work, but I don't understand why. I will try to take a look tonight
> and post a patch. It will be up to Parth if he wants to put it in the
> release once the full fix is merged.
>
> Jason Altekruse
> Software Engineer at Dremio
> Apache Drill Committer
>
> On Thu, Mar 10, 2016 at 1:09 AM, Stefán Baxter 
> wrote:
>
> > Hi,
> >
> > This issue is still unresolved:
> > https://issues.apache.org/jira/browse/DRILL-4120
> >
> > It would mean a great deal to us if it was.
> > The solution is, as I understood Jason and Jacques, ready and only needs
> to
> > be merged.
> >
> > Regards,
> >  -Stefán
> >
> > On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra 
> wrote:
> >
> > > Hi everyone,
> > >
> > >   Just a note to  update everyone that the QA team is testing out the
> > build
> > > from master.
> > >   There are no further commits expected for the 1.6.0 release.
> > >   The repo is open for commits but try not to break anything :)
> > >
> > >
> > > Parth
> > >
> > > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra 
> wrote:
> > >
> > > > Okay we are down to the final one -
> > > >
> > > > DRILL-4482 - Avro no longer selects data correctly from a
> > > > sub-structure.(Jason)
> > > >
> > > > Note that MapR QA team is going to start testing 1.6 snapshot now
> > before
> > > I
> > > > roll out the release candidate. DRILL-4482 can be merged in later as
> it
> > > is
> > > > not likely to affect the  Hopefully there will be no show stoppers (.
> > > >
> > > > The plan is to roll out the release candidate by Thursday.
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > >
> > > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> > wrote:
> > > >
> > > >> OK, let's leave it out then.
> > > >>
> > > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> > > altekruseja...@gmail.com
> > > >> > wrote:
> > > >>
> > > >>> To be honest I was expecting a longer review cycle so I hadn't run
> > the
> > > >>> unit
> > > >>> tests before posting it for review. There were only very minor
> > > functional
> > > >>> changes, so I wasn't thinking it would be an issue, and I was
> > > >>> anticipating
> > > >>> having to update the patch before merging it. I could update the
> test
> > > >>> that
> > > >>> is failing but I don't see much sense in trying to get it into the
> > > >>> release
> > > >>> because it only introduces new tests and some small core
> refactoring.
> > > >>>
> > > >>> I'm all for getting it merged so everyone can start using it, I
> just
> > > >>> think
> > > >>> it doesn't really matter if it happens on the release branch or
> back
> > on
> > > >>> master once we cut a release branch.
> > > >>>
> > > >>> I would rather try to focus on getting the Avro issues resolved,
> > which
> > > is
> > > >>> what I'm working on right now.
> > > >>>
> > > >>> - Jason
> > > >>>
> > > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> > > wrote:
> > > >>>
> > > >>> > Sounds good Jason. Let's finalize this in the hangout.
> > > >>> > Do you have the expected plans for the failing tests? If so can
> you
> > > >>> update
> > > >>> > those and put in a pull request and we'll merge and run the
> tests.
> > > >>> > Any reason for the operator test framework to be punted? You
> have a
> > > +1
> > > >>> to
> > > >>> > merge it.
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
> > kfar...@maprtech.com
> > > >
> > > >>> > wrote:
> > > >>> >
> > > >>> > > We should update the expected results (i.e. the expected query
> > plan
> > > >>> in
> > > >>> > this
> > > >>> > > case) and not mark them as Failing. We do not have a Failing
> test
> > > >>> > directory
> > > >>> > > today.
> > > >>> > >
> > > >>> > > If we are sure the expected query plans for these tests are
> > > incorrect
> > > >>> > > (today), we should go ahead and update the expected results
> files
> > > >>> with
> > > >>> > the
> > > >>> > > correct query plans.
> > > >>> > >
> > > >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > > >>> > > pruning/hierarchical/plan/count2_MD-185.q
> > > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > > >>> > >
> > > >>> > > Thanks,
> > > >>> > > Khurram
> > > >>> > >
> > > >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> > > >>> > altekruseja...@gmail.com>
> > > >>> > > wrote:
> > > >>> > >
> > 

Re: Time for the 1.6 Release

[Jason Altekruse]

I hadn't actually tested out the patch, what I had said was that I could
add a flag to make avro files behave like parquet and JSON, without schema
validation. The patch made it so the behavior of directories would be
different from that of individual files, removing the schema validation. I
tried applying it just now and it still doesn't appear to make the dirN
columns work, but I don't understand why. I will try to take a look tonight
and post a patch. It will be up to Parth if he wants to put it in the
release once the full fix is merged.

Jason Altekruse
Software Engineer at Dremio
Apache Drill Committer

On Thu, Mar 10, 2016 at 1:09 AM, Stefán Baxter 
wrote:

> Hi,
>
> This issue is still unresolved:
> https://issues.apache.org/jira/browse/DRILL-4120
>
> It would mean a great deal to us if it was.
> The solution is, as I understood Jason and Jacques, ready and only needs to
> be merged.
>
> Regards,
>  -Stefán
>
> On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra  wrote:
>
> > Hi everyone,
> >
> >   Just a note to  update everyone that the QA team is testing out the
> build
> > from master.
> >   There are no further commits expected for the 1.6.0 release.
> >   The repo is open for commits but try not to break anything :)
> >
> >
> > Parth
> >
> > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra  wrote:
> >
> > > Okay we are down to the final one -
> > >
> > > DRILL-4482 - Avro no longer selects data correctly from a
> > > sub-structure.(Jason)
> > >
> > > Note that MapR QA team is going to start testing 1.6 snapshot now
> before
> > I
> > > roll out the release candidate. DRILL-4482 can be merged in later as it
> > is
> > > not likely to affect the  Hopefully there will be no show stoppers (.
> > >
> > > The plan is to roll out the release candidate by Thursday.
> > >
> > > Thanks
> > >
> > > Parth
> > >
> > >
> > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> wrote:
> > >
> > >> OK, let's leave it out then.
> > >>
> > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> > altekruseja...@gmail.com
> > >> > wrote:
> > >>
> > >>> To be honest I was expecting a longer review cycle so I hadn't run
> the
> > >>> unit
> > >>> tests before posting it for review. There were only very minor
> > functional
> > >>> changes, so I wasn't thinking it would be an issue, and I was
> > >>> anticipating
> > >>> having to update the patch before merging it. I could update the test
> > >>> that
> > >>> is failing but I don't see much sense in trying to get it into the
> > >>> release
> > >>> because it only introduces new tests and some small core refactoring.
> > >>>
> > >>> I'm all for getting it merged so everyone can start using it, I just
> > >>> think
> > >>> it doesn't really matter if it happens on the release branch or back
> on
> > >>> master once we cut a release branch.
> > >>>
> > >>> I would rather try to focus on getting the Avro issues resolved,
> which
> > is
> > >>> what I'm working on right now.
> > >>>
> > >>> - Jason
> > >>>
> > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> > wrote:
> > >>>
> > >>> > Sounds good Jason. Let's finalize this in the hangout.
> > >>> > Do you have the expected plans for the failing tests? If so can you
> > >>> update
> > >>> > those and put in a pull request and we'll merge and run the tests.
> > >>> > Any reason for the operator test framework to be punted? You have a
> > +1
> > >>> to
> > >>> > merge it.
> > >>> >
> > >>> >
> > >>> >
> > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
> kfar...@maprtech.com
> > >
> > >>> > wrote:
> > >>> >
> > >>> > > We should update the expected results (i.e. the expected query
> plan
> > >>> in
> > >>> > this
> > >>> > > case) and not mark them as Failing. We do not have a Failing test
> > >>> > directory
> > >>> > > today.
> > >>> > >
> > >>> > > If we are sure the expected query plans for these tests are
> > incorrect
> > >>> > > (today), we should go ahead and update the expected results files
> > >>> with
> > >>> > the
> > >>> > > correct query plans.
> > >>> > >
> > >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > >>> > > pruning/hierarchical/plan/count2_MD-185.q
> > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > >>> > >
> > >>> > > Thanks,
> > >>> > > Khurram
> > >>> > >
> > >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> > >>> > altekruseja...@gmail.com>
> > >>> > > wrote:
> > >>> > >
> > >>> > > > The cutoff time sounds good to me. I don't think I'm too
> > >>> overburdened,
> > >>> > I
> > >>> > > > mostly tried putting together a merge branch today and had to
> > kick
> > >>> a
> > >>> > few
> > >>> > > > things out as I found issues.
> > >>> > > >
> > >>> > > > As we are not running the full regression cluster at Dremio, it
> > >>> would
> > >>> > be
> > >>> > > > helpful 

Re: Time for the 1.6 Release

[Stefán Baxter]

Hi,

This issue is still unresolved:
https://issues.apache.org/jira/browse/DRILL-4120

It would mean a great deal to us if it was.
The solution is, as I understood Jason and Jacques, ready and only needs to
be merged.

Regards,
 -Stefán

On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra  wrote:

> Hi everyone,
>
>   Just a note to  update everyone that the QA team is testing out the build
> from master.
>   There are no further commits expected for the 1.6.0 release.
>   The repo is open for commits but try not to break anything :)
>
>
> Parth
>
> On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra  wrote:
>
> > Okay we are down to the final one -
> >
> > DRILL-4482 - Avro no longer selects data correctly from a
> > sub-structure.(Jason)
> >
> > Note that MapR QA team is going to start testing 1.6 snapshot now before
> I
> > roll out the release candidate. DRILL-4482 can be merged in later as it
> is
> > not likely to affect the  Hopefully there will be no show stoppers (.
> >
> > The plan is to roll out the release candidate by Thursday.
> >
> > Thanks
> >
> > Parth
> >
> >
> > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra  wrote:
> >
> >> OK, let's leave it out then.
> >>
> >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> altekruseja...@gmail.com
> >> > wrote:
> >>
> >>> To be honest I was expecting a longer review cycle so I hadn't run the
> >>> unit
> >>> tests before posting it for review. There were only very minor
> functional
> >>> changes, so I wasn't thinking it would be an issue, and I was
> >>> anticipating
> >>> having to update the patch before merging it. I could update the test
> >>> that
> >>> is failing but I don't see much sense in trying to get it into the
> >>> release
> >>> because it only introduces new tests and some small core refactoring.
> >>>
> >>> I'm all for getting it merged so everyone can start using it, I just
> >>> think
> >>> it doesn't really matter if it happens on the release branch or back on
> >>> master once we cut a release branch.
> >>>
> >>> I would rather try to focus on getting the Avro issues resolved, which
> is
> >>> what I'm working on right now.
> >>>
> >>> - Jason
> >>>
> >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> wrote:
> >>>
> >>> > Sounds good Jason. Let's finalize this in the hangout.
> >>> > Do you have the expected plans for the failing tests? If so can you
> >>> update
> >>> > those and put in a pull request and we'll merge and run the tests.
> >>> > Any reason for the operator test framework to be punted? You have a
> +1
> >>> to
> >>> > merge it.
> >>> >
> >>> >
> >>> >
> >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz  >
> >>> > wrote:
> >>> >
> >>> > > We should update the expected results (i.e. the expected query plan
> >>> in
> >>> > this
> >>> > > case) and not mark them as Failing. We do not have a Failing test
> >>> > directory
> >>> > > today.
> >>> > >
> >>> > > If we are sure the expected query plans for these tests are
> incorrect
> >>> > > (today), we should go ahead and update the expected results files
> >>> with
> >>> > the
> >>> > > correct query plans.
> >>> > >
> >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> >>> > > pruning/hierarchical/plan/count2_MD-185.q
> >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> >>> > >
> >>> > > Thanks,
> >>> > > Khurram
> >>> > >
> >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> >>> > altekruseja...@gmail.com>
> >>> > > wrote:
> >>> > >
> >>> > > > The cutoff time sounds good to me. I don't think I'm too
> >>> overburdened,
> >>> > I
> >>> > > > mostly tried putting together a merge branch today and had to
> kick
> >>> a
> >>> > few
> >>> > > > things out as I found issues.
> >>> > > >
> >>> > > > As we are not running the full regression cluster at Dremio, it
> >>> would
> >>> > be
> >>> > > > helpful if someone could merge Jacques patch (DRILL-4474) after
> >>> running
> >>> > > the
> >>> > > > complete set of tests. Could someone at MapR pick up the test
> >>> updates
> >>> > and
> >>> > > > merging this patch?
> >>> > > >
> >>> > > > These are the failures I was seeing so far, my fix was just going
> >>> to be
> >>> > > to
> >>> > > > mark the tests as failing:
> >>> > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
> >>> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> >>> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> >>> > > >
> >>> > > > I will just go ahead and merge the other two fixes as I had a
> clean
> >>> > unit
> >>> > > > test run and neither of the patches will have any impact on the
> >>> > > regression
> >>> > > > tests. One is a build fix, that only changes behavior when
> running
> >>> the
> >>> > > > 

Re: Time for the 1.6 Release

[Stefán Baxter]

You are correct, it was, sorry.

On Thu, Mar 10, 2016 at 9:02 AM, Abdel Hakim Deneche 
wrote:

> Hey Stefán, I just left a comment in the JIRA. I think the issue is related
> to the double quotes.
>
> On Thu, Mar 10, 2016 at 9:55 AM, Stefán Baxter 
> wrote:
>
> > Hi,
> >
> > I noticed that using the IN operator with a sub structure has stopped
> > working:
> >
> > select s.client_ip.ip from dfs.asa.`/processed/venuepoint/transactions`
> as
> > s where s.client_ip.ip in ("unknown") limit 2;
> > Error: PARSE ERROR: Encountered "\"" at line 1, column 103.
> > Was expecting one of:
> > ...
> > SQL Query select s.client_ip.ip from
> > dfs.asa.`/processed/venuepoint/transactions` as s where s.client_ip.ip in
> > ("2.69.200.113","unknown") limit 2
> >
> >
> >   ^
> > (the hat should point at the _ip part of the where clause)
> >
> > I will report this in Jira and mark it as a blocker.
> >
> > Regards,
> >  -Stefán
> >
> > On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra 
> wrote:
> >
> > > Hi everyone,
> > >
> > >   Just a note to  update everyone that the QA team is testing out the
> > build
> > > from master.
> > >   There are no further commits expected for the 1.6.0 release.
> > >   The repo is open for commits but try not to break anything :)
> > >
> > >
> > > Parth
> > >
> > > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra 
> wrote:
> > >
> > > > Okay we are down to the final one -
> > > >
> > > > DRILL-4482 - Avro no longer selects data correctly from a
> > > > sub-structure.(Jason)
> > > >
> > > > Note that MapR QA team is going to start testing 1.6 snapshot now
> > before
> > > I
> > > > roll out the release candidate. DRILL-4482 can be merged in later as
> it
> > > is
> > > > not likely to affect the  Hopefully there will be no show stoppers (.
> > > >
> > > > The plan is to roll out the release candidate by Thursday.
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > >
> > > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> > wrote:
> > > >
> > > >> OK, let's leave it out then.
> > > >>
> > > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> > > altekruseja...@gmail.com
> > > >> > wrote:
> > > >>
> > > >>> To be honest I was expecting a longer review cycle so I hadn't run
> > the
> > > >>> unit
> > > >>> tests before posting it for review. There were only very minor
> > > functional
> > > >>> changes, so I wasn't thinking it would be an issue, and I was
> > > >>> anticipating
> > > >>> having to update the patch before merging it. I could update the
> test
> > > >>> that
> > > >>> is failing but I don't see much sense in trying to get it into the
> > > >>> release
> > > >>> because it only introduces new tests and some small core
> refactoring.
> > > >>>
> > > >>> I'm all for getting it merged so everyone can start using it, I
> just
> > > >>> think
> > > >>> it doesn't really matter if it happens on the release branch or
> back
> > on
> > > >>> master once we cut a release branch.
> > > >>>
> > > >>> I would rather try to focus on getting the Avro issues resolved,
> > which
> > > is
> > > >>> what I'm working on right now.
> > > >>>
> > > >>> - Jason
> > > >>>
> > > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> > > wrote:
> > > >>>
> > > >>> > Sounds good Jason. Let's finalize this in the hangout.
> > > >>> > Do you have the expected plans for the failing tests? If so can
> you
> > > >>> update
> > > >>> > those and put in a pull request and we'll merge and run the
> tests.
> > > >>> > Any reason for the operator test framework to be punted? You
> have a
> > > +1
> > > >>> to
> > > >>> > merge it.
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
> > kfar...@maprtech.com
> > > >
> > > >>> > wrote:
> > > >>> >
> > > >>> > > We should update the expected results (i.e. the expected query
> > plan
> > > >>> in
> > > >>> > this
> > > >>> > > case) and not mark them as Failing. We do not have a Failing
> test
> > > >>> > directory
> > > >>> > > today.
> > > >>> > >
> > > >>> > > If we are sure the expected query plans for these tests are
> > > incorrect
> > > >>> > > (today), we should go ahead and update the expected results
> files
> > > >>> with
> > > >>> > the
> > > >>> > > correct query plans.
> > > >>> > >
> > > >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > > >>> > > pruning/hierarchical/plan/count2_MD-185.q
> > > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > > >>> > >
> > > >>> > > Thanks,
> > > >>> > > Khurram
> > > >>> > >
> > > >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> > > >>> > altekruseja...@gmail.com>
> > > >>> > > wrote:
> > > >>> > >
> > > >>> > > > The cutoff time sounds good to me. I don't 

Re: Time for the 1.6 Release

[Abdel Hakim Deneche]

Hey Stefán, I just left a comment in the JIRA. I think the issue is related
to the double quotes.

On Thu, Mar 10, 2016 at 9:55 AM, Stefán Baxter 
wrote:

> Hi,
>
> I noticed that using the IN operator with a sub structure has stopped
> working:
>
> select s.client_ip.ip from dfs.asa.`/processed/venuepoint/transactions` as
> s where s.client_ip.ip in ("unknown") limit 2;
> Error: PARSE ERROR: Encountered "\"" at line 1, column 103.
> Was expecting one of:
> ...
> SQL Query select s.client_ip.ip from
> dfs.asa.`/processed/venuepoint/transactions` as s where s.client_ip.ip in
> ("2.69.200.113","unknown") limit 2
>
>
>   ^
> (the hat should point at the _ip part of the where clause)
>
> I will report this in Jira and mark it as a blocker.
>
> Regards,
>  -Stefán
>
> On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra  wrote:
>
> > Hi everyone,
> >
> >   Just a note to  update everyone that the QA team is testing out the
> build
> > from master.
> >   There are no further commits expected for the 1.6.0 release.
> >   The repo is open for commits but try not to break anything :)
> >
> >
> > Parth
> >
> > On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra  wrote:
> >
> > > Okay we are down to the final one -
> > >
> > > DRILL-4482 - Avro no longer selects data correctly from a
> > > sub-structure.(Jason)
> > >
> > > Note that MapR QA team is going to start testing 1.6 snapshot now
> before
> > I
> > > roll out the release candidate. DRILL-4482 can be merged in later as it
> > is
> > > not likely to affect the  Hopefully there will be no show stoppers (.
> > >
> > > The plan is to roll out the release candidate by Thursday.
> > >
> > > Thanks
> > >
> > > Parth
> > >
> > >
> > > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra 
> wrote:
> > >
> > >> OK, let's leave it out then.
> > >>
> > >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> > altekruseja...@gmail.com
> > >> > wrote:
> > >>
> > >>> To be honest I was expecting a longer review cycle so I hadn't run
> the
> > >>> unit
> > >>> tests before posting it for review. There were only very minor
> > functional
> > >>> changes, so I wasn't thinking it would be an issue, and I was
> > >>> anticipating
> > >>> having to update the patch before merging it. I could update the test
> > >>> that
> > >>> is failing but I don't see much sense in trying to get it into the
> > >>> release
> > >>> because it only introduces new tests and some small core refactoring.
> > >>>
> > >>> I'm all for getting it merged so everyone can start using it, I just
> > >>> think
> > >>> it doesn't really matter if it happens on the release branch or back
> on
> > >>> master once we cut a release branch.
> > >>>
> > >>> I would rather try to focus on getting the Avro issues resolved,
> which
> > is
> > >>> what I'm working on right now.
> > >>>
> > >>> - Jason
> > >>>
> > >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> > wrote:
> > >>>
> > >>> > Sounds good Jason. Let's finalize this in the hangout.
> > >>> > Do you have the expected plans for the failing tests? If so can you
> > >>> update
> > >>> > those and put in a pull request and we'll merge and run the tests.
> > >>> > Any reason for the operator test framework to be punted? You have a
> > +1
> > >>> to
> > >>> > merge it.
> > >>> >
> > >>> >
> > >>> >
> > >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz <
> kfar...@maprtech.com
> > >
> > >>> > wrote:
> > >>> >
> > >>> > > We should update the expected results (i.e. the expected query
> plan
> > >>> in
> > >>> > this
> > >>> > > case) and not mark them as Failing. We do not have a Failing test
> > >>> > directory
> > >>> > > today.
> > >>> > >
> > >>> > > If we are sure the expected query plans for these tests are
> > incorrect
> > >>> > > (today), we should go ahead and update the expected results files
> > >>> with
> > >>> > the
> > >>> > > correct query plans.
> > >>> > >
> > >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > >>> > > pruning/hierarchical/plan/count2_MD-185.q
> > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > >>> > >
> > >>> > > Thanks,
> > >>> > > Khurram
> > >>> > >
> > >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> > >>> > altekruseja...@gmail.com>
> > >>> > > wrote:
> > >>> > >
> > >>> > > > The cutoff time sounds good to me. I don't think I'm too
> > >>> overburdened,
> > >>> > I
> > >>> > > > mostly tried putting together a merge branch today and had to
> > kick
> > >>> a
> > >>> > few
> > >>> > > > things out as I found issues.
> > >>> > > >
> > >>> > > > As we are not running the full regression cluster at Dremio, it
> > >>> would
> > >>> > be
> > >>> > > > helpful if someone could merge Jacques patch (DRILL-4474) after
> > >>> running
> > >>> > > the
> > 

Re: Time for the 1.6 Release

[Stefán Baxter]

Hi,

I noticed that using the IN operator with a sub structure has stopped
working:

select s.client_ip.ip from dfs.asa.`/processed/venuepoint/transactions` as
s where s.client_ip.ip in ("unknown") limit 2;
Error: PARSE ERROR: Encountered "\"" at line 1, column 103.
Was expecting one of:
...
SQL Query select s.client_ip.ip from
dfs.asa.`/processed/venuepoint/transactions` as s where s.client_ip.ip in
("2.69.200.113","unknown") limit 2


  ^
(the hat should point at the _ip part of the where clause)

I will report this in Jira and mark it as a blocker.

Regards,
 -Stefán

On Thu, Mar 10, 2016 at 3:50 AM, Parth Chandra  wrote:

> Hi everyone,
>
>   Just a note to  update everyone that the QA team is testing out the build
> from master.
>   There are no further commits expected for the 1.6.0 release.
>   The repo is open for commits but try not to break anything :)
>
>
> Parth
>
> On Tue, Mar 8, 2016 at 5:16 PM, Parth Chandra  wrote:
>
> > Okay we are down to the final one -
> >
> > DRILL-4482 - Avro no longer selects data correctly from a
> > sub-structure.(Jason)
> >
> > Note that MapR QA team is going to start testing 1.6 snapshot now before
> I
> > roll out the release candidate. DRILL-4482 can be merged in later as it
> is
> > not likely to affect the  Hopefully there will be no show stoppers (.
> >
> > The plan is to roll out the release candidate by Thursday.
> >
> > Thanks
> >
> > Parth
> >
> >
> > On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra  wrote:
> >
> >> OK, let's leave it out then.
> >>
> >> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse <
> altekruseja...@gmail.com
> >> > wrote:
> >>
> >>> To be honest I was expecting a longer review cycle so I hadn't run the
> >>> unit
> >>> tests before posting it for review. There were only very minor
> functional
> >>> changes, so I wasn't thinking it would be an issue, and I was
> >>> anticipating
> >>> having to update the patch before merging it. I could update the test
> >>> that
> >>> is failing but I don't see much sense in trying to get it into the
> >>> release
> >>> because it only introduces new tests and some small core refactoring.
> >>>
> >>> I'm all for getting it merged so everyone can start using it, I just
> >>> think
> >>> it doesn't really matter if it happens on the release branch or back on
> >>> master once we cut a release branch.
> >>>
> >>> I would rather try to focus on getting the Avro issues resolved, which
> is
> >>> what I'm working on right now.
> >>>
> >>> - Jason
> >>>
> >>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra 
> wrote:
> >>>
> >>> > Sounds good Jason. Let's finalize this in the hangout.
> >>> > Do you have the expected plans for the failing tests? If so can you
> >>> update
> >>> > those and put in a pull request and we'll merge and run the tests.
> >>> > Any reason for the operator test framework to be punted? You have a
> +1
> >>> to
> >>> > merge it.
> >>> >
> >>> >
> >>> >
> >>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz  >
> >>> > wrote:
> >>> >
> >>> > > We should update the expected results (i.e. the expected query plan
> >>> in
> >>> > this
> >>> > > case) and not mark them as Failing. We do not have a Failing test
> >>> > directory
> >>> > > today.
> >>> > >
> >>> > > If we are sure the expected query plans for these tests are
> incorrect
> >>> > > (today), we should go ahead and update the expected results files
> >>> with
> >>> > the
> >>> > > correct query plans.
> >>> > >
> >>> > > Functional/ctas/ctas_auto_partition/existing_partition_
> >>> > > pruning/hierarchical/plan/count2_MD-185.q
> >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> >>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> >>> > >
> >>> > > Thanks,
> >>> > > Khurram
> >>> > >
> >>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> >>> > altekruseja...@gmail.com>
> >>> > > wrote:
> >>> > >
> >>> > > > The cutoff time sounds good to me. I don't think I'm too
> >>> overburdened,
> >>> > I
> >>> > > > mostly tried putting together a merge branch today and had to
> kick
> >>> a
> >>> > few
> >>> > > > things out as I found issues.
> >>> > > >
> >>> > > > As we are not running the full regression cluster at Dremio, it
> >>> would
> >>> > be
> >>> > > > helpful if someone could merge Jacques patch (DRILL-4474) after
> >>> running
> >>> > > the
> >>> > > > complete set of tests. Could someone at MapR pick up the test
> >>> updates
> >>> > and
> >>> > > > merging this patch?
> >>> > > >
> >>> > > > These are the failures I was seeing so far, my fix was just going
> >>> to be
> >>> > > to
> >>> > > > mark the tests as failing:
> >>> > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
> >>> > > > 

Re: Time for the 1.6 Release

[Parth Chandra]

Okay we are down to the final one -

DRILL-4482 - Avro no longer selects data correctly from a
sub-structure.(Jason)

Note that MapR QA team is going to start testing 1.6 snapshot now before I
roll out the release candidate. DRILL-4482 can be merged in later as it is
not likely to affect the  Hopefully there will be no show stoppers (.

The plan is to roll out the release candidate by Thursday.

Thanks

Parth


On Tue, Mar 8, 2016 at 9:31 AM, Parth Chandra  wrote:

> OK, let's leave it out then.
>
> On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse 
> wrote:
>
>> To be honest I was expecting a longer review cycle so I hadn't run the
>> unit
>> tests before posting it for review. There were only very minor functional
>> changes, so I wasn't thinking it would be an issue, and I was anticipating
>> having to update the patch before merging it. I could update the test that
>> is failing but I don't see much sense in trying to get it into the release
>> because it only introduces new tests and some small core refactoring.
>>
>> I'm all for getting it merged so everyone can start using it, I just think
>> it doesn't really matter if it happens on the release branch or back on
>> master once we cut a release branch.
>>
>> I would rather try to focus on getting the Avro issues resolved, which is
>> what I'm working on right now.
>>
>> - Jason
>>
>> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra  wrote:
>>
>> > Sounds good Jason. Let's finalize this in the hangout.
>> > Do you have the expected plans for the failing tests? If so can you
>> update
>> > those and put in a pull request and we'll merge and run the tests.
>> > Any reason for the operator test framework to be punted? You have a +1
>> to
>> > merge it.
>> >
>> >
>> >
>> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz 
>> > wrote:
>> >
>> > > We should update the expected results (i.e. the expected query plan in
>> > this
>> > > case) and not mark them as Failing. We do not have a Failing test
>> > directory
>> > > today.
>> > >
>> > > If we are sure the expected query plans for these tests are incorrect
>> > > (today), we should go ahead and update the expected results files with
>> > the
>> > > correct query plans.
>> > >
>> > > Functional/ctas/ctas_auto_partition/existing_partition_
>> > > pruning/hierarchical/plan/count2_MD-185.q
>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
>> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
>> > >
>> > > Thanks,
>> > > Khurram
>> > >
>> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
>> > altekruseja...@gmail.com>
>> > > wrote:
>> > >
>> > > > The cutoff time sounds good to me. I don't think I'm too
>> overburdened,
>> > I
>> > > > mostly tried putting together a merge branch today and had to kick a
>> > few
>> > > > things out as I found issues.
>> > > >
>> > > > As we are not running the full regression cluster at Dremio, it
>> would
>> > be
>> > > > helpful if someone could merge Jacques patch (DRILL-4474) after
>> running
>> > > the
>> > > > complete set of tests. Could someone at MapR pick up the test
>> updates
>> > and
>> > > > merging this patch?
>> > > >
>> > > > These are the failures I was seeing so far, my fix was just going
>> to be
>> > > to
>> > > > mark the tests as failing:
>> > > >
>> > > >
>> > >
>> >
>> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
>> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
>> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
>> > > >
>> > > > I will just go ahead and merge the other two fixes as I had a clean
>> > unit
>> > > > test run and neither of the patches will have any impact on the
>> > > regression
>> > > > tests. One is a build fix, that only changes behavior when running
>> the
>> > > > release profile and the other is a unit test fix.
>> > > >
>> > > > I had punted the operator unit tests out of the release, so those
>> can
>> > be
>> > > > removed from your list.
>> > > >
>> > > > I will start looking back at both of the Avro issues right after
>> > merging.
>> > > >
>> > > > On Mon, Mar 7, 2016 at 6:32 PM, Parth Chandra <
>> pchan...@maprtech.com>
>> > > > wrote:
>> > > >
>> > > > > The train is about to leave :). I'd like to propose a cutoff for
>> > > > tomorrow 5
>> > > > > pm.
>> > > > > (This will be a full week after the initial mail so plenty of time
>> > for
>> > > > > everyone to get their issues aired.)
>> > > > >
>> > > > > Here are the open items (that I am aware of) -
>> > > > >
>> > > > > Waiting to be merged
>> > > > > DRILL-4483/pr 411 (Fix text plan regression in query profiles)
>> > (Venki)
>> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
>> > (Jason)
>> > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
>> > > framework)
>> > > > > (?)
>> > > > > DRILL-4474/pr 406 (Ensure 

Re: Time for the 1.6 Release

[Parth Chandra]

OK, let's leave it out then.

On Tue, Mar 8, 2016 at 9:25 AM, Jason Altekruse 
wrote:

> To be honest I was expecting a longer review cycle so I hadn't run the unit
> tests before posting it for review. There were only very minor functional
> changes, so I wasn't thinking it would be an issue, and I was anticipating
> having to update the patch before merging it. I could update the test that
> is failing but I don't see much sense in trying to get it into the release
> because it only introduces new tests and some small core refactoring.
>
> I'm all for getting it merged so everyone can start using it, I just think
> it doesn't really matter if it happens on the release branch or back on
> master once we cut a release branch.
>
> I would rather try to focus on getting the Avro issues resolved, which is
> what I'm working on right now.
>
> - Jason
>
> On Tue, Mar 8, 2016 at 8:58 AM, Parth Chandra  wrote:
>
> > Sounds good Jason. Let's finalize this in the hangout.
> > Do you have the expected plans for the failing tests? If so can you
> update
> > those and put in a pull request and we'll merge and run the tests.
> > Any reason for the operator test framework to be punted? You have a +1 to
> > merge it.
> >
> >
> >
> > On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz 
> > wrote:
> >
> > > We should update the expected results (i.e. the expected query plan in
> > this
> > > case) and not mark them as Failing. We do not have a Failing test
> > directory
> > > today.
> > >
> > > If we are sure the expected query plans for these tests are incorrect
> > > (today), we should go ahead and update the expected results files with
> > the
> > > correct query plans.
> > >
> > > Functional/ctas/ctas_auto_partition/existing_partition_
> > > pruning/hierarchical/plan/count2_MD-185.q
> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > >
> > > Thanks,
> > > Khurram
> > >
> > > On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse <
> > altekruseja...@gmail.com>
> > > wrote:
> > >
> > > > The cutoff time sounds good to me. I don't think I'm too
> overburdened,
> > I
> > > > mostly tried putting together a merge branch today and had to kick a
> > few
> > > > things out as I found issues.
> > > >
> > > > As we are not running the full regression cluster at Dremio, it would
> > be
> > > > helpful if someone could merge Jacques patch (DRILL-4474) after
> running
> > > the
> > > > complete set of tests. Could someone at MapR pick up the test updates
> > and
> > > > merging this patch?
> > > >
> > > > These are the failures I was seeing so far, my fix was just going to
> be
> > > to
> > > > mark the tests as failing:
> > > >
> > > >
> > >
> >
> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > > > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> > > >
> > > > I will just go ahead and merge the other two fixes as I had a clean
> > unit
> > > > test run and neither of the patches will have any impact on the
> > > regression
> > > > tests. One is a build fix, that only changes behavior when running
> the
> > > > release profile and the other is a unit test fix.
> > > >
> > > > I had punted the operator unit tests out of the release, so those can
> > be
> > > > removed from your list.
> > > >
> > > > I will start looking back at both of the Avro issues right after
> > merging.
> > > >
> > > > On Mon, Mar 7, 2016 at 6:32 PM, Parth Chandra  >
> > > > wrote:
> > > >
> > > > > The train is about to leave :). I'd like to propose a cutoff for
> > > > tomorrow 5
> > > > > pm.
> > > > > (This will be a full week after the initial mail so plenty of time
> > for
> > > > > everyone to get their issues aired.)
> > > > >
> > > > > Here are the open items (that I am aware of) -
> > > > >
> > > > > Waiting to be merged
> > > > > DRILL-4483/pr 411 (Fix text plan regression in query profiles)
> > (Venki)
> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > (Jason)
> > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > framework)
> > > > > (?)
> > > > > DRILL-4474/pr 406 (Ensure that ConvertCountToDirectScan only pushes
> > > > through
> > > > > project when project is trivial.) - Tests need to be fixed (Jason)
> > > > >
> > > > > Need review -
> > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > > > reviewed. Merge)
> > > > > DRILL-4486/pr 412 (Fix expression serialization escaping) (Need are
> > > > > reviewer)
> > > > > DRILL-4485 - Update MapR profile to use MapR 5.1.0 (Parth/Aditya)
> > > > >
> > > > > Regression
> > > > > DRILL-4482 - Avro no longer selects data correctly from a
> > > sub-structure.
> > > > No
> > > > > patch available. (Jason)
> > > > >
> > > > > 

Re: Time for the 1.6 Release

[Parth Chandra]

Sounds good Jason. Let's finalize this in the hangout.
Do you have the expected plans for the failing tests? If so can you update
those and put in a pull request and we'll merge and run the tests.
Any reason for the operator test framework to be punted? You have a +1 to
merge it.



On Mon, Mar 7, 2016 at 9:33 PM, Khurram Faraaz  wrote:

> We should update the expected results (i.e. the expected query plan in this
> case) and not mark them as Failing. We do not have a Failing test directory
> today.
>
> If we are sure the expected query plans for these tests are incorrect
> (today), we should go ahead and update the expected results files with the
> correct query plans.
>
> Functional/ctas/ctas_auto_partition/existing_partition_
> pruning/hierarchical/plan/count2_MD-185.q
> Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
>
> Thanks,
> Khurram
>
> On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse 
> wrote:
>
> > The cutoff time sounds good to me. I don't think I'm too overburdened, I
> > mostly tried putting together a merge branch today and had to kick a few
> > things out as I found issues.
> >
> > As we are not running the full regression cluster at Dremio, it would be
> > helpful if someone could merge Jacques patch (DRILL-4474) after running
> the
> > complete set of tests. Could someone at MapR pick up the test updates and
> > merging this patch?
> >
> > These are the failures I was seeing so far, my fix was just going to be
> to
> > mark the tests as failing:
> >
> >
> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
> > Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> > Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
> >
> > I will just go ahead and merge the other two fixes as I had a clean unit
> > test run and neither of the patches will have any impact on the
> regression
> > tests. One is a build fix, that only changes behavior when running the
> > release profile and the other is a unit test fix.
> >
> > I had punted the operator unit tests out of the release, so those can be
> > removed from your list.
> >
> > I will start looking back at both of the Avro issues right after merging.
> >
> > On Mon, Mar 7, 2016 at 6:32 PM, Parth Chandra 
> > wrote:
> >
> > > The train is about to leave :). I'd like to propose a cutoff for
> > tomorrow 5
> > > pm.
> > > (This will be a full week after the initial mail so plenty of time for
> > > everyone to get their issues aired.)
> > >
> > > Here are the open items (that I am aware of) -
> > >
> > > Waiting to be merged
> > > DRILL-4483/pr 411 (Fix text plan regression in query profiles) (Venki)
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Jason)
> > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> framework)
> > > (?)
> > > DRILL-4474/pr 406 (Ensure that ConvertCountToDirectScan only pushes
> > through
> > > project when project is trivial.) - Tests need to be fixed (Jason)
> > >
> > > Need review -
> > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > reviewed. Merge)
> > > DRILL-4486/pr 412 (Fix expression serialization escaping) (Need are
> > > reviewer)
> > > DRILL-4485 - Update MapR profile to use MapR 5.1.0 (Parth/Aditya)
> > >
> > > Regression
> > > DRILL-4482 - Avro no longer selects data correctly from a
> sub-structure.
> > No
> > > patch available. (Jason)
> > >
> > > Dropped
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) Pushed out because of test failures
> > >
> > > Jason, at the moment it looks like you've volunteered for too much. Can
> > we
> > > get other folks to help out?
> > >
> > > Thanks
> > >
> > > Parth
> > >
> > >
> > > On Mon, Mar 7, 2016 at 5:32 PM, Jason Altekruse <
> > altekruseja...@gmail.com>
> > > wrote:
> > >
> > > > 4474 is actually revealing a few invalid tests in the Regression
> suite
> > > that
> > > > test for the current incorrect plans. The fix should be included in
> the
> > > > release, but I will post a PR on the regression suite to update the
> > tests
> > > > before I push it.
> > > >
> > > > On Mon, Mar 7, 2016 at 4:44 PM, Steven Phillips 
> > > wrote:
> > > >
> > > > > DRILL-4486 is a pretty simple fix. Without it, currently some regex
> > > > queries
> > > > > will fail.
> > > > >
> > > > > I think we should include it in the release.
> > > > >
> > > > >
> > > > > https://github.com/apache/drill/pull/412
> > > > >
> > > > > On Mon, Mar 7, 2016 at 2:15 PM, Jason Altekruse <
> > > > altekruseja...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > There is a small test issue with some of the refactoring that
> > > > accompanied
> > > > > > the operator unit tests. These don't change any user-facing
> > behavior,
> > > > so
> > > 

Re: Time for the 1.6 Release

[Khurram Faraaz]

We should update the expected results (i.e. the expected query plan in this
case) and not mark them as Failing. We do not have a Failing test directory
today.

If we are sure the expected query plans for these tests are incorrect
(today), we should go ahead and update the expected results files with the
correct query plans.

Functional/ctas/ctas_auto_partition/existing_partition_
pruning/hierarchical/plan/count2_MD-185.q
Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q

Thanks,
Khurram

On Tue, Mar 8, 2016 at 8:58 AM, Jason Altekruse 
wrote:

> The cutoff time sounds good to me. I don't think I'm too overburdened, I
> mostly tried putting together a merge branch today and had to kick a few
> things out as I found issues.
>
> As we are not running the full regression cluster at Dremio, it would be
> helpful if someone could merge Jacques patch (DRILL-4474) after running the
> complete set of tests. Could someone at MapR pick up the test updates and
> merging this patch?
>
> These are the failures I was seeing so far, my fix was just going to be to
> mark the tests as failing:
>
> Functional/ctas/ctas_auto_partition/existing_partition_pruning/hierarchical/plan/count2_MD-185.q
> Functional/ctas/ctas_auto_partition/general/plan/drill3947_2.q
> Functional/ctas/ctas_auto_partition/general/plan/drill3947_4.q
>
> I will just go ahead and merge the other two fixes as I had a clean unit
> test run and neither of the patches will have any impact on the regression
> tests. One is a build fix, that only changes behavior when running the
> release profile and the other is a unit test fix.
>
> I had punted the operator unit tests out of the release, so those can be
> removed from your list.
>
> I will start looking back at both of the Avro issues right after merging.
>
> On Mon, Mar 7, 2016 at 6:32 PM, Parth Chandra 
> wrote:
>
> > The train is about to leave :). I'd like to propose a cutoff for
> tomorrow 5
> > pm.
> > (This will be a full week after the initial mail so plenty of time for
> > everyone to get their issues aired.)
> >
> > Here are the open items (that I am aware of) -
> >
> > Waiting to be merged
> > DRILL-4483/pr 411 (Fix text plan regression in query profiles) (Venki)
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Jason)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > (?)
> > DRILL-4474/pr 406 (Ensure that ConvertCountToDirectScan only pushes
> through
> > project when project is trivial.) - Tests need to be fixed (Jason)
> >
> > Need review -
> > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > reviewed. Merge)
> > DRILL-4486/pr 412 (Fix expression serialization escaping) (Need are
> > reviewer)
> > DRILL-4485 - Update MapR profile to use MapR 5.1.0 (Parth/Aditya)
> >
> > Regression
> > DRILL-4482 - Avro no longer selects data correctly from a sub-structure.
> No
> > patch available. (Jason)
> >
> > Dropped
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) Pushed out because of test failures
> >
> > Jason, at the moment it looks like you've volunteered for too much. Can
> we
> > get other folks to help out?
> >
> > Thanks
> >
> > Parth
> >
> >
> > On Mon, Mar 7, 2016 at 5:32 PM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > 4474 is actually revealing a few invalid tests in the Regression suite
> > that
> > > test for the current incorrect plans. The fix should be included in the
> > > release, but I will post a PR on the regression suite to update the
> tests
> > > before I push it.
> > >
> > > On Mon, Mar 7, 2016 at 4:44 PM, Steven Phillips 
> > wrote:
> > >
> > > > DRILL-4486 is a pretty simple fix. Without it, currently some regex
> > > queries
> > > > will fail.
> > > >
> > > > I think we should include it in the release.
> > > >
> > > >
> > > > https://github.com/apache/drill/pull/412
> > > >
> > > > On Mon, Mar 7, 2016 at 2:15 PM, Jason Altekruse <
> > > altekruseja...@gmail.com>
> > > > wrote:
> > > >
> > > > > There is a small test issue with some of the refactoring that
> > > accompanied
> > > > > the operator unit tests. These don't change any user-facing
> behavior,
> > > so
> > > > I
> > > > > don't think it really needs to get into the release. I will be
> > working
> > > to
> > > > > merge them into master after we cut the release branch.
> > > > >
> > > > > The change to update the avatica JDBC driver version also does not
> > make
> > > > any
> > > > > behavior changes, so I think it also makes sense to keep it off the
> > > > release
> > > > > branch.
> > > > >
> > > > > I will be merging the fix for 4375 the maven release profile, 4474
> > > wrong
> > > > > results with incorrect creation of DirectScan and 4332 fixing a
> unit
> > > test
> > > > > to work in JDK 8, after another 

Re: Time for the 1.6 Release

[Parth Chandra]

The train is about to leave :). I'd like to propose a cutoff for tomorrow 5
pm.
(This will be a full week after the initial mail so plenty of time for
everyone to get their issues aired.)

Here are the open items (that I am aware of) -

Waiting to be merged
DRILL-4483/pr 411 (Fix text plan regression in query profiles) (Venki)
DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Jason)
DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
(?)
DRILL-4474/pr 406 (Ensure that ConvertCountToDirectScan only pushes through
project when project is trivial.) - Tests need to be fixed (Jason)

Need review -
DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
reviewed. Merge)
DRILL-4486/pr 412 (Fix expression serialization escaping) (Need are
reviewer)
DRILL-4485 - Update MapR profile to use MapR 5.1.0 (Parth/Aditya)

Regression
DRILL-4482 - Avro no longer selects data correctly from a sub-structure. No
patch available. (Jason)

Dropped
DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
their types within Calcite.) Pushed out because of test failures

Jason, at the moment it looks like you've volunteered for too much. Can we
get other folks to help out?

Thanks

Parth


On Mon, Mar 7, 2016 at 5:32 PM, Jason Altekruse 
wrote:

> 4474 is actually revealing a few invalid tests in the Regression suite that
> test for the current incorrect plans. The fix should be included in the
> release, but I will post a PR on the regression suite to update the tests
> before I push it.
>
> On Mon, Mar 7, 2016 at 4:44 PM, Steven Phillips  wrote:
>
> > DRILL-4486 is a pretty simple fix. Without it, currently some regex
> queries
> > will fail.
> >
> > I think we should include it in the release.
> >
> >
> > https://github.com/apache/drill/pull/412
> >
> > On Mon, Mar 7, 2016 at 2:15 PM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > There is a small test issue with some of the refactoring that
> accompanied
> > > the operator unit tests. These don't change any user-facing behavior,
> so
> > I
> > > don't think it really needs to get into the release. I will be working
> to
> > > merge them into master after we cut the release branch.
> > >
> > > The change to update the avatica JDBC driver version also does not make
> > any
> > > behavior changes, so I think it also makes sense to keep it off the
> > release
> > > branch.
> > >
> > > I will be merging the fix for 4375 the maven release profile, 4474
> wrong
> > > results with incorrect creation of DirectScan and 4332 fixing a unit
> test
> > > to work in JDK 8, after another test run.
> > >
> > > On Mon, Mar 7, 2016 at 1:53 PM, Venki Korukanti <
> > venki.koruka...@gmail.com
> > > >
> > > wrote:
> > >
> > > > WebUI profile issue: this is a regression cause by refactoring of
> > Calcite
> > > > integration code (DRILL-4465) which sets the text plan only if debug
> is
> > > > enabled. Will submit a patch soon.
> > > >
> > > > On Mon, Mar 7, 2016 at 1:29 PM, Sudheesh Katkam <
> skat...@maprtech.com>
> > > > wrote:
> > > >
> > > > > Thanks for clarifying Jacques.
> > > > >
> > > > > I haven’t looked into the fix for DRILL-4384; I reopened it because
> > the
> > > > > description mentioned “visualized plan” section is (also) empty.
> > > > >
> > > > > Thank you,
> > > > > Sudheesh
> > > > >
> > > > > > On Mar 7, 2016, at 1:08 PM, Jacques Nadeau 
> > > wrote:
> > > > > >
> > > > > > The new bug (currently filed under DRILL-4384) is a completely
> > > > different
> > > > > > bug than the original (original one has to do with profile
> metrics,
> > > > this
> > > > > > has to do with plan text). I try to look at it tonight if noone
> can
> > > get
> > > > > to
> > > > > > it sooner.
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > > On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra <
> > > pchan...@maprtech.com>
> > > > > > wrote:
> > > > > >
> > > > > >> DRILL-4384 is a blocker for the release though
> > > > > >>
> > > > > >> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam <
> > > > skat...@maprtech.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >>> I reopened DRILL-4384 <
> > > > > https://issues.apache.org/jira/browse/DRILL-4384>
> > > > > >>> (blocker); it is assigned to Jacques.
> > > > > >>>
> > > > > >>> On the latest master, the visualized and physical plan tabs on
> > web
> > > UI
> > > > > are
> > > > > >>> empty.
> > > > > >>>
> > > > > >>> Thank you,
> > > > > >>> Sudheesh
> > > > > >>>
> > > > >  On Mar 7, 2016, at 11:39 AM, Jason Altekruse <
> > > > > altekruseja...@gmail.com
> > > > > >>>
> > > > > >>> wrote:
> > > > > 
> > > > >  I don't know if there are any specific time constraints for
> > > getting
> > > > > out
> > > > > >>> the
> > > > >  release, but I'm inclined to go with Vicky on DRILL-4477, at
> > least
> > > > > some
> > 

Re: Time for the 1.6 Release

[Jason Altekruse]

4474 is actually revealing a few invalid tests in the Regression suite that
test for the current incorrect plans. The fix should be included in the
release, but I will post a PR on the regression suite to update the tests
before I push it.

On Mon, Mar 7, 2016 at 4:44 PM, Steven Phillips  wrote:

> DRILL-4486 is a pretty simple fix. Without it, currently some regex queries
> will fail.
>
> I think we should include it in the release.
>
>
> https://github.com/apache/drill/pull/412
>
> On Mon, Mar 7, 2016 at 2:15 PM, Jason Altekruse 
> wrote:
>
> > There is a small test issue with some of the refactoring that accompanied
> > the operator unit tests. These don't change any user-facing behavior, so
> I
> > don't think it really needs to get into the release. I will be working to
> > merge them into master after we cut the release branch.
> >
> > The change to update the avatica JDBC driver version also does not make
> any
> > behavior changes, so I think it also makes sense to keep it off the
> release
> > branch.
> >
> > I will be merging the fix for 4375 the maven release profile, 4474 wrong
> > results with incorrect creation of DirectScan and 4332 fixing a unit test
> > to work in JDK 8, after another test run.
> >
> > On Mon, Mar 7, 2016 at 1:53 PM, Venki Korukanti <
> venki.koruka...@gmail.com
> > >
> > wrote:
> >
> > > WebUI profile issue: this is a regression cause by refactoring of
> Calcite
> > > integration code (DRILL-4465) which sets the text plan only if debug is
> > > enabled. Will submit a patch soon.
> > >
> > > On Mon, Mar 7, 2016 at 1:29 PM, Sudheesh Katkam 
> > > wrote:
> > >
> > > > Thanks for clarifying Jacques.
> > > >
> > > > I haven’t looked into the fix for DRILL-4384; I reopened it because
> the
> > > > description mentioned “visualized plan” section is (also) empty.
> > > >
> > > > Thank you,
> > > > Sudheesh
> > > >
> > > > > On Mar 7, 2016, at 1:08 PM, Jacques Nadeau 
> > wrote:
> > > > >
> > > > > The new bug (currently filed under DRILL-4384) is a completely
> > > different
> > > > > bug than the original (original one has to do with profile metrics,
> > > this
> > > > > has to do with plan text). I try to look at it tonight if noone can
> > get
> > > > to
> > > > > it sooner.
> > > > >
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > > On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra <
> > pchan...@maprtech.com>
> > > > > wrote:
> > > > >
> > > > >> DRILL-4384 is a blocker for the release though
> > > > >>
> > > > >> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam <
> > > skat...@maprtech.com>
> > > > >> wrote:
> > > > >>
> > > > >>> I reopened DRILL-4384 <
> > > > https://issues.apache.org/jira/browse/DRILL-4384>
> > > > >>> (blocker); it is assigned to Jacques.
> > > > >>>
> > > > >>> On the latest master, the visualized and physical plan tabs on
> web
> > UI
> > > > are
> > > > >>> empty.
> > > > >>>
> > > > >>> Thank you,
> > > > >>> Sudheesh
> > > > >>>
> > > >  On Mar 7, 2016, at 11:39 AM, Jason Altekruse <
> > > > altekruseja...@gmail.com
> > > > >>>
> > > > >>> wrote:
> > > > 
> > > >  I don't know if there are any specific time constraints for
> > getting
> > > > out
> > > > >>> the
> > > >  release, but I'm inclined to go with Vicky on DRILL-4477, at
> least
> > > > some
> > > >  investigation into the scope of a fix would be good. I think
> it's
> > > >  reasonably big problem whether it's a regression or not.
> > > > 
> > > >  On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong <
> zf...@maprtech.com
> > >
> > > > >>> wrote:
> > > > 
> > > > > Hakim,
> > > > >
> > > > > Yes, we'll include this in the release.
> > > > >
> > > > > -- Zelaine
> > > > >
> > > > > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> > > > >>> adene...@maprtech.com
> > > > >>
> > > > > wrote:
> > > > >
> > > > >> If we still have time, I would like to include DRILL-4457 [1],
> > > it's
> > > > a
> > > > > wrong
> > > > >> results issue, I already have a fix and it's passing all
> tests,
> > I
> > > am
> > > > >>> just
> > > > >> waiting for a review [2]
> > > > >>
> > > > >>
> > > > >> [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > > >> [2] https://github.com/apache/drill/pull/410
> > > > >>
> > > > >> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra <
> > par...@apache.org>
> > > > >>> wrote:
> > > > >>
> > > > >>> Hi guys,
> > > > >>>
> > > > >>> I'm still waiting for the following to be reviewed/merged by
> > > today.
> > > > >>>
> > > > >>> DRILL-4437 (and others)/pr 394 (Operator unit test
> framework).
> > > > >> Waiting
> > > > > to
> > > > >>> be merged (Jason)
> > > > >>>
> > > > >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > > correctly
> > > > >> expose
> 

Re: Time for the 1.6 Release

[Steven Phillips]

DRILL-4486 is a pretty simple fix. Without it, currently some regex queries
will fail.

I think we should include it in the release.


https://github.com/apache/drill/pull/412

On Mon, Mar 7, 2016 at 2:15 PM, Jason Altekruse 
wrote:

> There is a small test issue with some of the refactoring that accompanied
> the operator unit tests. These don't change any user-facing behavior, so I
> don't think it really needs to get into the release. I will be working to
> merge them into master after we cut the release branch.
>
> The change to update the avatica JDBC driver version also does not make any
> behavior changes, so I think it also makes sense to keep it off the release
> branch.
>
> I will be merging the fix for 4375 the maven release profile, 4474 wrong
> results with incorrect creation of DirectScan and 4332 fixing a unit test
> to work in JDK 8, after another test run.
>
> On Mon, Mar 7, 2016 at 1:53 PM, Venki Korukanti  >
> wrote:
>
> > WebUI profile issue: this is a regression cause by refactoring of Calcite
> > integration code (DRILL-4465) which sets the text plan only if debug is
> > enabled. Will submit a patch soon.
> >
> > On Mon, Mar 7, 2016 at 1:29 PM, Sudheesh Katkam 
> > wrote:
> >
> > > Thanks for clarifying Jacques.
> > >
> > > I haven’t looked into the fix for DRILL-4384; I reopened it because the
> > > description mentioned “visualized plan” section is (also) empty.
> > >
> > > Thank you,
> > > Sudheesh
> > >
> > > > On Mar 7, 2016, at 1:08 PM, Jacques Nadeau 
> wrote:
> > > >
> > > > The new bug (currently filed under DRILL-4384) is a completely
> > different
> > > > bug than the original (original one has to do with profile metrics,
> > this
> > > > has to do with plan text). I try to look at it tonight if noone can
> get
> > > to
> > > > it sooner.
> > > >
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > > >
> > > > On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra <
> pchan...@maprtech.com>
> > > > wrote:
> > > >
> > > >> DRILL-4384 is a blocker for the release though
> > > >>
> > > >> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam <
> > skat...@maprtech.com>
> > > >> wrote:
> > > >>
> > > >>> I reopened DRILL-4384 <
> > > https://issues.apache.org/jira/browse/DRILL-4384>
> > > >>> (blocker); it is assigned to Jacques.
> > > >>>
> > > >>> On the latest master, the visualized and physical plan tabs on web
> UI
> > > are
> > > >>> empty.
> > > >>>
> > > >>> Thank you,
> > > >>> Sudheesh
> > > >>>
> > >  On Mar 7, 2016, at 11:39 AM, Jason Altekruse <
> > > altekruseja...@gmail.com
> > > >>>
> > > >>> wrote:
> > > 
> > >  I don't know if there are any specific time constraints for
> getting
> > > out
> > > >>> the
> > >  release, but I'm inclined to go with Vicky on DRILL-4477, at least
> > > some
> > >  investigation into the scope of a fix would be good. I think it's
> > >  reasonably big problem whether it's a regression or not.
> > > 
> > >  On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong  >
> > > >>> wrote:
> > > 
> > > > Hakim,
> > > >
> > > > Yes, we'll include this in the release.
> > > >
> > > > -- Zelaine
> > > >
> > > > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> > > >>> adene...@maprtech.com
> > > >>
> > > > wrote:
> > > >
> > > >> If we still have time, I would like to include DRILL-4457 [1],
> > it's
> > > a
> > > > wrong
> > > >> results issue, I already have a fix and it's passing all tests,
> I
> > am
> > > >>> just
> > > >> waiting for a review [2]
> > > >>
> > > >>
> > > >> [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > >> [2] https://github.com/apache/drill/pull/410
> > > >>
> > > >> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra <
> par...@apache.org>
> > > >>> wrote:
> > > >>
> > > >>> Hi guys,
> > > >>>
> > > >>> I'm still waiting for the following to be reviewed/merged by
> > today.
> > > >>>
> > > >>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > >> Waiting
> > > > to
> > > >>> be merged (Jason)
> > > >>>
> > > >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > correctly
> > > >> expose
> > > >>> their types within Calcite.) - (Jinfeng to review)
> > > >>>
> > > >>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> > with
> > > >>> warnings about using the feature ) (Hanifi/Sudheesh/Paul -
> patch
> > > >> reviewed.
> > > >>> No +1)
> > > >>>
> > > >>> DRILL-4375/pr 402 (Fix the maven release profile) - (Jason -
> > patch
> > > >>> reviewed. Ready to merge?)
> > > >>>
> > > >>> Thanks
> > > >>>
> > > >>> Parth
> > > >>>
> > > >>> On Sun, Mar 6, 2016 at 12:01 PM, Aditya <
> adityakish...@gmail.com
> > >
> > > > wrote:
> > 

Re: Time for the 1.6 Release

[Jason Altekruse]

There is a small test issue with some of the refactoring that accompanied
the operator unit tests. These don't change any user-facing behavior, so I
don't think it really needs to get into the release. I will be working to
merge them into master after we cut the release branch.

The change to update the avatica JDBC driver version also does not make any
behavior changes, so I think it also makes sense to keep it off the release
branch.

I will be merging the fix for 4375 the maven release profile, 4474 wrong
results with incorrect creation of DirectScan and 4332 fixing a unit test
to work in JDK 8, after another test run.

On Mon, Mar 7, 2016 at 1:53 PM, Venki Korukanti 
wrote:

> WebUI profile issue: this is a regression cause by refactoring of Calcite
> integration code (DRILL-4465) which sets the text plan only if debug is
> enabled. Will submit a patch soon.
>
> On Mon, Mar 7, 2016 at 1:29 PM, Sudheesh Katkam 
> wrote:
>
> > Thanks for clarifying Jacques.
> >
> > I haven’t looked into the fix for DRILL-4384; I reopened it because the
> > description mentioned “visualized plan” section is (also) empty.
> >
> > Thank you,
> > Sudheesh
> >
> > > On Mar 7, 2016, at 1:08 PM, Jacques Nadeau  wrote:
> > >
> > > The new bug (currently filed under DRILL-4384) is a completely
> different
> > > bug than the original (original one has to do with profile metrics,
> this
> > > has to do with plan text). I try to look at it tonight if noone can get
> > to
> > > it sooner.
> > >
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra 
> > > wrote:
> > >
> > >> DRILL-4384 is a blocker for the release though
> > >>
> > >> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam <
> skat...@maprtech.com>
> > >> wrote:
> > >>
> > >>> I reopened DRILL-4384 <
> > https://issues.apache.org/jira/browse/DRILL-4384>
> > >>> (blocker); it is assigned to Jacques.
> > >>>
> > >>> On the latest master, the visualized and physical plan tabs on web UI
> > are
> > >>> empty.
> > >>>
> > >>> Thank you,
> > >>> Sudheesh
> > >>>
> >  On Mar 7, 2016, at 11:39 AM, Jason Altekruse <
> > altekruseja...@gmail.com
> > >>>
> > >>> wrote:
> > 
> >  I don't know if there are any specific time constraints for getting
> > out
> > >>> the
> >  release, but I'm inclined to go with Vicky on DRILL-4477, at least
> > some
> >  investigation into the scope of a fix would be good. I think it's
> >  reasonably big problem whether it's a regression or not.
> > 
> >  On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong 
> > >>> wrote:
> > 
> > > Hakim,
> > >
> > > Yes, we'll include this in the release.
> > >
> > > -- Zelaine
> > >
> > > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> > >>> adene...@maprtech.com
> > >>
> > > wrote:
> > >
> > >> If we still have time, I would like to include DRILL-4457 [1],
> it's
> > a
> > > wrong
> > >> results issue, I already have a fix and it's passing all tests, I
> am
> > >>> just
> > >> waiting for a review [2]
> > >>
> > >>
> > >> [1] https://issues.apache.org/jira/browse/DRILL-4457
> > >> [2] https://github.com/apache/drill/pull/410
> > >>
> > >> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> > >>> wrote:
> > >>
> > >>> Hi guys,
> > >>>
> > >>> I'm still waiting for the following to be reviewed/merged by
> today.
> > >>>
> > >>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > >> Waiting
> > > to
> > >>> be merged (Jason)
> > >>>
> > >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > correctly
> > >> expose
> > >>> their types within Calcite.) - (Jinfeng to review)
> > >>>
> > >>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> with
> > >>> warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > >> reviewed.
> > >>> No +1)
> > >>>
> > >>> DRILL-4375/pr 402 (Fix the maven release profile) - (Jason -
> patch
> > >>> reviewed. Ready to merge?)
> > >>>
> > >>> Thanks
> > >>>
> > >>> Parth
> > >>>
> > >>> On Sun, Mar 6, 2016 at 12:01 PM, Aditya  >
> > > wrote:
> > >>>
> >  DRILL-4375/pr 402 - reviewed.
> > 
> >  On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > >>> ste...@activitystream.com>
> >  wrote:
> > 
> > > Please review this and then consider as a potential blocker:
> > >
> > > https://issues.apache.org/jira/browse/DRILL-4482
> > >
> > >
> > >
> > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra <
> par...@apache.org
> > >
> > >>> wrote:
> > >
> > >> Okay here's the list  of  JIRA's 

Re: Time for the 1.6 Release

[Venki Korukanti]

WebUI profile issue: this is a regression cause by refactoring of Calcite
integration code (DRILL-4465) which sets the text plan only if debug is
enabled. Will submit a patch soon.

On Mon, Mar 7, 2016 at 1:29 PM, Sudheesh Katkam 
wrote:

> Thanks for clarifying Jacques.
>
> I haven’t looked into the fix for DRILL-4384; I reopened it because the
> description mentioned “visualized plan” section is (also) empty.
>
> Thank you,
> Sudheesh
>
> > On Mar 7, 2016, at 1:08 PM, Jacques Nadeau  wrote:
> >
> > The new bug (currently filed under DRILL-4384) is a completely different
> > bug than the original (original one has to do with profile metrics, this
> > has to do with plan text). I try to look at it tonight if noone can get
> to
> > it sooner.
> >
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra 
> > wrote:
> >
> >> DRILL-4384 is a blocker for the release though
> >>
> >> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam 
> >> wrote:
> >>
> >>> I reopened DRILL-4384 <
> https://issues.apache.org/jira/browse/DRILL-4384>
> >>> (blocker); it is assigned to Jacques.
> >>>
> >>> On the latest master, the visualized and physical plan tabs on web UI
> are
> >>> empty.
> >>>
> >>> Thank you,
> >>> Sudheesh
> >>>
>  On Mar 7, 2016, at 11:39 AM, Jason Altekruse <
> altekruseja...@gmail.com
> >>>
> >>> wrote:
> 
>  I don't know if there are any specific time constraints for getting
> out
> >>> the
>  release, but I'm inclined to go with Vicky on DRILL-4477, at least
> some
>  investigation into the scope of a fix would be good. I think it's
>  reasonably big problem whether it's a regression or not.
> 
>  On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong 
> >>> wrote:
> 
> > Hakim,
> >
> > Yes, we'll include this in the release.
> >
> > -- Zelaine
> >
> > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> >>> adene...@maprtech.com
> >>
> > wrote:
> >
> >> If we still have time, I would like to include DRILL-4457 [1], it's
> a
> > wrong
> >> results issue, I already have a fix and it's passing all tests, I am
> >>> just
> >> waiting for a review [2]
> >>
> >>
> >> [1] https://issues.apache.org/jira/browse/DRILL-4457
> >> [2] https://github.com/apache/drill/pull/410
> >>
> >> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> >>> wrote:
> >>
> >>> Hi guys,
> >>>
> >>> I'm still waiting for the following to be reviewed/merged by today.
> >>>
> >>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> >> Waiting
> > to
> >>> be merged (Jason)
> >>>
> >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> correctly
> >> expose
> >>> their types within Calcite.) - (Jinfeng to review)
> >>>
> >>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> >>> warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> >> reviewed.
> >>> No +1)
> >>>
> >>> DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> >>> reviewed. Ready to merge?)
> >>>
> >>> Thanks
> >>>
> >>> Parth
> >>>
> >>> On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > wrote:
> >>>
>  DRILL-4375/pr 402 - reviewed.
> 
>  On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> >>> ste...@activitystream.com>
>  wrote:
> 
> > Please review this and then consider as a potential blocker:
> >
> > https://issues.apache.org/jira/browse/DRILL-4482
> >
> >
> >
> > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  >
> >>> wrote:
> >
> >> Okay here's the list  of  JIRA's pending. It looks like we need
> > to
> >>> get
> > some
> >> more time to get the PRs still under review merged, so I'll wait
> >> over
>  the
> >> weekend.
> >> It looks like the PRs that no reviewers assigned in the list
> > below
> >>> may
> > not
> >> make it into the release.
> >>
> >> Thanks
> >>
> >>
> >>
> >> Committed for 1.6 -
> >>
> >> DRILL-4384 - Query profile is missing important information on
> >> WebUi
> >>> -
> >> Merged
> >> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> >> DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > Merged
> >> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> >>> Merged
> >> DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> >> integration) -
> >> Merged
> >> DRILL-4467 - Baselines need updating.
> 

Re: Time for the 1.6 Release

[Vicky Markman]

It is in 1.4.0

On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong  wrote:

> Vicky,
>
> Per our discussion today, let us know if this issue also exists in 1.4.
> From the discussion, it sounds like this is not a recent regression.
>
> -- Zelaine
>
> On Mon, Mar 7, 2016 at 10:44 AM, Vicky Markman 
> wrote:
>
> > DRILL-4477 is a really bad bug and should be fixed in 1.6
> >
> > On Mon, Mar 7, 2016 at 9:40 AM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > Hakim,
> > >
> > > The patch looks good, I just gave you a +1.
> > >
> > > I will be merging the operator unit tests today, I would recommend
> > checking
> > > it out for writing tests like this in future commits.
> > >
> > > - Jason
> > >
> > > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> > adene...@maprtech.com
> > > >
> > > wrote:
> > >
> > > > If we still have time, I would like to include DRILL-4457 [1], it's a
> > > wrong
> > > > results issue, I already have a fix and it's passing all tests, I am
> > just
> > > > waiting for a review [2]
> > > >
> > > >
> > > > [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > > [2] https://github.com/apache/drill/pull/410
> > > >
> > > > On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> > wrote:
> > > >
> > > > > Hi guys,
> > > > >
> > > > > I'm still waiting for the following to be reviewed/merged by today.
> > > > >
> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > Waiting
> > > to
> > > > > be merged (Jason)
> > > > >
> > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> correctly
> > > > expose
> > > > > their types within Calcite.) - (Jinfeng to review)
> > > > >
> > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > > > reviewed.
> > > > > No +1)
> > > > >
> > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > > > reviewed. Ready to merge?)
> > > > >
> > > > > Thanks
> > > > >
> > > > > Parth
> > > > >
> > > > > On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > > wrote:
> > > > >
> > > > > > DRILL-4375/pr 402 - reviewed.
> > > > > >
> > > > > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > > > > ste...@activitystream.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Please review this and then consider as a potential blocker:
> > > > > > >
> > > > > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra <
> par...@apache.org
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > Okay here's the list  of  JIRA's pending. It looks like we
> need
> > > to
> > > > > get
> > > > > > > some
> > > > > > > > more time to get the PRs still under review merged, so I'll
> > wait
> > > > over
> > > > > > the
> > > > > > > > weekend.
> > > > > > > > It looks like the PRs that no reviewers assigned in the list
> > > below
> > > > > may
> > > > > > > not
> > > > > > > > make it into the release.
> > > > > > > >
> > > > > > > > Thanks
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Committed for 1.6 -
> > > > > > > >
> > > > > > > > DRILL-4384 - Query profile is missing important information
> on
> > > > WebUi
> > > > > -
> > > > > > > > Merged
> > > > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > > Merged
> > > > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos,
> etc)
> > -
> > > > > Merged
> > > > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > > > integration) -
> > > > > > > > Merged
> > > > > > > > DRILL-4467 - Baselines need updating.
> > > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is
> used..)
> > > > > Merged
> > > > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test
> framework).
> > > > > Waiting
> > > > > > to
> > > > > > > > be merged
> > > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is
> > used..) -
> > > > > > > Waiting
> > > > > > > > to be merged
> > > > > > > >
> > > > > > > > Need review -
> > > > > > > > DRILL-4281/pr 400 (Drill should support inbound
> impersonation)
> > > > > (Jacques
> > > > > > > to
> > > > > > > > review)
> > > > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > > correctly
> > > > > > > expose
> > > > > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > > > > DRILL-4313/pr 396  (Improved client randomization. Update
> JIRA
> > > with
> > > > > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> > > > review.)
> > > > > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya
> to
> > > > > review)
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > > > > 

Re: Time for the 1.6 Release

[Sudheesh Katkam]

Thanks for clarifying Jacques.

I haven’t looked into the fix for DRILL-4384; I reopened it because the 
description mentioned “visualized plan” section is (also) empty.

Thank you,
Sudheesh

> On Mar 7, 2016, at 1:08 PM, Jacques Nadeau  wrote:
> 
> The new bug (currently filed under DRILL-4384) is a completely different
> bug than the original (original one has to do with profile metrics, this
> has to do with plan text). I try to look at it tonight if noone can get to
> it sooner.
> 
> 
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
> 
> On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra 
> wrote:
> 
>> DRILL-4384 is a blocker for the release though
>> 
>> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam 
>> wrote:
>> 
>>> I reopened DRILL-4384 
>>> (blocker); it is assigned to Jacques.
>>> 
>>> On the latest master, the visualized and physical plan tabs on web UI are
>>> empty.
>>> 
>>> Thank you,
>>> Sudheesh
>>> 
 On Mar 7, 2016, at 11:39 AM, Jason Altekruse >> 
>>> wrote:
 
 I don't know if there are any specific time constraints for getting out
>>> the
 release, but I'm inclined to go with Vicky on DRILL-4477, at least some
 investigation into the scope of a fix would be good. I think it's
 reasonably big problem whether it's a regression or not.
 
 On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong 
>>> wrote:
 
> Hakim,
> 
> Yes, we'll include this in the release.
> 
> -- Zelaine
> 
> On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
>>> adene...@maprtech.com
>> 
> wrote:
> 
>> If we still have time, I would like to include DRILL-4457 [1], it's a
> wrong
>> results issue, I already have a fix and it's passing all tests, I am
>>> just
>> waiting for a review [2]
>> 
>> 
>> [1] https://issues.apache.org/jira/browse/DRILL-4457
>> [2] https://github.com/apache/drill/pull/410
>> 
>> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
>>> wrote:
>> 
>>> Hi guys,
>>> 
>>> I'm still waiting for the following to be reviewed/merged by today.
>>> 
>>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
>> Waiting
> to
>>> be merged (Jason)
>>> 
>>> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
>> expose
>>> their types within Calcite.) - (Jinfeng to review)
>>> 
>>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
>>> warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
>> reviewed.
>>> No +1)
>>> 
>>> DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
>>> reviewed. Ready to merge?)
>>> 
>>> Thanks
>>> 
>>> Parth
>>> 
>>> On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> wrote:
>>> 
 DRILL-4375/pr 402 - reviewed.
 
 On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
>>> ste...@activitystream.com>
 wrote:
 
> Please review this and then consider as a potential blocker:
> 
> https://issues.apache.org/jira/browse/DRILL-4482
> 
> 
> 
> On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
>>> wrote:
> 
>> Okay here's the list  of  JIRA's pending. It looks like we need
> to
>>> get
> some
>> more time to get the PRs still under review merged, so I'll wait
>> over
 the
>> weekend.
>> It looks like the PRs that no reviewers assigned in the list
> below
>>> may
> not
>> make it into the release.
>> 
>> Thanks
>> 
>> 
>> 
>> Committed for 1.6 -
>> 
>> DRILL-4384 - Query profile is missing important information on
>> WebUi
>>> -
>> Merged
>> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
>> DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> Merged
>> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
>>> Merged
>> DRILL-4465/pr 401 (Simplify Calcite parsing & planning
>> integration) -
>> Merged
>> DRILL-4467 - Baselines need updating.
>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
>>> Merged
>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
>>> Waiting
 to
>> be merged
>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> Waiting
>> to be merged
>> 
>> Need review -
>> DRILL-4281/pr 400 (Drill should support inbound impersonation)
>>> (Jacques
> to
>> review)
>> DRILL-4372/pr 377(?) (Drill 

Re: Time for the 1.6 Release

[Jacques Nadeau]

The new bug (currently filed under DRILL-4384) is a completely different
bug than the original (original one has to do with profile metrics, this
has to do with plan text). I try to look at it tonight if noone can get to
it sooner.


--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Mon, Mar 7, 2016 at 12:37 PM, Parth Chandra 
wrote:

> DRILL-4384 is a blocker for the release though
>
> On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam 
> wrote:
>
> > I reopened DRILL-4384 
> > (blocker); it is assigned to Jacques.
> >
> > On the latest master, the visualized and physical plan tabs on web UI are
> > empty.
> >
> > Thank you,
> > Sudheesh
> >
> > > On Mar 7, 2016, at 11:39 AM, Jason Altekruse  >
> > wrote:
> > >
> > > I don't know if there are any specific time constraints for getting out
> > the
> > > release, but I'm inclined to go with Vicky on DRILL-4477, at least some
> > > investigation into the scope of a fix would be good. I think it's
> > > reasonably big problem whether it's a regression or not.
> > >
> > > On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong 
> > wrote:
> > >
> > >> Hakim,
> > >>
> > >> Yes, we'll include this in the release.
> > >>
> > >> -- Zelaine
> > >>
> > >> On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> > adene...@maprtech.com
> > >>>
> > >> wrote:
> > >>
> > >>> If we still have time, I would like to include DRILL-4457 [1], it's a
> > >> wrong
> > >>> results issue, I already have a fix and it's passing all tests, I am
> > just
> > >>> waiting for a review [2]
> > >>>
> > >>>
> > >>> [1] https://issues.apache.org/jira/browse/DRILL-4457
> > >>> [2] https://github.com/apache/drill/pull/410
> > >>>
> > >>> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> > wrote:
> > >>>
> >  Hi guys,
> > 
> >  I'm still waiting for the following to be reviewed/merged by today.
> > 
> >  DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > >> to
> >  be merged (Jason)
> > 
> >  DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > >>> expose
> >  their types within Calcite.) - (Jinfeng to review)
> > 
> >  DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> >  warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > >>> reviewed.
> >  No +1)
> > 
> >  DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> >  reviewed. Ready to merge?)
> > 
> >  Thanks
> > 
> >  Parth
> > 
> >  On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > >> wrote:
> > 
> > > DRILL-4375/pr 402 - reviewed.
> > >
> > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> >  ste...@activitystream.com>
> > > wrote:
> > >
> > >> Please review this and then consider as a potential blocker:
> > >>
> > >> https://issues.apache.org/jira/browse/DRILL-4482
> > >>
> > >>
> > >>
> > >> On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
> >  wrote:
> > >>
> > >>> Okay here's the list  of  JIRA's pending. It looks like we need
> > >> to
> >  get
> > >> some
> > >>> more time to get the PRs still under review merged, so I'll wait
> > >>> over
> > > the
> > >>> weekend.
> > >>> It looks like the PRs that no reviewers assigned in the list
> > >> below
> >  may
> > >> not
> > >>> make it into the release.
> > >>>
> > >>> Thanks
> > >>>
> > >>>
> > >>>
> > >>> Committed for 1.6 -
> > >>>
> > >>> DRILL-4384 - Query profile is missing important information on
> > >>> WebUi
> >  -
> > >>> Merged
> > >>> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > >>> DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > >> Merged
> > >>> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> >  Merged
> > >>> DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > >>> integration) -
> > >>> Merged
> > >>> DRILL-4467 - Baselines need updating.
> > >>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> >  Merged
> > >>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> >  Waiting
> > > to
> > >>> be merged
> > >>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > >> Waiting
> > >>> to be merged
> > >>>
> > >>> Need review -
> > >>> DRILL-4281/pr 400 (Drill should support inbound impersonation)
> >  (Jacques
> > >> to
> > >>> review)
> > >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > >>> correctly
> > >> expose
> > >>> their types within Calcite.) - (Jinfeng to review)
> > >>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> > >> with
> > 

Re: Time for the 1.6 Release

[Parth Chandra]

DRILL-4384 is a blocker for the release though

On Mon, Mar 7, 2016 at 12:01 PM, Sudheesh Katkam 
wrote:

> I reopened DRILL-4384 
> (blocker); it is assigned to Jacques.
>
> On the latest master, the visualized and physical plan tabs on web UI are
> empty.
>
> Thank you,
> Sudheesh
>
> > On Mar 7, 2016, at 11:39 AM, Jason Altekruse 
> wrote:
> >
> > I don't know if there are any specific time constraints for getting out
> the
> > release, but I'm inclined to go with Vicky on DRILL-4477, at least some
> > investigation into the scope of a fix would be good. I think it's
> > reasonably big problem whether it's a regression or not.
> >
> > On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong 
> wrote:
> >
> >> Hakim,
> >>
> >> Yes, we'll include this in the release.
> >>
> >> -- Zelaine
> >>
> >> On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> adene...@maprtech.com
> >>>
> >> wrote:
> >>
> >>> If we still have time, I would like to include DRILL-4457 [1], it's a
> >> wrong
> >>> results issue, I already have a fix and it's passing all tests, I am
> just
> >>> waiting for a review [2]
> >>>
> >>>
> >>> [1] https://issues.apache.org/jira/browse/DRILL-4457
> >>> [2] https://github.com/apache/drill/pull/410
> >>>
> >>> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> wrote:
> >>>
>  Hi guys,
> 
>  I'm still waiting for the following to be reviewed/merged by today.
> 
>  DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting
> >> to
>  be merged (Jason)
> 
>  DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> >>> expose
>  their types within Calcite.) - (Jinfeng to review)
> 
>  DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
>  warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> >>> reviewed.
>  No +1)
> 
>  DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
>  reviewed. Ready to merge?)
> 
>  Thanks
> 
>  Parth
> 
>  On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> >> wrote:
> 
> > DRILL-4375/pr 402 - reviewed.
> >
> > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
>  ste...@activitystream.com>
> > wrote:
> >
> >> Please review this and then consider as a potential blocker:
> >>
> >> https://issues.apache.org/jira/browse/DRILL-4482
> >>
> >>
> >>
> >> On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
>  wrote:
> >>
> >>> Okay here's the list  of  JIRA's pending. It looks like we need
> >> to
>  get
> >> some
> >>> more time to get the PRs still under review merged, so I'll wait
> >>> over
> > the
> >>> weekend.
> >>> It looks like the PRs that no reviewers assigned in the list
> >> below
>  may
> >> not
> >>> make it into the release.
> >>>
> >>> Thanks
> >>>
> >>>
> >>>
> >>> Committed for 1.6 -
> >>>
> >>> DRILL-4384 - Query profile is missing important information on
> >>> WebUi
>  -
> >>> Merged
> >>> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> >>> DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> >> Merged
> >>> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
>  Merged
> >>> DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> >>> integration) -
> >>> Merged
> >>> DRILL-4467 - Baselines need updating.
> >>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
>  Merged
> >>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
>  Waiting
> > to
> >>> be merged
> >>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> >> Waiting
> >>> to be merged
> >>>
> >>> Need review -
> >>> DRILL-4281/pr 400 (Drill should support inbound impersonation)
>  (Jacques
> >> to
> >>> review)
> >>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
> >>> correctly
> >> expose
> >>> their types within Calcite.) - (Jinfeng to review)
> >>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> >> with
> >>> warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> >>> review.)
> >>> DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
>  review)
> >>>
> >>>
> >>>
> >>> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> >>> DRILL-4332/pr 389 (Make vector comparison order stable in test
> > framework)
> >>> DRILL-4411/pr 381 (hash join over-memory condition)
> >>> DRILL-4387/pr 379 (GroupScan should not use star column)
> >>> DRILL-4184/pr 372 (support variable length decimal fields in
> >>> parquet)
> >>> DRILL-4120 - dir0 does not work when the directory structure
> >>> 

Re: Time for the 1.6 Release

[Parth Chandra]

I'm inclined to go ahead with the release unless DRILL-4477 is a
regression.

On Mon, Mar 7, 2016 at 11:39 AM, Jason Altekruse 
wrote:

> I don't know if there are any specific time constraints for getting out the
> release, but I'm inclined to go with Vicky on DRILL-4477, at least some
> investigation into the scope of a fix would be good. I think it's
> reasonably big problem whether it's a regression or not.
>
> On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong  wrote:
>
> > Hakim,
> >
> > Yes, we'll include this in the release.
> >
> > -- Zelaine
> >
> > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> adene...@maprtech.com
> > >
> > wrote:
> >
> > > If we still have time, I would like to include DRILL-4457 [1], it's a
> > wrong
> > > results issue, I already have a fix and it's passing all tests, I am
> just
> > > waiting for a review [2]
> > >
> > >
> > > [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > [2] https://github.com/apache/drill/pull/410
> > >
> > > On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> wrote:
> > >
> > > > Hi guys,
> > > >
> > > > I'm still waiting for the following to be reviewed/merged by today.
> > > >
> > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > to
> > > > be merged (Jason)
> > > >
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - (Jinfeng to review)
> > > >
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > > reviewed.
> > > > No +1)
> > > >
> > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > > reviewed. Ready to merge?)
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > > On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > wrote:
> > > >
> > > > > DRILL-4375/pr 402 - reviewed.
> > > > >
> > > > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > > > ste...@activitystream.com>
> > > > > wrote:
> > > > >
> > > > > > Please review this and then consider as a potential blocker:
> > > > > >
> > > > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  >
> > > > wrote:
> > > > > >
> > > > > > > Okay here's the list  of  JIRA's pending. It looks like we need
> > to
> > > > get
> > > > > > some
> > > > > > > more time to get the PRs still under review merged, so I'll
> wait
> > > over
> > > > > the
> > > > > > > weekend.
> > > > > > > It looks like the PRs that no reviewers assigned in the list
> > below
> > > > may
> > > > > > not
> > > > > > > make it into the release.
> > > > > > >
> > > > > > > Thanks
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Committed for 1.6 -
> > > > > > >
> > > > > > > DRILL-4384 - Query profile is missing important information on
> > > WebUi
> > > > -
> > > > > > > Merged
> > > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > Merged
> > > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
> -
> > > > Merged
> > > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > > integration) -
> > > > > > > Merged
> > > > > > > DRILL-4467 - Baselines need updating.
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > > > Merged
> > > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > > Waiting
> > > > > to
> > > > > > > be merged
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is
> used..) -
> > > > > > Waiting
> > > > > > > to be merged
> > > > > > >
> > > > > > > Need review -
> > > > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > (Jacques
> > > > > > to
> > > > > > > review)
> > > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > correctly
> > > > > > expose
> > > > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> > with
> > > > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> > > review.)
> > > > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > > > review)
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > > > framework)
> > > > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> > > parquet)
> > > > > > > DRILL-4120 - dir0 does not work when the directory structure
> > > contains
> > > > > > Avro
> > > > > > > files - 

Re: Time for the 1.6 Release

[Sudheesh Katkam]

I reopened DRILL-4384  
(blocker); it is assigned to Jacques.

On the latest master, the visualized and physical plan tabs on web UI are empty.

Thank you,
Sudheesh

> On Mar 7, 2016, at 11:39 AM, Jason Altekruse  wrote:
> 
> I don't know if there are any specific time constraints for getting out the
> release, but I'm inclined to go with Vicky on DRILL-4477, at least some
> investigation into the scope of a fix would be good. I think it's
> reasonably big problem whether it's a regression or not.
> 
> On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong  wrote:
> 
>> Hakim,
>> 
>> Yes, we'll include this in the release.
>> 
>> -- Zelaine
>> 
>> On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche >> 
>> wrote:
>> 
>>> If we still have time, I would like to include DRILL-4457 [1], it's a
>> wrong
>>> results issue, I already have a fix and it's passing all tests, I am just
>>> waiting for a review [2]
>>> 
>>> 
>>> [1] https://issues.apache.org/jira/browse/DRILL-4457
>>> [2] https://github.com/apache/drill/pull/410
>>> 
>>> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra  wrote:
>>> 
 Hi guys,
 
 I'm still waiting for the following to be reviewed/merged by today.
 
 DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting
>> to
 be merged (Jason)
 
 DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
>>> expose
 their types within Calcite.) - (Jinfeng to review)
 
 DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
 warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
>>> reviewed.
 No +1)
 
 DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
 reviewed. Ready to merge?)
 
 Thanks
 
 Parth
 
 On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
>> wrote:
 
> DRILL-4375/pr 402 - reviewed.
> 
> On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
 ste...@activitystream.com>
> wrote:
> 
>> Please review this and then consider as a potential blocker:
>> 
>> https://issues.apache.org/jira/browse/DRILL-4482
>> 
>> 
>> 
>> On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
 wrote:
>> 
>>> Okay here's the list  of  JIRA's pending. It looks like we need
>> to
 get
>> some
>>> more time to get the PRs still under review merged, so I'll wait
>>> over
> the
>>> weekend.
>>> It looks like the PRs that no reviewers assigned in the list
>> below
 may
>> not
>>> make it into the release.
>>> 
>>> Thanks
>>> 
>>> 
>>> 
>>> Committed for 1.6 -
>>> 
>>> DRILL-4384 - Query profile is missing important information on
>>> WebUi
 -
>>> Merged
>>> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
>>> DRILL-4410/pr 380 (listvector should initiatlize bits...) -
>> Merged
>>> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
 Merged
>>> DRILL-4465/pr 401 (Simplify Calcite parsing & planning
>>> integration) -
>>> Merged
>>> DRILL-4467 - Baselines need updating.
>>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
 Merged
>>> DRILL-4437 (and others)/pr 394 (Operator unit test framework).
 Waiting
> to
>>> be merged
>>> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
>> Waiting
>>> to be merged
>>> 
>>> Need review -
>>> DRILL-4281/pr 400 (Drill should support inbound impersonation)
 (Jacques
>> to
>>> review)
>>> DRILL-4372/pr 377(?) (Drill Operators and Functions should
>>> correctly
>> expose
>>> their types within Calcite.) - (Jinfeng to review)
>>> DRILL-4313/pr 396  (Improved client randomization. Update JIRA
>> with
>>> warnings about using the feature ) (Hanifi/Sudheesh/Paul to
>>> review.)
>>> DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
 review)
>>> 
>>> 
>>> 
>>> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
>>> DRILL-4332/pr 389 (Make vector comparison order stable in test
> framework)
>>> DRILL-4411/pr 381 (hash join over-memory condition)
>>> DRILL-4387/pr 379 (GroupScan should not use star column)
>>> DRILL-4184/pr 372 (support variable length decimal fields in
>>> parquet)
>>> DRILL-4120 - dir0 does not work when the directory structure
>>> contains
>> Avro
>>> files - Partial patch available.
>>> DRILL-4203/pr 341 (fix dates written into parquet files to
>> conform
>>> to
>>> parquet format spec)
>>> 
>>> 
>>> On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau <
>> jacq...@dremio.com
 
>> wrote:
>>> 
 Awesome. Thanks Chun!
 On Mar 4, 2016 5:51 PM, "Chun Chang" 
>>> 

Re: Time for the 1.6 Release

[Jason Altekruse]

I don't know if there are any specific time constraints for getting out the
release, but I'm inclined to go with Vicky on DRILL-4477, at least some
investigation into the scope of a fix would be good. I think it's
reasonably big problem whether it's a regression or not.

On Mon, Mar 7, 2016 at 11:35 AM, Zelaine Fong  wrote:

> Hakim,
>
> Yes, we'll include this in the release.
>
> -- Zelaine
>
> On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche  >
> wrote:
>
> > If we still have time, I would like to include DRILL-4457 [1], it's a
> wrong
> > results issue, I already have a fix and it's passing all tests, I am just
> > waiting for a review [2]
> >
> >
> > [1] https://issues.apache.org/jira/browse/DRILL-4457
> > [2] https://github.com/apache/drill/pull/410
> >
> > On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra  wrote:
> >
> > > Hi guys,
> > >
> > > I'm still waiting for the following to be reviewed/merged by today.
> > >
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting
> to
> > > be merged (Jason)
> > >
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) - (Jinfeng to review)
> > >
> > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > reviewed.
> > > No +1)
> > >
> > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > reviewed. Ready to merge?)
> > >
> > > Thanks
> > >
> > > Parth
> > >
> > > On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> wrote:
> > >
> > > > DRILL-4375/pr 402 - reviewed.
> > > >
> > > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > > ste...@activitystream.com>
> > > > wrote:
> > > >
> > > > > Please review this and then consider as a potential blocker:
> > > > >
> > > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > > >
> > > > >
> > > > >
> > > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
> > > wrote:
> > > > >
> > > > > > Okay here's the list  of  JIRA's pending. It looks like we need
> to
> > > get
> > > > > some
> > > > > > more time to get the PRs still under review merged, so I'll wait
> > over
> > > > the
> > > > > > weekend.
> > > > > > It looks like the PRs that no reviewers assigned in the list
> below
> > > may
> > > > > not
> > > > > > make it into the release.
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > >
> > > > > >
> > > > > > Committed for 1.6 -
> > > > > >
> > > > > > DRILL-4384 - Query profile is missing important information on
> > WebUi
> > > -
> > > > > > Merged
> > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> Merged
> > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > > Merged
> > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > integration) -
> > > > > > Merged
> > > > > > DRILL-4467 - Baselines need updating.
> > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > > Merged
> > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > Waiting
> > > > to
> > > > > > be merged
> > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > > > > Waiting
> > > > > > to be merged
> > > > > >
> > > > > > Need review -
> > > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > (Jacques
> > > > > to
> > > > > > review)
> > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > correctly
> > > > > expose
> > > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> with
> > > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> > review.)
> > > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > > review)
> > > > > >
> > > > > >
> > > > > >
> > > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > > framework)
> > > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> > parquet)
> > > > > > DRILL-4120 - dir0 does not work when the directory structure
> > contains
> > > > > Avro
> > > > > > files - Partial patch available.
> > > > > > DRILL-4203/pr 341 (fix dates written into parquet files to
> conform
> > to
> > > > > > parquet format spec)
> > > > > >
> > > > > >
> > > > > > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau <
> jacq...@dremio.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > Awesome. Thanks Chun!
> > > > > > > On Mar 4, 2016 5:51 PM, "Chun Chang" 
> > wrote:
> > > > > > >
> > > > > > > > Jacques submitted a PR for 

Re: Time for the 1.6 Release

[Zelaine Fong]

Hakim,

Yes, we'll include this in the release.

-- Zelaine

On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche 
wrote:

> If we still have time, I would like to include DRILL-4457 [1], it's a wrong
> results issue, I already have a fix and it's passing all tests, I am just
> waiting for a review [2]
>
>
> [1] https://issues.apache.org/jira/browse/DRILL-4457
> [2] https://github.com/apache/drill/pull/410
>
> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra  wrote:
>
> > Hi guys,
> >
> > I'm still waiting for the following to be reviewed/merged by today.
> >
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> > be merged (Jason)
> >
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - (Jinfeng to review)
> >
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> reviewed.
> > No +1)
> >
> > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > reviewed. Ready to merge?)
> >
> > Thanks
> >
> > Parth
> >
> > On Sun, Mar 6, 2016 at 12:01 PM, Aditya  wrote:
> >
> > > DRILL-4375/pr 402 - reviewed.
> > >
> > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > ste...@activitystream.com>
> > > wrote:
> > >
> > > > Please review this and then consider as a potential blocker:
> > > >
> > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > >
> > > >
> > > >
> > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
> > wrote:
> > > >
> > > > > Okay here's the list  of  JIRA's pending. It looks like we need to
> > get
> > > > some
> > > > > more time to get the PRs still under review merged, so I'll wait
> over
> > > the
> > > > > weekend.
> > > > > It looks like the PRs that no reviewers assigned in the list below
> > may
> > > > not
> > > > > make it into the release.
> > > > >
> > > > > Thanks
> > > > >
> > > > >
> > > > >
> > > > > Committed for 1.6 -
> > > > >
> > > > > DRILL-4384 - Query profile is missing important information on
> WebUi
> > -
> > > > > Merged
> > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > Merged
> > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> integration) -
> > > > > Merged
> > > > > DRILL-4467 - Baselines need updating.
> > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > Merged
> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > Waiting
> > > to
> > > > > be merged
> > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > > > Waiting
> > > > > to be merged
> > > > >
> > > > > Need review -
> > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > (Jacques
> > > > to
> > > > > review)
> > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> correctly
> > > > expose
> > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> review.)
> > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > review)
> > > > >
> > > > >
> > > > >
> > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > framework)
> > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> parquet)
> > > > > DRILL-4120 - dir0 does not work when the directory structure
> contains
> > > > Avro
> > > > > files - Partial patch available.
> > > > > DRILL-4203/pr 341 (fix dates written into parquet files to conform
> to
> > > > > parquet format spec)
> > > > >
> > > > >
> > > > > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau  >
> > > > wrote:
> > > > >
> > > > > > Awesome. Thanks Chun!
> > > > > > On Mar 4, 2016 5:51 PM, "Chun Chang" 
> wrote:
> > > > > >
> > > > > > > Jacques submitted a PR for fixing the failed baselines. I've
> > merged
> > > > > them
> > > > > > > into automation master and confirmed the failed tests are all
> > > passing
> > > > > > now.
> > > > > > > Thanks.
> > > > > > >
> > > > > > > -Chun
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau <
> > > jacq...@dremio.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > I think we need to include DRILL-4467
> > > > > > > > . I think
> it
> > > is
> > > > a
> > > > > > one
> > > > > > > > line patch and it provides unpredictable plans at a minimum
> but
> > > may
> > > > > 

Re: Time for the 1.6 Release

[Zelaine Fong]

Vicky,

Per our discussion today, let us know if this issue also exists in 1.4.
>From the discussion, it sounds like this is not a recent regression.

-- Zelaine

On Mon, Mar 7, 2016 at 10:44 AM, Vicky Markman 
wrote:

> DRILL-4477 is a really bad bug and should be fixed in 1.6
>
> On Mon, Mar 7, 2016 at 9:40 AM, Jason Altekruse 
> wrote:
>
> > Hakim,
> >
> > The patch looks good, I just gave you a +1.
> >
> > I will be merging the operator unit tests today, I would recommend
> checking
> > it out for writing tests like this in future commits.
> >
> > - Jason
> >
> > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> adene...@maprtech.com
> > >
> > wrote:
> >
> > > If we still have time, I would like to include DRILL-4457 [1], it's a
> > wrong
> > > results issue, I already have a fix and it's passing all tests, I am
> just
> > > waiting for a review [2]
> > >
> > >
> > > [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > [2] https://github.com/apache/drill/pull/410
> > >
> > > On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> wrote:
> > >
> > > > Hi guys,
> > > >
> > > > I'm still waiting for the following to be reviewed/merged by today.
> > > >
> > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > to
> > > > be merged (Jason)
> > > >
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - (Jinfeng to review)
> > > >
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > > reviewed.
> > > > No +1)
> > > >
> > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > > reviewed. Ready to merge?)
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > > On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > wrote:
> > > >
> > > > > DRILL-4375/pr 402 - reviewed.
> > > > >
> > > > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > > > ste...@activitystream.com>
> > > > > wrote:
> > > > >
> > > > > > Please review this and then consider as a potential blocker:
> > > > > >
> > > > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  >
> > > > wrote:
> > > > > >
> > > > > > > Okay here's the list  of  JIRA's pending. It looks like we need
> > to
> > > > get
> > > > > > some
> > > > > > > more time to get the PRs still under review merged, so I'll
> wait
> > > over
> > > > > the
> > > > > > > weekend.
> > > > > > > It looks like the PRs that no reviewers assigned in the list
> > below
> > > > may
> > > > > > not
> > > > > > > make it into the release.
> > > > > > >
> > > > > > > Thanks
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Committed for 1.6 -
> > > > > > >
> > > > > > > DRILL-4384 - Query profile is missing important information on
> > > WebUi
> > > > -
> > > > > > > Merged
> > > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > Merged
> > > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
> -
> > > > Merged
> > > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > > integration) -
> > > > > > > Merged
> > > > > > > DRILL-4467 - Baselines need updating.
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > > > Merged
> > > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > > Waiting
> > > > > to
> > > > > > > be merged
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is
> used..) -
> > > > > > Waiting
> > > > > > > to be merged
> > > > > > >
> > > > > > > Need review -
> > > > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > (Jacques
> > > > > > to
> > > > > > > review)
> > > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > correctly
> > > > > > expose
> > > > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> > with
> > > > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> > > review.)
> > > > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > > > review)
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > > > framework)
> > > > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> > > parquet)
> > > > > > > DRILL-4120 - dir0 does not work when the directory structure
> > > contains
> > > > > > Avro
> > > > > 

Re: Time for the 1.6 Release

[Abdel Hakim Deneche]

Just merged DRILL-4457 into master.

Thanks

On Mon, Mar 7, 2016 at 7:44 PM, Vicky Markman  wrote:

> DRILL-4477 is a really bad bug and should be fixed in 1.6
>
> On Mon, Mar 7, 2016 at 9:40 AM, Jason Altekruse 
> wrote:
>
> > Hakim,
> >
> > The patch looks good, I just gave you a +1.
> >
> > I will be merging the operator unit tests today, I would recommend
> checking
> > it out for writing tests like this in future commits.
> >
> > - Jason
> >
> > On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche <
> adene...@maprtech.com
> > >
> > wrote:
> >
> > > If we still have time, I would like to include DRILL-4457 [1], it's a
> > wrong
> > > results issue, I already have a fix and it's passing all tests, I am
> just
> > > waiting for a review [2]
> > >
> > >
> > > [1] https://issues.apache.org/jira/browse/DRILL-4457
> > > [2] https://github.com/apache/drill/pull/410
> > >
> > > On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra 
> wrote:
> > >
> > > > Hi guys,
> > > >
> > > > I'm still waiting for the following to be reviewed/merged by today.
> > > >
> > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > to
> > > > be merged (Jason)
> > > >
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - (Jinfeng to review)
> > > >
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> > > reviewed.
> > > > No +1)
> > > >
> > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > > > reviewed. Ready to merge?)
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > > > On Sun, Mar 6, 2016 at 12:01 PM, Aditya 
> > wrote:
> > > >
> > > > > DRILL-4375/pr 402 - reviewed.
> > > > >
> > > > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > > > ste...@activitystream.com>
> > > > > wrote:
> > > > >
> > > > > > Please review this and then consider as a potential blocker:
> > > > > >
> > > > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  >
> > > > wrote:
> > > > > >
> > > > > > > Okay here's the list  of  JIRA's pending. It looks like we need
> > to
> > > > get
> > > > > > some
> > > > > > > more time to get the PRs still under review merged, so I'll
> wait
> > > over
> > > > > the
> > > > > > > weekend.
> > > > > > > It looks like the PRs that no reviewers assigned in the list
> > below
> > > > may
> > > > > > not
> > > > > > > make it into the release.
> > > > > > >
> > > > > > > Thanks
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Committed for 1.6 -
> > > > > > >
> > > > > > > DRILL-4384 - Query profile is missing important information on
> > > WebUi
> > > > -
> > > > > > > Merged
> > > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > Merged
> > > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
> -
> > > > Merged
> > > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > > integration) -
> > > > > > > Merged
> > > > > > > DRILL-4467 - Baselines need updating.
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > > > Merged
> > > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > > Waiting
> > > > > to
> > > > > > > be merged
> > > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is
> used..) -
> > > > > > Waiting
> > > > > > > to be merged
> > > > > > >
> > > > > > > Need review -
> > > > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > (Jacques
> > > > > > to
> > > > > > > review)
> > > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > > correctly
> > > > > > expose
> > > > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> > with
> > > > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> > > review.)
> > > > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > > > review)
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > > > framework)
> > > > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> > > parquet)
> > > > > > > DRILL-4120 - dir0 does not work when the directory structure
> > > contains
> > > > > > Avro
> > > > > > > files - Partial patch available.
> > > > > > > DRILL-4203/pr 341 (fix dates written into parquet files to
> > 

Re: Time for the 1.6 Release

[Jason Altekruse]

Hakim,

The patch looks good, I just gave you a +1.

I will be merging the operator unit tests today, I would recommend checking
it out for writing tests like this in future commits.

- Jason

On Mon, Mar 7, 2016 at 9:31 AM, Abdel Hakim Deneche 
wrote:

> If we still have time, I would like to include DRILL-4457 [1], it's a wrong
> results issue, I already have a fix and it's passing all tests, I am just
> waiting for a review [2]
>
>
> [1] https://issues.apache.org/jira/browse/DRILL-4457
> [2] https://github.com/apache/drill/pull/410
>
> On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra  wrote:
>
> > Hi guys,
> >
> > I'm still waiting for the following to be reviewed/merged by today.
> >
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> > be merged (Jason)
> >
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - (Jinfeng to review)
> >
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch
> reviewed.
> > No +1)
> >
> > DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> > reviewed. Ready to merge?)
> >
> > Thanks
> >
> > Parth
> >
> > On Sun, Mar 6, 2016 at 12:01 PM, Aditya  wrote:
> >
> > > DRILL-4375/pr 402 - reviewed.
> > >
> > > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> > ste...@activitystream.com>
> > > wrote:
> > >
> > > > Please review this and then consider as a potential blocker:
> > > >
> > > > https://issues.apache.org/jira/browse/DRILL-4482
> > > >
> > > >
> > > >
> > > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
> > wrote:
> > > >
> > > > > Okay here's the list  of  JIRA's pending. It looks like we need to
> > get
> > > > some
> > > > > more time to get the PRs still under review merged, so I'll wait
> over
> > > the
> > > > > weekend.
> > > > > It looks like the PRs that no reviewers assigned in the list below
> > may
> > > > not
> > > > > make it into the release.
> > > > >
> > > > > Thanks
> > > > >
> > > > >
> > > > >
> > > > > Committed for 1.6 -
> > > > >
> > > > > DRILL-4384 - Query profile is missing important information on
> WebUi
> > -
> > > > > Merged
> > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > Merged
> > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> integration) -
> > > > > Merged
> > > > > DRILL-4467 - Baselines need updating.
> > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > Merged
> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > Waiting
> > > to
> > > > > be merged
> > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > > > Waiting
> > > > > to be merged
> > > > >
> > > > > Need review -
> > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > (Jacques
> > > > to
> > > > > review)
> > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> correctly
> > > > expose
> > > > > their types within Calcite.) - (Jinfeng to review)
> > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to
> review.)
> > > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> > review)
> > > > >
> > > > >
> > > > >
> > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > framework)
> > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > > DRILL-4184/pr 372 (support variable length decimal fields in
> parquet)
> > > > > DRILL-4120 - dir0 does not work when the directory structure
> contains
> > > > Avro
> > > > > files - Partial patch available.
> > > > > DRILL-4203/pr 341 (fix dates written into parquet files to conform
> to
> > > > > parquet format spec)
> > > > >
> > > > >
> > > > > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau  >
> > > > wrote:
> > > > >
> > > > > > Awesome. Thanks Chun!
> > > > > > On Mar 4, 2016 5:51 PM, "Chun Chang" 
> wrote:
> > > > > >
> > > > > > > Jacques submitted a PR for fixing the failed baselines. I've
> > merged
> > > > > them
> > > > > > > into automation master and confirmed the failed tests are all
> > > passing
> > > > > > now.
> > > > > > > Thanks.
> > > > > > >
> > > > > > > -Chun
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau <
> > > jacq...@dremio.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > I think we need to include DRILL-4467
> > > > > > > > . I think
> it
> > > 

Re: Time for the 1.6 Release

[Abdel Hakim Deneche]

If we still have time, I would like to include DRILL-4457 [1], it's a wrong
results issue, I already have a fix and it's passing all tests, I am just
waiting for a review [2]


[1] https://issues.apache.org/jira/browse/DRILL-4457
[2] https://github.com/apache/drill/pull/410

On Mon, Mar 7, 2016 at 4:50 PM, Parth Chandra  wrote:

> Hi guys,
>
> I'm still waiting for the following to be reviewed/merged by today.
>
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> be merged (Jason)
>
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - (Jinfeng to review)
>
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch reviewed.
> No +1)
>
> DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
> reviewed. Ready to merge?)
>
> Thanks
>
> Parth
>
> On Sun, Mar 6, 2016 at 12:01 PM, Aditya  wrote:
>
> > DRILL-4375/pr 402 - reviewed.
> >
> > On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter <
> ste...@activitystream.com>
> > wrote:
> >
> > > Please review this and then consider as a potential blocker:
> > >
> > > https://issues.apache.org/jira/browse/DRILL-4482
> > >
> > >
> > >
> > > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra 
> wrote:
> > >
> > > > Okay here's the list  of  JIRA's pending. It looks like we need to
> get
> > > some
> > > > more time to get the PRs still under review merged, so I'll wait over
> > the
> > > > weekend.
> > > > It looks like the PRs that no reviewers assigned in the list below
> may
> > > not
> > > > make it into the release.
> > > >
> > > > Thanks
> > > >
> > > >
> > > >
> > > > Committed for 1.6 -
> > > >
> > > > DRILL-4384 - Query profile is missing important information on WebUi
> -
> > > > Merged
> > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> Merged
> > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > > > Merged
> > > > DRILL-4467 - Baselines need updating.
> > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> Merged
> > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > to
> > > > be merged
> > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > > Waiting
> > > > to be merged
> > > >
> > > > Need review -
> > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> (Jacques
> > > to
> > > > review)
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - (Jinfeng to review)
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to review.)
> > > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to
> review)
> > > >
> > > >
> > > >
> > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > framework)
> > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > > > DRILL-4120 - dir0 does not work when the directory structure contains
> > > Avro
> > > > files - Partial patch available.
> > > > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > > > parquet format spec)
> > > >
> > > >
> > > > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau 
> > > wrote:
> > > >
> > > > > Awesome. Thanks Chun!
> > > > > On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:
> > > > >
> > > > > > Jacques submitted a PR for fixing the failed baselines. I've
> merged
> > > > them
> > > > > > into automation master and confirmed the failed tests are all
> > passing
> > > > > now.
> > > > > > Thanks.
> > > > > >
> > > > > > -Chun
> > > > > >
> > > > > >
> > > > > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau <
> > jacq...@dremio.com>
> > > > > > wrote:
> > > > > >
> > > > > > > I think we need to include DRILL-4467
> > > > > > > . I think it
> > is
> > > a
> > > > > one
> > > > > > > line patch and it provides unpredictable plans at a minimum but
> > may
> > > > > also
> > > > > > > present invalid result. Still need to think through the second
> > > half.
> > > > > I've
> > > > > > > seen this plan instability in some of my recent test runs (even
> > > > without
> > > > > > > Java 8) when running extended HBase tests.
> > > > > > >
> > > > > > > --
> > > > > > > Jacques Nadeau
> > > > > > > CTO and Co-Founder, Dremio
> > > > > > >
> > > > > > > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra <
> > 

Re: Time for the 1.6 Release

[Parth Chandra]

Hi guys,

I'm still waiting for the following to be reviewed/merged by today.

DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
be merged (Jason)

DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
their types within Calcite.) - (Jinfeng to review)

DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
warnings about using the feature ) (Hanifi/Sudheesh/Paul - patch reviewed.
No +1)

DRILL-4375/pr 402 (Fix the maven release profile) - (Jason - patch
reviewed. Ready to merge?)

Thanks

Parth

On Sun, Mar 6, 2016 at 12:01 PM, Aditya  wrote:

> DRILL-4375/pr 402 - reviewed.
>
> On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter 
> wrote:
>
> > Please review this and then consider as a potential blocker:
> >
> > https://issues.apache.org/jira/browse/DRILL-4482
> >
> >
> >
> > On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  wrote:
> >
> > > Okay here's the list  of  JIRA's pending. It looks like we need to get
> > some
> > > more time to get the PRs still under review merged, so I'll wait over
> the
> > > weekend.
> > > It looks like the PRs that no reviewers assigned in the list below may
> > not
> > > make it into the release.
> > >
> > > Thanks
> > >
> > >
> > >
> > > Committed for 1.6 -
> > >
> > > DRILL-4384 - Query profile is missing important information on WebUi -
> > > Merged
> > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > > Merged
> > > DRILL-4467 - Baselines need updating.
> > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) Merged
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting
> to
> > > be merged
> > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> > Waiting
> > > to be merged
> > >
> > > Need review -
> > > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques
> > to
> > > review)
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) - (Jinfeng to review)
> > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > warnings about using the feature ) (Hanifi/Sudheesh/Paul to review.)
> > > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to review)
> > >
> > >
> > >
> > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> framework)
> > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > > DRILL-4120 - dir0 does not work when the directory structure contains
> > Avro
> > > files - Partial patch available.
> > > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > > parquet format spec)
> > >
> > >
> > > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau 
> > wrote:
> > >
> > > > Awesome. Thanks Chun!
> > > > On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:
> > > >
> > > > > Jacques submitted a PR for fixing the failed baselines. I've merged
> > > them
> > > > > into automation master and confirmed the failed tests are all
> passing
> > > > now.
> > > > > Thanks.
> > > > >
> > > > > -Chun
> > > > >
> > > > >
> > > > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau <
> jacq...@dremio.com>
> > > > > wrote:
> > > > >
> > > > > > I think we need to include DRILL-4467
> > > > > > . I think it
> is
> > a
> > > > one
> > > > > > line patch and it provides unpredictable plans at a minimum but
> may
> > > > also
> > > > > > present invalid result. Still need to think through the second
> > half.
> > > > I've
> > > > > > seen this plan instability in some of my recent test runs (even
> > > without
> > > > > > Java 8) when running extended HBase tests.
> > > > > >
> > > > > > --
> > > > > > Jacques Nadeau
> > > > > > CTO and Co-Founder, Dremio
> > > > > >
> > > > > > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra <
> par...@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > Updated list  (I'll follow up with the folks named here
> > > separately) -
> > > > > > >
> > > > > > > Committed for 1.6 -
> > > > > > >
> > > > > > > DRILL-4384 - Query profile is missing important information on
> > > WebUi
> > > > -
> > > > > > > Merged
> > > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> > Merged
> > > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
> -
> > > > Merged
> > > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > > 

Re: Time for the 1.6 Release

[Aditya]

DRILL-4375/pr 402 - reviewed.

On Sun, Mar 6, 2016 at 12:48 AM, Stefán Baxter 
wrote:

> Please review this and then consider as a potential blocker:
>
> https://issues.apache.org/jira/browse/DRILL-4482
>
>
>
> On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  wrote:
>
> > Okay here's the list  of  JIRA's pending. It looks like we need to get
> some
> > more time to get the PRs still under review merged, so I'll wait over the
> > weekend.
> > It looks like the PRs that no reviewers assigned in the list below may
> not
> > make it into the release.
> >
> > Thanks
> >
> >
> >
> > Committed for 1.6 -
> >
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Merged
> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > Merged
> > DRILL-4467 - Baselines need updating.
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) Merged
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> > be merged
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -
> Waiting
> > to be merged
> >
> > Need review -
> > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques
> to
> > review)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - (Jinfeng to review)
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Hanifi/Sudheesh/Paul to review.)
> > DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to review)
> >
> >
> >
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > DRILL-4120 - dir0 does not work when the directory structure contains
> Avro
> > files - Partial patch available.
> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > parquet format spec)
> >
> >
> > On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau 
> wrote:
> >
> > > Awesome. Thanks Chun!
> > > On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:
> > >
> > > > Jacques submitted a PR for fixing the failed baselines. I've merged
> > them
> > > > into automation master and confirmed the failed tests are all passing
> > > now.
> > > > Thanks.
> > > >
> > > > -Chun
> > > >
> > > >
> > > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau 
> > > > wrote:
> > > >
> > > > > I think we need to include DRILL-4467
> > > > > . I think it is
> a
> > > one
> > > > > line patch and it provides unpredictable plans at a minimum but may
> > > also
> > > > > present invalid result. Still need to think through the second
> half.
> > > I've
> > > > > seen this plan instability in some of my recent test runs (even
> > without
> > > > > Java 8) when running extended HBase tests.
> > > > >
> > > > > --
> > > > > Jacques Nadeau
> > > > > CTO and Co-Founder, Dremio
> > > > >
> > > > > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra 
> > > > wrote:
> > > > >
> > > > > > Updated list  (I'll follow up with the folks named here
> > separately) -
> > > > > >
> > > > > > Committed for 1.6 -
> > > > > >
> > > > > > DRILL-4384 - Query profile is missing important information on
> > WebUi
> > > -
> > > > > > Merged
> > > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) -
> Merged
> > > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > > Merged
> > > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> > integration) -
> > > > > > Waiting to be merged
> > > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > > Waiting
> > > > to
> > > > > > be merged.
> > > > > >
> > > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > (Jacques
> > > > > to
> > > > > > review)
> > > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> > correctly
> > > > > expose
> > > > > > their types within Calcite.) - Waiting for Aman to review.
> (Owners:
> > > > > Hsuan,
> > > > > > Jinfeng, Aman, Sudheesh)
> > > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA
> with
> > > > > > warnings about using the feature ) (Sudheesh to review.)
> > > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > (Aman
> > > > to
> > > > > > review)
> > > > > > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner:
> > > > 

Re: Time for the 1.6 Release

[Stefán Baxter]

Please review this and then consider as a potential blocker:

https://issues.apache.org/jira/browse/DRILL-4482



On Sat, Mar 5, 2016 at 3:15 AM, Parth Chandra  wrote:

> Okay here's the list  of  JIRA's pending. It looks like we need to get some
> more time to get the PRs still under review merged, so I'll wait over the
> weekend.
> It looks like the PRs that no reviewers assigned in the list below may not
> make it into the release.
>
> Thanks
>
>
>
> Committed for 1.6 -
>
> DRILL-4384 - Query profile is missing important information on WebUi -
> Merged
> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> Merged
> DRILL-4467 - Baselines need updating.
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) Merged
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> be merged
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -  Waiting
> to be merged
>
> Need review -
> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques to
> review)
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - (Jinfeng to review)
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) (Hanifi/Sudheesh/Paul to review.)
> DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to review)
>
>
>
> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> DRILL-4411/pr 381 (hash join over-memory condition)
> DRILL-4387/pr 379 (GroupScan should not use star column)
> DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> DRILL-4120 - dir0 does not work when the directory structure contains Avro
> files - Partial patch available.
> DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> parquet format spec)
>
>
> On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau  wrote:
>
> > Awesome. Thanks Chun!
> > On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:
> >
> > > Jacques submitted a PR for fixing the failed baselines. I've merged
> them
> > > into automation master and confirmed the failed tests are all passing
> > now.
> > > Thanks.
> > >
> > > -Chun
> > >
> > >
> > > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau 
> > > wrote:
> > >
> > > > I think we need to include DRILL-4467
> > > > . I think it is a
> > one
> > > > line patch and it provides unpredictable plans at a minimum but may
> > also
> > > > present invalid result. Still need to think through the second half.
> > I've
> > > > seen this plan instability in some of my recent test runs (even
> without
> > > > Java 8) when running extended HBase tests.
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > > >
> > > > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra 
> > > wrote:
> > > >
> > > > > Updated list  (I'll follow up with the folks named here
> separately) -
> > > > >
> > > > > Committed for 1.6 -
> > > > >
> > > > > DRILL-4384 - Query profile is missing important information on
> WebUi
> > -
> > > > > Merged
> > > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > Merged
> > > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> integration) -
> > > > > Waiting to be merged
> > > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> > Waiting
> > > to
> > > > > be merged.
> > > > >
> > > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > (Jacques
> > > > to
> > > > > review)
> > > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should
> correctly
> > > > expose
> > > > > their types within Calcite.) - Waiting for Aman to review. (Owners:
> > > > Hsuan,
> > > > > Jinfeng, Aman, Sudheesh)
> > > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > > warnings about using the feature ) (Sudheesh to review.)
> > > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> (Aman
> > > to
> > > > > review)
> > > > > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner:
> > > Sudheesh)
> > > > >
> > > > > Need review -
> > > > > DRILL-4375/pr 402 (Fix the maven release profile)
> > > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > > framework)
> > > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > 

Re: Time for the 1.6 Release

[Parth Chandra]

Okay here's the list  of  JIRA's pending. It looks like we need to get some
more time to get the PRs still under review merged, so I'll wait over the
weekend.
It looks like the PRs that no reviewers assigned in the list below may not
make it into the release.

Thanks



Committed for 1.6 -

DRILL-4384 - Query profile is missing important information on WebUi -
Merged
DRILL-3488/pr 388 (Java 1.8 support) - Merged.
DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) - Merged
DRILL-4467 - Baselines need updating.
DRILL-4449/pr 389 (Wrong results when metadata cache is used..) Merged
DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
be merged
DRILL-4449/pr 389 (Wrong results when metadata cache is used..) -  Waiting
to be merged

Need review -
DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques to
review)
DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
their types within Calcite.) - (Jinfeng to review)
DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
warnings about using the feature ) (Hanifi/Sudheesh/Paul to review.)
DRILL-4375/pr 402 (Fix the maven release profile) - (Aditya to review)



DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
DRILL-4411/pr 381 (hash join over-memory condition)
DRILL-4387/pr 379 (GroupScan should not use star column)
DRILL-4184/pr 372 (support variable length decimal fields in parquet)
DRILL-4120 - dir0 does not work when the directory structure contains Avro
files - Partial patch available.
DRILL-4203/pr 341 (fix dates written into parquet files to conform to
parquet format spec)


On Fri, Mar 4, 2016 at 6:24 PM, Jacques Nadeau  wrote:

> Awesome. Thanks Chun!
> On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:
>
> > Jacques submitted a PR for fixing the failed baselines. I've merged them
> > into automation master and confirmed the failed tests are all passing
> now.
> > Thanks.
> >
> > -Chun
> >
> >
> > On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau 
> > wrote:
> >
> > > I think we need to include DRILL-4467
> > > . I think it is a
> one
> > > line patch and it provides unpredictable plans at a minimum but may
> also
> > > present invalid result. Still need to think through the second half.
> I've
> > > seen this plan instability in some of my recent test runs (even without
> > > Java 8) when running extended HBase tests.
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra 
> > wrote:
> > >
> > > > Updated list  (I'll follow up with the folks named here separately) -
> > > >
> > > > Committed for 1.6 -
> > > >
> > > > DRILL-4384 - Query profile is missing important information on WebUi
> -
> > > > Merged
> > > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> Merged
> > > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > > > Waiting to be merged
> > > > DRILL-4437 (and others)/pr 394 (Operator unit test framework).
> Waiting
> > to
> > > > be merged.
> > > >
> > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> (Jacques
> > > to
> > > > review)
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - Waiting for Aman to review. (Owners:
> > > Hsuan,
> > > > Jinfeng, Aman, Sudheesh)
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) (Sudheesh to review.)
> > > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman
> > to
> > > > review)
> > > > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner:
> > Sudheesh)
> > > >
> > > > Need review -
> > > > DRILL-4375/pr 402 (Fix the maven release profile)
> > > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> > framework)
> > > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > > > DRILL-4120 - dir0 does not work when the directory structure contains
> > > Avro
> > > > files - Partial patch available.
> > > > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > > > parquet format spec)
> > > >
> > > > Not included (yet) -
> > > > DRILL-3149 - No patch available
> > > > DRILL-4441 - IN operator does not work 

Re: Time for the 1.6 Release

[Jacques Nadeau]

Awesome. Thanks Chun!
On Mar 4, 2016 5:51 PM, "Chun Chang"  wrote:

> Jacques submitted a PR for fixing the failed baselines. I've merged them
> into automation master and confirmed the failed tests are all passing now.
> Thanks.
>
> -Chun
>
>
> On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau 
> wrote:
>
> > I think we need to include DRILL-4467
> > . I think it is a one
> > line patch and it provides unpredictable plans at a minimum but may also
> > present invalid result. Still need to think through the second half. I've
> > seen this plan instability in some of my recent test runs (even without
> > Java 8) when running extended HBase tests.
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra 
> wrote:
> >
> > > Updated list  (I'll follow up with the folks named here separately) -
> > >
> > > Committed for 1.6 -
> > >
> > > DRILL-4384 - Query profile is missing important information on WebUi -
> > > Merged
> > > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > > Waiting to be merged
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting
> to
> > > be merged.
> > >
> > > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques
> > to
> > > review)
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) - Waiting for Aman to review. (Owners:
> > Hsuan,
> > > Jinfeng, Aman, Sudheesh)
> > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > warnings about using the feature ) (Sudheesh to review.)
> > > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman
> to
> > > review)
> > > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner:
> Sudheesh)
> > >
> > > Need review -
> > > DRILL-4375/pr 402 (Fix the maven release profile)
> > > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > > DRILL-4332/pr 389 (Make vector comparison order stable in test
> framework)
> > > DRILL-4411/pr 381 (hash join over-memory condition)
> > > DRILL-4387/pr 379 (GroupScan should not use star column)
> > > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > > DRILL-4120 - dir0 does not work when the directory structure contains
> > Avro
> > > files - Partial patch available.
> > > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > > parquet format spec)
> > >
> > > Not included (yet) -
> > > DRILL-3149 - No patch available
> > > DRILL-4441 - IN operator does not work with Avro reader - No patch
> > > available
> > > DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> > > included in 1.6
> > > DRILL-3623 - Limit 0 should avoid execution when querying a known
> schema.
> > > (Need to add limitations of current impl). Intrusive change; should be
> > > included at beginning of release cycle.
> > > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi) - Causes leak.
> > >
> > > Others -
> > > DRILL-2517   - Already resolved.
> > > DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged.
> PR
> > > needs to be closed.
> > >
> > >
> > > On Thu, Mar 3, 2016 at 9:44 PM, Parth Chandra 
> wrote:
> > >
> > > > Right. My mistake. Thanks, Jacques, for reviewing.
> > > >
> > > > On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong 
> > wrote:
> > > >
> > > >> DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > (Sudheesh
> > > >> to
> > > >> review)
> > > >>
> > > >> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
> > > >> reviewer :).
> > > >>
> > > >> -- Zelaine
> > > >>
> > > >> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra 
> > > wrote:
> > > >>
> > > >> > Here's an updated list with names of reviewers added. If anyone
> else
> > > is
> > > >> > reviewing the open PRs please let me know. Some PRs have owners
> > names
> > > >> that
> > > >> > I will follow up with.
> > > >> > Jason, I've included your JIRA in the list.
> > > >> >
> > > >> >
> > > >> > Committed for 1.6 -
> > > >> >
> > > >> > DRILL-4384 - Query profile is missing important information on
> > WebUi -
> > > >> > Merged
> > > >> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > > >> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > > >> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > > Merged
> > > >> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning
> integration)
> > -
> > > >> > Waiting to be merged
> > > >> >
> > > >> > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > >> (Sudheesh to

Re: Time for the 1.6 Release

[Chun Chang]

Jacques submitted a PR for fixing the failed baselines. I've merged them
into automation master and confirmed the failed tests are all passing now.
Thanks.

-Chun


On Thu, Mar 3, 2016 at 10:48 PM, Jacques Nadeau  wrote:

> I think we need to include DRILL-4467
> . I think it is a one
> line patch and it provides unpredictable plans at a minimum but may also
> present invalid result. Still need to think through the second half. I've
> seen this plan instability in some of my recent test runs (even without
> Java 8) when running extended HBase tests.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra  wrote:
>
> > Updated list  (I'll follow up with the folks named here separately) -
> >
> > Committed for 1.6 -
> >
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Merged
> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > Waiting to be merged
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> > be merged.
> >
> > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques
> to
> > review)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> Hsuan,
> > Jinfeng, Aman, Sudheesh)
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Sudheesh to review.)
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> > review)
> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
> >
> > Need review -
> > DRILL-4375/pr 402 (Fix the maven release profile)
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > DRILL-4120 - dir0 does not work when the directory structure contains
> Avro
> > files - Partial patch available.
> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > parquet format spec)
> >
> > Not included (yet) -
> > DRILL-3149 - No patch available
> > DRILL-4441 - IN operator does not work with Avro reader - No patch
> > available
> > DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> > included in 1.6
> > DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> > (Need to add limitations of current impl). Intrusive change; should be
> > included at beginning of release cycle.
> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi) - Causes leak.
> >
> > Others -
> > DRILL-2517   - Already resolved.
> > DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> > needs to be closed.
> >
> >
> > On Thu, Mar 3, 2016 at 9:44 PM, Parth Chandra  wrote:
> >
> > > Right. My mistake. Thanks, Jacques, for reviewing.
> > >
> > > On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong 
> wrote:
> > >
> > >> DRILL-4281/pr 400 (Drill should support inbound impersonation)
> (Sudheesh
> > >> to
> > >> review)
> > >>
> > >> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
> > >> reviewer :).
> > >>
> > >> -- Zelaine
> > >>
> > >> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra 
> > wrote:
> > >>
> > >> > Here's an updated list with names of reviewers added. If anyone else
> > is
> > >> > reviewing the open PRs please let me know. Some PRs have owners
> names
> > >> that
> > >> > I will follow up with.
> > >> > Jason, I've included your JIRA in the list.
> > >> >
> > >> >
> > >> > Committed for 1.6 -
> > >> >
> > >> > DRILL-4384 - Query profile is missing important information on
> WebUi -
> > >> > Merged
> > >> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > >> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > >> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> > Merged
> > >> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration)
> -
> > >> > Waiting to be merged
> > >> >
> > >> > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > >> (Sudheesh to
> > >> > review)
> > >> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > >> expose
> > >> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> > >> Hsuan,
> > >> > Jinfeng, Aman, Sudheesh)
> > >> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > >> > warnings about using the feature ) 

Re: Time for the 1.6 Release

[Jacques Nadeau]

I think we need to include DRILL-4467
. I think it is a one
line patch and it provides unpredictable plans at a minimum but may also
present invalid result. Still need to think through the second half. I've
seen this plan instability in some of my recent test runs (even without
Java 8) when running extended HBase tests.

--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Thu, Mar 3, 2016 at 10:02 PM, Parth Chandra  wrote:

> Updated list  (I'll follow up with the folks named here separately) -
>
> Committed for 1.6 -
>
> DRILL-4384 - Query profile is missing important information on WebUi -
> Merged
> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> Waiting to be merged
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
> be merged.
>
> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques to
> review)
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - Waiting for Aman to review. (Owners: Hsuan,
> Jinfeng, Aman, Sudheesh)
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) (Sudheesh to review.)
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> review)
> DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
>
> Need review -
> DRILL-4375/pr 402 (Fix the maven release profile)
> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> DRILL-4411/pr 381 (hash join over-memory condition)
> DRILL-4387/pr 379 (GroupScan should not use star column)
> DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> DRILL-4120 - dir0 does not work when the directory structure contains Avro
> files - Partial patch available.
> DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> parquet format spec)
>
> Not included (yet) -
> DRILL-3149 - No patch available
> DRILL-4441 - IN operator does not work with Avro reader - No patch
> available
> DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> included in 1.6
> DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> (Need to add limitations of current impl). Intrusive change; should be
> included at beginning of release cycle.
> DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi) - Causes leak.
>
> Others -
> DRILL-2517   - Already resolved.
> DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> needs to be closed.
>
>
> On Thu, Mar 3, 2016 at 9:44 PM, Parth Chandra  wrote:
>
> > Right. My mistake. Thanks, Jacques, for reviewing.
> >
> > On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong  wrote:
> >
> >> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh
> >> to
> >> review)
> >>
> >> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
> >> reviewer :).
> >>
> >> -- Zelaine
> >>
> >> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra 
> wrote:
> >>
> >> > Here's an updated list with names of reviewers added. If anyone else
> is
> >> > reviewing the open PRs please let me know. Some PRs have owners names
> >> that
> >> > I will follow up with.
> >> > Jason, I've included your JIRA in the list.
> >> >
> >> >
> >> > Committed for 1.6 -
> >> >
> >> > DRILL-4384 - Query profile is missing important information on WebUi -
> >> > Merged
> >> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> >> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> >> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) -
> Merged
> >> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> >> > Waiting to be merged
> >> >
> >> > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> >> (Sudheesh to
> >> > review)
> >> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> >> expose
> >> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> >> Hsuan,
> >> > Jinfeng, Aman, Sudheesh)
> >> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> >> > warnings about using the feature ) (Sudheesh to review.)
> >> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth
> to
> >> > review)
> >> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman
> to
> >> > review)
> >> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> >> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner:
> Sudheesh)
> >> >
> >> > Need review -
> >> > DRILL-4375/pr 402 (Fix the maven release profile)
> >> > DRILL-4452/pr 395 (Update 

Re: Time for the 1.6 Release

[Parth Chandra]

Updated list  (I'll follow up with the folks named here separately) -

Committed for 1.6 -

DRILL-4384 - Query profile is missing important information on WebUi -
Merged
DRILL-3488/pr 388 (Java 1.8 support) - Merged.
DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
Waiting to be merged
DRILL-4437 (and others)/pr 394 (Operator unit test framework). Waiting to
be merged.

DRILL-4281/pr 400 (Drill should support inbound impersonation) (Jacques to
review)
DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
their types within Calcite.) - Waiting for Aman to review. (Owners: Hsuan,
Jinfeng, Aman, Sudheesh)
DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
warnings about using the feature ) (Sudheesh to review.)
DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
review)
DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)

Need review -
DRILL-4375/pr 402 (Fix the maven release profile)
DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
DRILL-4411/pr 381 (hash join over-memory condition)
DRILL-4387/pr 379 (GroupScan should not use star column)
DRILL-4184/pr 372 (support variable length decimal fields in parquet)
DRILL-4120 - dir0 does not work when the directory structure contains Avro
files - Partial patch available.
DRILL-4203/pr 341 (fix dates written into parquet files to conform to
parquet format spec)

Not included (yet) -
DRILL-3149 - No patch available
DRILL-4441 - IN operator does not work with Avro reader - No patch available
DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
included in 1.6
DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
(Need to add limitations of current impl). Intrusive change; should be
included at beginning of release cycle.
DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi) - Causes leak.

Others -
DRILL-2517   - Already resolved.
DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
needs to be closed.


On Thu, Mar 3, 2016 at 9:44 PM, Parth Chandra  wrote:

> Right. My mistake. Thanks, Jacques, for reviewing.
>
> On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong  wrote:
>
>> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh
>> to
>> review)
>>
>> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
>> reviewer :).
>>
>> -- Zelaine
>>
>> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:
>>
>> > Here's an updated list with names of reviewers added. If anyone else is
>> > reviewing the open PRs please let me know. Some PRs have owners names
>> that
>> > I will follow up with.
>> > Jason, I've included your JIRA in the list.
>> >
>> >
>> > Committed for 1.6 -
>> >
>> > DRILL-4384 - Query profile is missing important information on WebUi -
>> > Merged
>> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
>> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
>> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
>> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
>> > Waiting to be merged
>> >
>> > DRILL-4281/pr 400 (Drill should support inbound impersonation)
>> (Sudheesh to
>> > review)
>> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
>> expose
>> > their types within Calcite.) - Waiting for Aman to review. (Owners:
>> Hsuan,
>> > Jinfeng, Aman, Sudheesh)
>> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
>> > warnings about using the feature ) (Sudheesh to review.)
>> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
>> > review)
>> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
>> > review)
>> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
>> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
>> >
>> > Need review -
>> > DRILL-4375/pr 402 (Fix the maven release profile)
>> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
>> > DRILL-4332/pr 389 (Make vector comparison order stable in test
>> framework)
>> > DRILL-4411/pr 381 (hash join over-memory condition)
>> > DRILL-4387/pr 379 (GroupScan should not use star column)
>> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
>> > DRILL-4120 - dir0 does not work when the directory structure contains
>> Avro
>> > files - Partial patch available.
>> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
>> > parquet format spec)
>> >
>> > Not included (yet) -
>> > DRILL-3149 - No patch available
>> > DRILL-4441 - IN operator does not work with Avro reader - No patch
>> > available
>> > DRILL-3745/pr 399 - Hive 

Re: Time for the 1.6 Release

[Parth Chandra]

Right. My mistake. Thanks, Jacques, for reviewing.

On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong  wrote:

> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
> review)
>
> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
> reviewer :).
>
> -- Zelaine
>
> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:
>
> > Here's an updated list with names of reviewers added. If anyone else is
> > reviewing the open PRs please let me know. Some PRs have owners names
> that
> > I will follow up with.
> > Jason, I've included your JIRA in the list.
> >
> >
> > Committed for 1.6 -
> >
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Merged
> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > Waiting to be merged
> >
> > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh
> to
> > review)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> Hsuan,
> > Jinfeng, Aman, Sudheesh)
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Sudheesh to review.)
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
> > review)
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> > review)
> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
> >
> > Need review -
> > DRILL-4375/pr 402 (Fix the maven release profile)
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > DRILL-4120 - dir0 does not work when the directory structure contains
> Avro
> > files - Partial patch available.
> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > parquet format spec)
> >
> > Not included (yet) -
> > DRILL-3149 - No patch available
> > DRILL-4441 - IN operator does not work with Avro reader - No patch
> > available
> > DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> > included in 1.6
> > DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> > (Need to add limitations of current impl). Intrusive change; should be
> > included at beginning of release cycle.
> >
> > Others -
> > DRILL-2517   - Already resolved.
> > DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> > needs to be closed.
> >
> >
> >
> > Thanks
> >
> > Parth
> >
> >
> >
> >
> >
> > On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > I have updated the PR for the parquet date corruption issue that didn't
> > > make it into 1.5.
> > >
> > > https://github.com/apache/drill/pull/341
> > > https://issues.apache.org/jira/browse/DRILL-4203
> > >
> > > If this can get reviewed, I think it would be good to get into the
> > release.
> > > Any takers?
> > >
> > > On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra 
> > wrote:
> > >
> > > > I've summarized the list of JIRs below.
> > > > The first set of pull requests is under review (or have some reviewer
> > > > assigned).
> > > > The second set contains pull requests that need review. We need
> > > committers
> > > > to review these. Please volunteer or these will not be able to make
> it
> > > into
> > > > the release.
> > > > The third set is Jira's that do not have a patch and/or should not be
> > > > included because they require deeper scrutiny.
> > > > I'm hoping we can finalize the list of PRs that can be reviewed by
> > Friday
> > > > morning and possibly *finalize the list of issues to be included by
> > > Friday
> > > > end of day* so please take some time to review the PRs.
> > > > Also note that the QA team has offered to do sanity testing once we
> > > decide
> > > > on the final commit to be included, before the release candidate is
> > > rolled
> > > > out, which helps with the release candidate moving forward smoothly.
> > > >
> > > > Here's the list -
> > > >
> > > > *Committed for 1.6 -*
> > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - Waiting for Aman to review.
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) Sudheesh to review.
> > > > 

Re: Time for the 1.6 Release

[Jacques Nadeau]

I've been reviewing 4281. It's really close to ready.

--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Thu, Mar 3, 2016 at 9:08 PM, Zelaine Fong  wrote:

> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
> review)
>
> Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
> reviewer :).
>
> -- Zelaine
>
> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:
>
> > Here's an updated list with names of reviewers added. If anyone else is
> > reviewing the open PRs please let me know. Some PRs have owners names
> that
> > I will follow up with.
> > Jason, I've included your JIRA in the list.
> >
> >
> > Committed for 1.6 -
> >
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Merged
> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > Waiting to be merged
> >
> > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh
> to
> > review)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> Hsuan,
> > Jinfeng, Aman, Sudheesh)
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Sudheesh to review.)
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
> > review)
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> > review)
> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
> >
> > Need review -
> > DRILL-4375/pr 402 (Fix the maven release profile)
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > DRILL-4120 - dir0 does not work when the directory structure contains
> Avro
> > files - Partial patch available.
> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > parquet format spec)
> >
> > Not included (yet) -
> > DRILL-3149 - No patch available
> > DRILL-4441 - IN operator does not work with Avro reader - No patch
> > available
> > DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> > included in 1.6
> > DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> > (Need to add limitations of current impl). Intrusive change; should be
> > included at beginning of release cycle.
> >
> > Others -
> > DRILL-2517   - Already resolved.
> > DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> > needs to be closed.
> >
> >
> >
> > Thanks
> >
> > Parth
> >
> >
> >
> >
> >
> > On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > I have updated the PR for the parquet date corruption issue that didn't
> > > make it into 1.5.
> > >
> > > https://github.com/apache/drill/pull/341
> > > https://issues.apache.org/jira/browse/DRILL-4203
> > >
> > > If this can get reviewed, I think it would be good to get into the
> > release.
> > > Any takers?
> > >
> > > On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra 
> > wrote:
> > >
> > > > I've summarized the list of JIRs below.
> > > > The first set of pull requests is under review (or have some reviewer
> > > > assigned).
> > > > The second set contains pull requests that need review. We need
> > > committers
> > > > to review these. Please volunteer or these will not be able to make
> it
> > > into
> > > > the release.
> > > > The third set is Jira's that do not have a patch and/or should not be
> > > > included because they require deeper scrutiny.
> > > > I'm hoping we can finalize the list of PRs that can be reviewed by
> > Friday
> > > > morning and possibly *finalize the list of issues to be included by
> > > Friday
> > > > end of day* so please take some time to review the PRs.
> > > > Also note that the QA team has offered to do sanity testing once we
> > > decide
> > > > on the final commit to be included, before the release candidate is
> > > rolled
> > > > out, which helps with the release candidate moving forward smoothly.
> > > >
> > > > Here's the list -
> > > >
> > > > *Committed for 1.6 -*
> > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - Waiting for Aman to review.
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about 

Re: Time for the 1.6 Release

[Zelaine Fong]

DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
review)

Sudheesh is the fixer of DRILL-4281, so I don't think he can be the
reviewer :).

-- Zelaine

On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:

> Here's an updated list with names of reviewers added. If anyone else is
> reviewing the open PRs please let me know. Some PRs have owners names that
> I will follow up with.
> Jason, I've included your JIRA in the list.
>
>
> Committed for 1.6 -
>
> DRILL-4384 - Query profile is missing important information on WebUi -
> Merged
> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> Waiting to be merged
>
> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
> review)
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - Waiting for Aman to review. (Owners: Hsuan,
> Jinfeng, Aman, Sudheesh)
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) (Sudheesh to review.)
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
> review)
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> review)
> DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
>
> Need review -
> DRILL-4375/pr 402 (Fix the maven release profile)
> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> DRILL-4411/pr 381 (hash join over-memory condition)
> DRILL-4387/pr 379 (GroupScan should not use star column)
> DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> DRILL-4120 - dir0 does not work when the directory structure contains Avro
> files - Partial patch available.
> DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> parquet format spec)
>
> Not included (yet) -
> DRILL-3149 - No patch available
> DRILL-4441 - IN operator does not work with Avro reader - No patch
> available
> DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> included in 1.6
> DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> (Need to add limitations of current impl). Intrusive change; should be
> included at beginning of release cycle.
>
> Others -
> DRILL-2517   - Already resolved.
> DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> needs to be closed.
>
>
>
> Thanks
>
> Parth
>
>
>
>
>
> On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse 
> wrote:
>
> > I have updated the PR for the parquet date corruption issue that didn't
> > make it into 1.5.
> >
> > https://github.com/apache/drill/pull/341
> > https://issues.apache.org/jira/browse/DRILL-4203
> >
> > If this can get reviewed, I think it would be good to get into the
> release.
> > Any takers?
> >
> > On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra 
> wrote:
> >
> > > I've summarized the list of JIRs below.
> > > The first set of pull requests is under review (or have some reviewer
> > > assigned).
> > > The second set contains pull requests that need review. We need
> > committers
> > > to review these. Please volunteer or these will not be able to make it
> > into
> > > the release.
> > > The third set is Jira's that do not have a patch and/or should not be
> > > included because they require deeper scrutiny.
> > > I'm hoping we can finalize the list of PRs that can be reviewed by
> Friday
> > > morning and possibly *finalize the list of issues to be included by
> > Friday
> > > end of day* so please take some time to review the PRs.
> > > Also note that the QA team has offered to do sanity testing once we
> > decide
> > > on the final commit to be included, before the release candidate is
> > rolled
> > > out, which helps with the release candidate moving forward smoothly.
> > >
> > > Here's the list -
> > >
> > > *Committed for 1.6 -*
> > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) - Waiting for Aman to review.
> > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > warnings about using the feature ) Sudheesh to review.
> > > DRILL-3488/pr 388 (Java 1.8 support) Hanifi to review
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Parth to
> > > review
> > > DRILL-4384 - Query profile is missing important information on WebUi -
> > > Marked as resolved. Patch not applied?
> > >
> > > *Need review -*
> > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration)
> > > 

Re: Time for the 1.6 Release

[Parth Chandra]

Yes. I noticed the comment after I sent out the email. Removing it from the
list.


On Thu, Mar 3, 2016 at 7:02 PM, Hanifi Gunes  wrote:

> DRILL-4416 is going to make it to 1.7. The patch causes a leak and I will
> look into it once I make some time but 1.6 is too early.
>
> On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:
>
> > Here's an updated list with names of reviewers added. If anyone else is
> > reviewing the open PRs please let me know. Some PRs have owners names
> that
> > I will follow up with.
> > Jason, I've included your JIRA in the list.
> >
> >
> > Committed for 1.6 -
> >
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Merged
> > DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> > DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> > DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> > Waiting to be merged
> >
> > DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh
> to
> > review)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - Waiting for Aman to review. (Owners:
> Hsuan,
> > Jinfeng, Aman, Sudheesh)
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) (Sudheesh to review.)
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
> > review)
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> > review)
> > DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> > DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
> >
> > Need review -
> > DRILL-4375/pr 402 (Fix the maven release profile)
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> > DRILL-4120 - dir0 does not work when the directory structure contains
> Avro
> > files - Partial patch available.
> > DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> > parquet format spec)
> >
> > Not included (yet) -
> > DRILL-3149 - No patch available
> > DRILL-4441 - IN operator does not work with Avro reader - No patch
> > available
> > DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> > included in 1.6
> > DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> > (Need to add limitations of current impl). Intrusive change; should be
> > included at beginning of release cycle.
> >
> > Others -
> > DRILL-2517   - Already resolved.
> > DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> > needs to be closed.
> >
> >
> >
> > Thanks
> >
> > Parth
> >
> >
> >
> >
> >
> > On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse <
> altekruseja...@gmail.com>
> > wrote:
> >
> > > I have updated the PR for the parquet date corruption issue that didn't
> > > make it into 1.5.
> > >
> > > https://github.com/apache/drill/pull/341
> > > https://issues.apache.org/jira/browse/DRILL-4203
> > >
> > > If this can get reviewed, I think it would be good to get into the
> > release.
> > > Any takers?
> > >
> > > On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra 
> > wrote:
> > >
> > > > I've summarized the list of JIRs below.
> > > > The first set of pull requests is under review (or have some reviewer
> > > > assigned).
> > > > The second set contains pull requests that need review. We need
> > > committers
> > > > to review these. Please volunteer or these will not be able to make
> it
> > > into
> > > > the release.
> > > > The third set is Jira's that do not have a patch and/or should not be
> > > > included because they require deeper scrutiny.
> > > > I'm hoping we can finalize the list of PRs that can be reviewed by
> > Friday
> > > > morning and possibly *finalize the list of issues to be included by
> > > Friday
> > > > end of day* so please take some time to review the PRs.
> > > > Also note that the QA team has offered to do sanity testing once we
> > > decide
> > > > on the final commit to be included, before the release candidate is
> > > rolled
> > > > out, which helps with the release candidate moving forward smoothly.
> > > >
> > > > Here's the list -
> > > >
> > > > *Committed for 1.6 -*
> > > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > > expose
> > > > their types within Calcite.) - Waiting for Aman to review.
> > > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > > warnings about using the feature ) Sudheesh to review.
> > > > DRILL-3488/pr 388 (Java 

Re: Time for the 1.6 Release

[Hanifi Gunes]

DRILL-4416 is going to make it to 1.7. The patch causes a leak and I will
look into it once I make some time but 1.6 is too early.

On Thu, Mar 3, 2016 at 6:30 PM, Parth Chandra  wrote:

> Here's an updated list with names of reviewers added. If anyone else is
> reviewing the open PRs please let me know. Some PRs have owners names that
> I will follow up with.
> Jason, I've included your JIRA in the list.
>
>
> Committed for 1.6 -
>
> DRILL-4384 - Query profile is missing important information on WebUi -
> Merged
> DRILL-3488/pr 388 (Java 1.8 support) - Merged.
> DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
> DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
> Waiting to be merged
>
> DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
> review)
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - Waiting for Aman to review. (Owners: Hsuan,
> Jinfeng, Aman, Sudheesh)
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) (Sudheesh to review.)
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
> review)
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
> review)
> DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
> DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)
>
> Need review -
> DRILL-4375/pr 402 (Fix the maven release profile)
> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> DRILL-4411/pr 381 (hash join over-memory condition)
> DRILL-4387/pr 379 (GroupScan should not use star column)
> DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> DRILL-4120 - dir0 does not work when the directory structure contains Avro
> files - Partial patch available.
> DRILL-4203/pr 341 (fix dates written into parquet files to conform to
> parquet format spec)
>
> Not included (yet) -
> DRILL-3149 - No patch available
> DRILL-4441 - IN operator does not work with Avro reader - No patch
> available
> DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> included in 1.6
> DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> (Need to add limitations of current impl). Intrusive change; should be
> included at beginning of release cycle.
>
> Others -
> DRILL-2517   - Already resolved.
> DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> needs to be closed.
>
>
>
> Thanks
>
> Parth
>
>
>
>
>
> On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse 
> wrote:
>
> > I have updated the PR for the parquet date corruption issue that didn't
> > make it into 1.5.
> >
> > https://github.com/apache/drill/pull/341
> > https://issues.apache.org/jira/browse/DRILL-4203
> >
> > If this can get reviewed, I think it would be good to get into the
> release.
> > Any takers?
> >
> > On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra 
> wrote:
> >
> > > I've summarized the list of JIRs below.
> > > The first set of pull requests is under review (or have some reviewer
> > > assigned).
> > > The second set contains pull requests that need review. We need
> > committers
> > > to review these. Please volunteer or these will not be able to make it
> > into
> > > the release.
> > > The third set is Jira's that do not have a patch and/or should not be
> > > included because they require deeper scrutiny.
> > > I'm hoping we can finalize the list of PRs that can be reviewed by
> Friday
> > > morning and possibly *finalize the list of issues to be included by
> > Friday
> > > end of day* so please take some time to review the PRs.
> > > Also note that the QA team has offered to do sanity testing once we
> > decide
> > > on the final commit to be included, before the release candidate is
> > rolled
> > > out, which helps with the release candidate moving forward smoothly.
> > >
> > > Here's the list -
> > >
> > > *Committed for 1.6 -*
> > > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> > expose
> > > their types within Calcite.) - Waiting for Aman to review.
> > > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > > warnings about using the feature ) Sudheesh to review.
> > > DRILL-3488/pr 388 (Java 1.8 support) Hanifi to review
> > > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Parth to
> > > review
> > > DRILL-4384 - Query profile is missing important information on WebUi -
> > > Marked as resolved. Patch not applied?
> > >
> > > *Need review -*
> > > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration)
> > > DRILL-4375/pr 402 (Fix the maven release profile)
> > > 

Re: Time for the 1.6 Release

[Parth Chandra]

Here's an updated list with names of reviewers added. If anyone else is
reviewing the open PRs please let me know. Some PRs have owners names that
I will follow up with.
Jason, I've included your JIRA in the list.


Committed for 1.6 -

DRILL-4384 - Query profile is missing important information on WebUi -
Merged
DRILL-3488/pr 388 (Java 1.8 support) - Merged.
DRILL-4410/pr 380 (listvector should initiatlize bits...) - Merged
DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc) - Merged
DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration) -
Waiting to be merged

DRILL-4281/pr 400 (Drill should support inbound impersonation) (Sudheesh to
review)
DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
their types within Calcite.) - Waiting for Aman to review. (Owners: Hsuan,
Jinfeng, Aman, Sudheesh)
DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
warnings about using the feature ) (Sudheesh to review.)
DRILL-4437 (and others)/pr 394 (Operator unit test framework). (Parth to
review)
DRILL-4449/pr 389 (Wrong results when metadata cache is used..) (Aman to
review)
DRILL-4416/pr 385 (quote path separator) (Owner: Hanifi)
DRILL-4069/pr 352 Enable RPC thread offload by default (Owner: Sudheesh)

Need review -
DRILL-4375/pr 402 (Fix the maven release profile)
DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
DRILL-4411/pr 381 (hash join over-memory condition)
DRILL-4387/pr 379 (GroupScan should not use star column)
DRILL-4184/pr 372 (support variable length decimal fields in parquet)
DRILL-4120 - dir0 does not work when the directory structure contains Avro
files - Partial patch available.
DRILL-4203/pr 341 (fix dates written into parquet files to conform to
parquet format spec)

Not included (yet) -
DRILL-3149 - No patch available
DRILL-4441 - IN operator does not work with Avro reader - No patch available
DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
included in 1.6
DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
(Need to add limitations of current impl). Intrusive change; should be
included at beginning of release cycle.

Others -
DRILL-2517   - Already resolved.
DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
needs to be closed.



Thanks

Parth





On Thu, Mar 3, 2016 at 3:21 PM, Jason Altekruse 
wrote:

> I have updated the PR for the parquet date corruption issue that didn't
> make it into 1.5.
>
> https://github.com/apache/drill/pull/341
> https://issues.apache.org/jira/browse/DRILL-4203
>
> If this can get reviewed, I think it would be good to get into the release.
> Any takers?
>
> On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra  wrote:
>
> > I've summarized the list of JIRs below.
> > The first set of pull requests is under review (or have some reviewer
> > assigned).
> > The second set contains pull requests that need review. We need
> committers
> > to review these. Please volunteer or these will not be able to make it
> into
> > the release.
> > The third set is Jira's that do not have a patch and/or should not be
> > included because they require deeper scrutiny.
> > I'm hoping we can finalize the list of PRs that can be reviewed by Friday
> > morning and possibly *finalize the list of issues to be included by
> Friday
> > end of day* so please take some time to review the PRs.
> > Also note that the QA team has offered to do sanity testing once we
> decide
> > on the final commit to be included, before the release candidate is
> rolled
> > out, which helps with the release candidate moving forward smoothly.
> >
> > Here's the list -
> >
> > *Committed for 1.6 -*
> > DRILL-4281/pr 400 (Drill should support inbound impersonation)
> > DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly
> expose
> > their types within Calcite.) - Waiting for Aman to review.
> > DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> > warnings about using the feature ) Sudheesh to review.
> > DRILL-3488/pr 388 (Java 1.8 support) Hanifi to review
> > DRILL-4437 (and others)/pr 394 (Operator unit test framework). Parth to
> > review
> > DRILL-4384 - Query profile is missing important information on WebUi -
> > Marked as resolved. Patch not applied?
> >
> > *Need review -*
> > DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration)
> > DRILL-4375/pr 402 (Fix the maven release profile)
> > DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> > DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> > DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> > DRILL-4416/pr 385 (quote path separator)
> > DRILL-4411/pr 381 (hash join over-memory condition)
> > DRILL-4410/pr 380 (listvector should initiatlize bits...)
> > DRILL-4387/pr 379 (GroupScan should not use star column)
> > 

Re: Time for the 1.6 Release

[Jason Altekruse]

I have updated the PR for the parquet date corruption issue that didn't
make it into 1.5.

https://github.com/apache/drill/pull/341
https://issues.apache.org/jira/browse/DRILL-4203

If this can get reviewed, I think it would be good to get into the release.
Any takers?

On Wed, Mar 2, 2016 at 11:07 PM, Parth Chandra  wrote:

> I've summarized the list of JIRs below.
> The first set of pull requests is under review (or have some reviewer
> assigned).
> The second set contains pull requests that need review. We need committers
> to review these. Please volunteer or these will not be able to make it into
> the release.
> The third set is Jira's that do not have a patch and/or should not be
> included because they require deeper scrutiny.
> I'm hoping we can finalize the list of PRs that can be reviewed by Friday
> morning and possibly *finalize the list of issues to be included by Friday
> end of day* so please take some time to review the PRs.
> Also note that the QA team has offered to do sanity testing once we decide
> on the final commit to be included, before the release candidate is rolled
> out, which helps with the release candidate moving forward smoothly.
>
> Here's the list -
>
> *Committed for 1.6 -*
> DRILL-4281/pr 400 (Drill should support inbound impersonation)
> DRILL-4372/pr 377(?) (Drill Operators and Functions should correctly expose
> their types within Calcite.) - Waiting for Aman to review.
> DRILL-4313/pr 396  (Improved client randomization. Update JIRA with
> warnings about using the feature ) Sudheesh to review.
> DRILL-3488/pr 388 (Java 1.8 support) Hanifi to review
> DRILL-4437 (and others)/pr 394 (Operator unit test framework). Parth to
> review
> DRILL-4384 - Query profile is missing important information on WebUi -
> Marked as resolved. Patch not applied?
>
> *Need review -*
> DRILL-4465/pr 401 (Simplify Calcite parsing & planning integration)
> DRILL-4375/pr 402 (Fix the maven release profile)
> DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
> DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
> DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
> DRILL-4416/pr 385 (quote path separator)
> DRILL-4411/pr 381 (hash join over-memory condition)
> DRILL-4410/pr 380 (listvector should initiatlize bits...)
> DRILL-4387/pr 379 (GroupScan should not use star column)
> DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
> DRILL-4184/pr 372 (support variable length decimal fields in parquet)
> DRILL-4069/pr 352 Enable RPC thread offload by default
> DRILL-4120 - dir0 does not work when the directory structure contains Avro
> files - Partial patch available.
>
> *Not included (yet) - *
> DRILL-3149 - No patch available
> DRILL-4441 - IN operator does not work with Avro reader - No patch
> available
> DRILL-3745/pr 399 - Hive char support - New feature - Needs QA - Not
> included in 1.6
> DRILL-3623 - Limit 0 should avoid execution when querying a known schema.
> (Need to add limitations of current impl). Intrusive change; should be
> included at beginning of release cycle.
>
> *Others -*
> DRILL-2517   - Already resolved.
> DRILL-3688/pr 382 (skip.header.line.count in hive). - Already merged. PR
> needs to be closed.
>
>
>
> On Wed, Mar 2, 2016 at 3:11 PM, Vicky Markman 
> wrote:
>
> > You are welcome, Jacques.
> >
> > Vick*y *:)
> >
> > On Wed, Mar 2, 2016 at 3:06 PM, Jacques Nadeau 
> wrote:
> >
> > > I just realized that we didn't merge the broken profile patch (thanks
> > > Vicki). We should get it merged as well.
> > >
> > > DRILL-4384
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Wed, Mar 2, 2016 at 10:46 AM, Jason Altekruse <
> > altekruseja...@gmail.com
> > > >
> > > wrote:
> > >
> > > > I should have merged this sooner but we will need this patch that I
> had
> > > > applied to the 1.5 release branch. The change is small and fixes a
> > build
> > > > problem that only appears when running the maven release profile.
> > > >
> > > > https://github.com/apache/drill/pull/402
> > > >
> > > > On Wed, Mar 2, 2016 at 9:28 AM, Jinfeng Ni 
> > > wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > I think patch for DRILL-2517 has been merged to the apache master
> > > > > branch. Have you tried your query on the latest master branch?
> > > > >
> > > > > In DRILL-2517, I posted some performance number for 117k small
> > parquet
> > > > > files. The patch did show improvement.
> > > > >
> > > > > Before DRILL-3996 is resolved, for now if your query relies on
> filter
> > > > > pushdown logic to push partitioning filter first, then the patch
> for
> > > > > DRILL-2517 will not help.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Mar 2, 2016 at 4:23 AM, John Omernik 
> > wrote:
> > > > > > I'd like to request drill-2517 be added as a bandaid for the
> > planning
> > > > > > issues when 

Re: Time for the 1.6 Release

[Jacques Nadeau]

I just realized that we didn't merge the broken profile patch (thanks
Vicki). We should get it merged as well.

DRILL-4384

--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Wed, Mar 2, 2016 at 10:46 AM, Jason Altekruse 
wrote:

> I should have merged this sooner but we will need this patch that I had
> applied to the 1.5 release branch. The change is small and fixes a build
> problem that only appears when running the maven release profile.
>
> https://github.com/apache/drill/pull/402
>
> On Wed, Mar 2, 2016 at 9:28 AM, Jinfeng Ni  wrote:
>
> > Hi John,
> >
> > I think patch for DRILL-2517 has been merged to the apache master
> > branch. Have you tried your query on the latest master branch?
> >
> > In DRILL-2517, I posted some performance number for 117k small parquet
> > files. The patch did show improvement.
> >
> > Before DRILL-3996 is resolved, for now if your query relies on filter
> > pushdown logic to push partitioning filter first, then the patch for
> > DRILL-2517 will not help.
> >
> >
> >
> >
> > On Wed, Mar 2, 2016 at 4:23 AM, John Omernik  wrote:
> > > I'd like to request drill-2517 be added as a bandaid for the planning
> > > issues when there are lots of directories of parquet files.   This
> issue
> > is
> > > really hurting drill adoption for me in my org.
> > >
> > > Thanks,  John
> > >
> > >
> > >
> > > On Tuesday, March 1, 2016, Edmon Begoli  wrote:
> > >
> > >> May I please ask to give this issue the attention for 1.6:
> > >>
> https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
> > >>
> > >> I will try to suggest a patch. Given my time constraints I might not
> be
> > >> able to submit a complete, unit tested code but at I least I will try
> to
> > >> submit a snippet that will help with fixing it up (I think we just
> need
> > to
> > >> do a look ahead byte lookup to ensure that it is not \r\n.
> > >>
> > >> On Tuesday, March 1, 2016, Jacques Nadeau  > >> > wrote:
> > >>
> > >> > It seems like a stretch to include DRILL-3623 right before the
> > release.
> > >> > This is a pretty fundamental change that seems like it should soak
> > for a
> > >> > bit of time before we release. If we want to include, I'd suggest
> > that we
> > >> > disable the functionality by default and consider it experimental.
> > >> >
> > >> > I'll propose a few other patches for inclusion shortly.
> > >> >
> > >> > --
> > >> > Jacques Nadeau
> > >> > CTO and Co-Founder, Dremio
> > >> >
> > >> > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  > >> 
> > >> > > wrote:
> > >> >
> > >> > > Hello everyone,
> > >> > >
> > >> > >   It's time to start looking into the 1.6 release.
> > >> > >
> > >> > >   Can all the folks working on open issues let me know if there
> are
> > any
> > >> > > JIRAs you would like to get into the release?
> > >> > >
> > >> > >   I know of the following -
> > >> > >
> > >> > > *DRILL-4281 *- Drill should support inbound impersonation. Pull
> > request
> > >> > > expected today. C++ client to be tested.
> > >> > >
> > >> > > *DRILL-4372* - Drill Operators and Functions should correctly
> expose
> > >> > their
> > >> > > types within Calcite. Waiting for review.
> > >> > >
> > >> > > *DRILL-3623* - Limit 0 should avoid execution when querying a
> known
> > >> > schema.
> > >> > > Pull request expected today. Need to add limitations of current
> > impl to
> > >> > the
> > >> > > JIRA. Review needed.
> > >> > >
> > >> > > *DRILL-4313* - Improved client randomization. Update JIRA with
> > warnings
> > >> > > about using the feature. Waiting for review.
> > >> > >
> > >> > >
> > >> > > Thanks
> > >> > >
> > >> > > Parth
> > >> > >
> > >> >
> > >>
> > >
> > >
> > > --
> > > Sent from my iThing
> >
>

Re: Time for the 1.6 Release

[Jason Altekruse]

I should have merged this sooner but we will need this patch that I had
applied to the 1.5 release branch. The change is small and fixes a build
problem that only appears when running the maven release profile.

https://github.com/apache/drill/pull/402

On Wed, Mar 2, 2016 at 9:28 AM, Jinfeng Ni  wrote:

> Hi John,
>
> I think patch for DRILL-2517 has been merged to the apache master
> branch. Have you tried your query on the latest master branch?
>
> In DRILL-2517, I posted some performance number for 117k small parquet
> files. The patch did show improvement.
>
> Before DRILL-3996 is resolved, for now if your query relies on filter
> pushdown logic to push partitioning filter first, then the patch for
> DRILL-2517 will not help.
>
>
>
>
> On Wed, Mar 2, 2016 at 4:23 AM, John Omernik  wrote:
> > I'd like to request drill-2517 be added as a bandaid for the planning
> > issues when there are lots of directories of parquet files.   This issue
> is
> > really hurting drill adoption for me in my org.
> >
> > Thanks,  John
> >
> >
> >
> > On Tuesday, March 1, 2016, Edmon Begoli  wrote:
> >
> >> May I please ask to give this issue the attention for 1.6:
> >> https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
> >>
> >> I will try to suggest a patch. Given my time constraints I might not be
> >> able to submit a complete, unit tested code but at I least I will try to
> >> submit a snippet that will help with fixing it up (I think we just need
> to
> >> do a look ahead byte lookup to ensure that it is not \r\n.
> >>
> >> On Tuesday, March 1, 2016, Jacques Nadeau  >> > wrote:
> >>
> >> > It seems like a stretch to include DRILL-3623 right before the
> release.
> >> > This is a pretty fundamental change that seems like it should soak
> for a
> >> > bit of time before we release. If we want to include, I'd suggest
> that we
> >> > disable the functionality by default and consider it experimental.
> >> >
> >> > I'll propose a few other patches for inclusion shortly.
> >> >
> >> > --
> >> > Jacques Nadeau
> >> > CTO and Co-Founder, Dremio
> >> >
> >> > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  >> 
> >> > > wrote:
> >> >
> >> > > Hello everyone,
> >> > >
> >> > >   It's time to start looking into the 1.6 release.
> >> > >
> >> > >   Can all the folks working on open issues let me know if there are
> any
> >> > > JIRAs you would like to get into the release?
> >> > >
> >> > >   I know of the following -
> >> > >
> >> > > *DRILL-4281 *- Drill should support inbound impersonation. Pull
> request
> >> > > expected today. C++ client to be tested.
> >> > >
> >> > > *DRILL-4372* - Drill Operators and Functions should correctly expose
> >> > their
> >> > > types within Calcite. Waiting for review.
> >> > >
> >> > > *DRILL-3623* - Limit 0 should avoid execution when querying a known
> >> > schema.
> >> > > Pull request expected today. Need to add limitations of current
> impl to
> >> > the
> >> > > JIRA. Review needed.
> >> > >
> >> > > *DRILL-4313* - Improved client randomization. Update JIRA with
> warnings
> >> > > about using the feature. Waiting for review.
> >> > >
> >> > >
> >> > > Thanks
> >> > >
> >> > > Parth
> >> > >
> >> >
> >>
> >
> >
> > --
> > Sent from my iThing
>

Re: Time for the 1.6 Release

[Jinfeng Ni]

Hi John,

I think patch for DRILL-2517 has been merged to the apache master
branch. Have you tried your query on the latest master branch?

In DRILL-2517, I posted some performance number for 117k small parquet
files. The patch did show improvement.

Before DRILL-3996 is resolved, for now if your query relies on filter
pushdown logic to push partitioning filter first, then the patch for
DRILL-2517 will not help.




On Wed, Mar 2, 2016 at 4:23 AM, John Omernik  wrote:
> I'd like to request drill-2517 be added as a bandaid for the planning
> issues when there are lots of directories of parquet files.   This issue is
> really hurting drill adoption for me in my org.
>
> Thanks,  John
>
>
>
> On Tuesday, March 1, 2016, Edmon Begoli  wrote:
>
>> May I please ask to give this issue the attention for 1.6:
>> https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
>>
>> I will try to suggest a patch. Given my time constraints I might not be
>> able to submit a complete, unit tested code but at I least I will try to
>> submit a snippet that will help with fixing it up (I think we just need to
>> do a look ahead byte lookup to ensure that it is not \r\n.
>>
>> On Tuesday, March 1, 2016, Jacques Nadeau > > wrote:
>>
>> > It seems like a stretch to include DRILL-3623 right before the release.
>> > This is a pretty fundamental change that seems like it should soak for a
>> > bit of time before we release. If we want to include, I'd suggest that we
>> > disable the functionality by default and consider it experimental.
>> >
>> > I'll propose a few other patches for inclusion shortly.
>> >
>> > --
>> > Jacques Nadeau
>> > CTO and Co-Founder, Dremio
>> >
>> > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra > 
>> > > wrote:
>> >
>> > > Hello everyone,
>> > >
>> > >   It's time to start looking into the 1.6 release.
>> > >
>> > >   Can all the folks working on open issues let me know if there are any
>> > > JIRAs you would like to get into the release?
>> > >
>> > >   I know of the following -
>> > >
>> > > *DRILL-4281 *- Drill should support inbound impersonation. Pull request
>> > > expected today. C++ client to be tested.
>> > >
>> > > *DRILL-4372* - Drill Operators and Functions should correctly expose
>> > their
>> > > types within Calcite. Waiting for review.
>> > >
>> > > *DRILL-3623* - Limit 0 should avoid execution when querying a known
>> > schema.
>> > > Pull request expected today. Need to add limitations of current impl to
>> > the
>> > > JIRA. Review needed.
>> > >
>> > > *DRILL-4313* - Improved client randomization. Update JIRA with warnings
>> > > about using the feature. Waiting for review.
>> > >
>> > >
>> > > Thanks
>> > >
>> > > Parth
>> > >
>> >
>>
>
>
> --
> Sent from my iThing

Re: Time for the 1.6 Release

[Jacques Nadeau]

I've posted DRILL-4465 for review (Calcite integration cleanup) and would
like to include it in the release if others are amenable. As I mentioned,
it isn't a functional change but does set the groundwork for my work on
moving off a Calcite fork.

It also seems like the following pull requests are pretty much ready to go
and we should try to include them:

DRILL-4452/pr 395 (Update Avatica Driver to latest Calcite)
DRILL-4332/pr 389 (Make vector comparison order stable in test framework)
DRILL-4449/pr 389 (Wrong results when metadata cache is used..)
DRILL-4416/pr 385 (quote path separator)
DRILL-3688/pr 382 (skip.header.line.count in hive)
DRILL-4411/pr 381 (hash join over-memory condition)
DRILL-4410/pr 380 (listvector should initiatlize bits...)
DRILL-4387/pr 379 (GroupScan should not use star column)
DRILL-4383/pr 375 (Allow custom configs for S3, Kerberos, etc)
DRILL-4184/pr 372 (support variable length decimal fields in parquet)

There a are a bunch of other pull requests that probably need to be cleaned
up since I think many are merged. For example, I thought Sudheesh's
DRILL-4069 (RPC thread offload by default) was merged but I still see the
PR open. Same with 3688 (skip.header.line.count in hive).

thanks,
Jacques


--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Wed, Mar 2, 2016 at 7:53 AM, Stefán Baxter 
wrote:

> Fair point, sorry.
>
> Please at least include these:
>
>- https://issues.apache.org/jira/browse/DRILL-4441
>- https://issues.apache.org/jira/browse/DRILL-4120
>- Avro schema validation prevents directory pruning when schema is
>eveolving
>- Did not find this one in Jira but the schema validation in Avro is
>currently a "all or nothing" deal
>- Personally I think this should behave the same way a Parquet and JASON
>but I realize that I be the only one here asking for that consistency
>
> Regards,
>  -Stefán
>

RE: Time for the 1.6 Release

[Dave Oshinsky]

Hello Drillers,
Efficient support of decimal data in parquet files would be a plus for my 
organization (DRILL-4184).  My pull request has been around for a few weeks, 
waiting for review:
https://github.com/apache/drill/pull/372

Thanks,
Dave Oshinsky

-Original Message-
From: Parth Chandra [mailto:par...@apache.org] 
Sent: Tuesday, March 01, 2016 8:04 PM
To: dev
Subject: Time for the 1.6 Release

Hello everyone,

  It's time to start looking into the 1.6 release.

  Can all the folks working on open issues let me know if there are any JIRAs 
you would like to get into the release?

  I know of the following -

*DRILL-4281 *- Drill should support inbound impersonation. Pull request 
expected today. C++ client to be tested.

*DRILL-4372* - Drill Operators and Functions should correctly expose their 
types within Calcite. Waiting for review.

*DRILL-3623* - Limit 0 should avoid execution when querying a known schema.
Pull request expected today. Need to add limitations of current impl to the 
JIRA. Review needed.

*DRILL-4313* - Improved client randomization. Update JIRA with warnings about 
using the feature. Waiting for review.


Thanks

Parth



***Legal Disclaimer***
"This communication may contain confidential and privileged material for the
sole use of the intended recipient. Any unauthorized review, use or distribution
by others is strictly prohibited. If you have received the message by mistake,
please advise the sender by reply email and delete the message. Thank you."
**

Re: Time for the 1.6 Release

[Stefán Baxter]

Fair point, sorry.

Please at least include these:

   - https://issues.apache.org/jira/browse/DRILL-4441
   - https://issues.apache.org/jira/browse/DRILL-4120
   - Avro schema validation prevents directory pruning when schema is
   eveolving
   - Did not find this one in Jira but the schema validation in Avro is
   currently a "all or nothing" deal
   - Personally I think this should behave the same way a Parquet and JASON
   but I realize that I be the only one here asking for that consistency

Regards,
 -Stefán

Re: Time for the 1.6 Release

[John Omernik]

Stefán -

It may help to list some here, especially ones you are aware of, in a
priority order and describe how it's a blocker.  (Maybe some can be
addressed right away, but others could wait til 1.7 etc)

John

On Wed, Mar 2, 2016 at 6:26 AM, Stefán Baxter 
wrote:

> Hi,
>
> Can you please (pretty please with sugar on top) add the tickets involved
> in proper (Yes, please excuse the language) Avro support
>
> - Stefán
>
> On Wed, Mar 2, 2016 at 12:23 PM, John Omernik  wrote:
>
> > I'd like to request drill-2517 be added as a bandaid for the planning
> > issues when there are lots of directories of parquet files.   This issue
> is
> > really hurting drill adoption for me in my org.
> >
> > Thanks,  John
> >
> >
> >
> > On Tuesday, March 1, 2016, Edmon Begoli  wrote:
> >
> > > May I please ask to give this issue the attention for 1.6:
> > > https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
> > >
> > > I will try to suggest a patch. Given my time constraints I might not be
> > > able to submit a complete, unit tested code but at I least I will try
> to
> > > submit a snippet that will help with fixing it up (I think we just need
> > to
> > > do a look ahead byte lookup to ensure that it is not \r\n.
> > >
> > > On Tuesday, March 1, 2016, Jacques Nadeau  > > > wrote:
> > >
> > > > It seems like a stretch to include DRILL-3623 right before the
> release.
> > > > This is a pretty fundamental change that seems like it should soak
> for
> > a
> > > > bit of time before we release. If we want to include, I'd suggest
> that
> > we
> > > > disable the functionality by default and consider it experimental.
> > > >
> > > > I'll propose a few other patches for inclusion shortly.
> > > >
> > > > --
> > > > Jacques Nadeau
> > > > CTO and Co-Founder, Dremio
> > > >
> > > > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  > > 
> > > > > wrote:
> > > >
> > > > > Hello everyone,
> > > > >
> > > > >   It's time to start looking into the 1.6 release.
> > > > >
> > > > >   Can all the folks working on open issues let me know if there are
> > any
> > > > > JIRAs you would like to get into the release?
> > > > >
> > > > >   I know of the following -
> > > > >
> > > > > *DRILL-4281 *- Drill should support inbound impersonation. Pull
> > request
> > > > > expected today. C++ client to be tested.
> > > > >
> > > > > *DRILL-4372* - Drill Operators and Functions should correctly
> expose
> > > > their
> > > > > types within Calcite. Waiting for review.
> > > > >
> > > > > *DRILL-3623* - Limit 0 should avoid execution when querying a known
> > > > schema.
> > > > > Pull request expected today. Need to add limitations of current
> impl
> > to
> > > > the
> > > > > JIRA. Review needed.
> > > > >
> > > > > *DRILL-4313* - Improved client randomization. Update JIRA with
> > warnings
> > > > > about using the feature. Waiting for review.
> > > > >
> > > > >
> > > > > Thanks
> > > > >
> > > > > Parth
> > > > >
> > > >
> > >
> >
> >
> > --
> > Sent from my iThing
> >
>

Re: Time for the 1.6 Release

[Stefán Baxter]

Hi,

Can you please (pretty please with sugar on top) add the tickets involved
in proper (Yes, please excuse the language) Avro support

- Stefán

On Wed, Mar 2, 2016 at 12:23 PM, John Omernik  wrote:

> I'd like to request drill-2517 be added as a bandaid for the planning
> issues when there are lots of directories of parquet files.   This issue is
> really hurting drill adoption for me in my org.
>
> Thanks,  John
>
>
>
> On Tuesday, March 1, 2016, Edmon Begoli  wrote:
>
> > May I please ask to give this issue the attention for 1.6:
> > https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
> >
> > I will try to suggest a patch. Given my time constraints I might not be
> > able to submit a complete, unit tested code but at I least I will try to
> > submit a snippet that will help with fixing it up (I think we just need
> to
> > do a look ahead byte lookup to ensure that it is not \r\n.
> >
> > On Tuesday, March 1, 2016, Jacques Nadeau  > > wrote:
> >
> > > It seems like a stretch to include DRILL-3623 right before the release.
> > > This is a pretty fundamental change that seems like it should soak for
> a
> > > bit of time before we release. If we want to include, I'd suggest that
> we
> > > disable the functionality by default and consider it experimental.
> > >
> > > I'll propose a few other patches for inclusion shortly.
> > >
> > > --
> > > Jacques Nadeau
> > > CTO and Co-Founder, Dremio
> > >
> > > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  > 
> > > > wrote:
> > >
> > > > Hello everyone,
> > > >
> > > >   It's time to start looking into the 1.6 release.
> > > >
> > > >   Can all the folks working on open issues let me know if there are
> any
> > > > JIRAs you would like to get into the release?
> > > >
> > > >   I know of the following -
> > > >
> > > > *DRILL-4281 *- Drill should support inbound impersonation. Pull
> request
> > > > expected today. C++ client to be tested.
> > > >
> > > > *DRILL-4372* - Drill Operators and Functions should correctly expose
> > > their
> > > > types within Calcite. Waiting for review.
> > > >
> > > > *DRILL-3623* - Limit 0 should avoid execution when querying a known
> > > schema.
> > > > Pull request expected today. Need to add limitations of current impl
> to
> > > the
> > > > JIRA. Review needed.
> > > >
> > > > *DRILL-4313* - Improved client randomization. Update JIRA with
> warnings
> > > > about using the feature. Waiting for review.
> > > >
> > > >
> > > > Thanks
> > > >
> > > > Parth
> > > >
> > >
> >
>
>
> --
> Sent from my iThing
>

Re: Time for the 1.6 Release

[John Omernik]

I'd like to request drill-2517 be added as a bandaid for the planning
issues when there are lots of directories of parquet files.   This issue is
really hurting drill adoption for me in my org.

Thanks,  John



On Tuesday, March 1, 2016, Edmon Begoli  wrote:

> May I please ask to give this issue the attention for 1.6:
> https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149
>
> I will try to suggest a patch. Given my time constraints I might not be
> able to submit a complete, unit tested code but at I least I will try to
> submit a snippet that will help with fixing it up (I think we just need to
> do a look ahead byte lookup to ensure that it is not \r\n.
>
> On Tuesday, March 1, 2016, Jacques Nadeau  > wrote:
>
> > It seems like a stretch to include DRILL-3623 right before the release.
> > This is a pretty fundamental change that seems like it should soak for a
> > bit of time before we release. If we want to include, I'd suggest that we
> > disable the functionality by default and consider it experimental.
> >
> > I'll propose a few other patches for inclusion shortly.
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  
> > > wrote:
> >
> > > Hello everyone,
> > >
> > >   It's time to start looking into the 1.6 release.
> > >
> > >   Can all the folks working on open issues let me know if there are any
> > > JIRAs you would like to get into the release?
> > >
> > >   I know of the following -
> > >
> > > *DRILL-4281 *- Drill should support inbound impersonation. Pull request
> > > expected today. C++ client to be tested.
> > >
> > > *DRILL-4372* - Drill Operators and Functions should correctly expose
> > their
> > > types within Calcite. Waiting for review.
> > >
> > > *DRILL-3623* - Limit 0 should avoid execution when querying a known
> > schema.
> > > Pull request expected today. Need to add limitations of current impl to
> > the
> > > JIRA. Review needed.
> > >
> > > *DRILL-4313* - Improved client randomization. Update JIRA with warnings
> > > about using the feature. Waiting for review.
> > >
> > >
> > > Thanks
> > >
> > > Parth
> > >
> >
>


-- 
Sent from my iThing

Re: Time for the 1.6 Release

[Edmon Begoli]

May I please ask to give this issue the attention for 1.6:
https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149

I will try to suggest a patch. Given my time constraints I might not be
able to submit a complete, unit tested code but at least I will try to
submit a snippet that will help with fixing it up (I think we just need to
do a look ahead byte lookup to ensure that it is not \r\n.

On Tuesday, March 1, 2016, Jacques Nadeau  wrote:

> It seems like a stretch to include DRILL-3623 right before the release.
> This is a pretty fundamental change that seems like it should soak for a
> bit of time before we release. If we want to include, I'd suggest that we
> disable the functionality by default and consider it experimental.
>
> I'll propose a few other patches for inclusion shortly.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Tue, Mar 1, 2016 at 5:04 PM, Parth Chandra  > wrote:
>
> > Hello everyone,
> >
> >   It's time to start looking into the 1.6 release.
> >
> >   Can all the folks working on open issues let me know if there are any
> > JIRAs you would like to get into the release?
> >
> >   I know of the following -
> >
> > *DRILL-4281 *- Drill should support inbound impersonation. Pull request
> > expected today. C++ client to be tested.
> >
> > *DRILL-4372* - Drill Operators and Functions should correctly expose
> their
> > types within Calcite. Waiting for review.
> >
> > *DRILL-3623* - Limit 0 should avoid execution when querying a known
> schema.
> > Pull request expected today. Need to add limitations of current impl to
> the
> > JIRA. Review needed.
> >
> > *DRILL-4313* - Improved client randomization. Update JIRA with warnings
> > about using the feature. Waiting for review.
> >
> >
> > Thanks
> >
> > Parth
> >
>

Time for the 1.6 Release

[Parth Chandra]

Hello everyone,

  It's time to start looking into the 1.6 release.

  Can all the folks working on open issues let me know if there are any
JIRAs you would like to get into the release?

  I know of the following -

*DRILL-4281 *- Drill should support inbound impersonation. Pull request
expected today. C++ client to be tested.

*DRILL-4372* - Drill Operators and Functions should correctly expose their
types within Calcite. Waiting for review.

*DRILL-3623* - Limit 0 should avoid execution when querying a known schema.
Pull request expected today. Need to add limitations of current impl to the
JIRA. Review needed.

*DRILL-4313* - Improved client randomization. Update JIRA with warnings
about using the feature. Waiting for review.


Thanks

Parth