[GitHub] drill issue #1171: DRILL-6231: Fix memory allocation for repeated list vecto...

[ppadma]

Github user ppadma commented on the issue:

https://github.com/apache/drill/pull/1171
  
@paul-rogers I added the null check. Also, added a test case for 3D array 
i.e. repeated repeated list.


---

Re: [ANNOUNCE] Apache Drill release 1.13.0

[Abhishek Girish]

Congratulations everyone, on yet another great release of Apache Drill!
On Mon, Mar 19, 2018 at 6:57 AM Parth Chandra  wrote:

> On behalf of the Apache Drill community, I am happy to announce the
> release of
> Apache Drill 1.13.0.
>
> For information about Apache Drill, and to get involved, visit the
> project website
> [1].
>
> This release of Drill provides the following new features and improvements:
>
> - YARN support for Drill [DRILL-1170
> ]
>
> - Support HTTP Kerberos auth using SPNEGO [DRILL-5425
> ]
>
> - Support SQL syntax highlighting of queries [DRILL-5868
> ]
>
> - Drill should support user/distribution specific configuration checks
> during startup [DRILL-6068
> ]
>
> - Upgrade DRILL to Calcite 1.15.0 [DRILL-5966
> ]
>
> - Batch Sizing improvements to reduce memory footprint of operators
>
> - [DRILL-6071 <
> https://issues.apache.org/jira/browse/DRILL-6071>]
> - Limit batch size for flatten operator
>
> - [DRILL-6126 <
> https://issues.apache.org/jira/browse/DRILL-6126>]
> - Allocate memory for value vectors upfront in flatten operator
>
> - [DRILL-6123 <
> https://issues.apache.org/jira/browse/DRILL-6123>]
> - Limit batch size for Merge Join based on memory.
>
> - [DRILL-6177 <
> https://issues.apache.org/jira/browse/DRILL-6177>]
> - Merge Join - Allocate memory for outgoing value vectors based on sizes of
> incoming batches.
>
>
> For the full list please see release notes [2].
>
> The binary and source artifacts are available here [3].
>
> Thanks to everyone in the community who contributed to this release!
>
> 1. https://drill.apache.org/
> 2. https://drill.apache.org/docs/apache-drill-1-13-0-release-notes/
> 3. https://drill.apache.org/download/
>

[ANNOUNCE] Apache Drill release 1.13.0

[Parth Chandra]

On behalf of the Apache Drill community, I am happy to announce the release of
Apache Drill 1.13.0.

For information about Apache Drill, and to get involved, visit the
project website
[1].

This release of Drill provides the following new features and improvements:

- YARN support for Drill [DRILL-1170
]

- Support HTTP Kerberos auth using SPNEGO [DRILL-5425
]

- Support SQL syntax highlighting of queries [DRILL-5868
]

- Drill should support user/distribution specific configuration checks
during startup [DRILL-6068
]

- Upgrade DRILL to Calcite 1.15.0 [DRILL-5966
]

- Batch Sizing improvements to reduce memory footprint of operators

- [DRILL-6071 ]
- Limit batch size for flatten operator

- [DRILL-6126 ]
- Allocate memory for value vectors upfront in flatten operator

- [DRILL-6123 ]
- Limit batch size for Merge Join based on memory.

- [DRILL-6177 ]
- Merge Join - Allocate memory for outgoing value vectors based on sizes of
incoming batches.


For the full list please see release notes [2].

The binary and source artifacts are available here [3].

Thanks to everyone in the community who contributed to this release!

1. https://drill.apache.org/
2. https://drill.apache.org/docs/apache-drill-1-13-0-release-notes/
3. https://drill.apache.org/download/

Re: [VOTE] Apache Drill release 1.13.0 - RC0

[Paul Rogers]

Hi Parth,
I realized that the vote was closed only after sending. I wondered why I could 
not find your original call for a vote so I could respond to that. Turns out my 
e-mail vendor was helpfully sending some Drill e-mails (including all of yours) 
to spam...
Would be handy to have the voting period include a weekend for those of us that 
have to do this stuff on our own time.
Thanks,
- Paul

 

On Sunday, March 18, 2018, 3:49:51 AM PDT, Parth Chandra 
 wrote:  
 
 Thanks for the +1 Paul. I don't know if you realized, but this came in
after the vote closed. Glad it was a +1.
Maybe we should extend the voting period for the next release so as to
allow voters more time.



On Sun, Mar 18, 2018 at 5:21 AM, Paul Rogers 
wrote:

> Downloaded the tar.gz files. Followed the USAGE.md [1] instructions for
> running Drill-on-YARN.
> * Launched Drill using DoY on a single node YARN/HDFS cluster on my Mac.*
> Played with the DoY AM UI, which looks good.* Ran a few queries on the
> Drillbit which DoY launched. Also looks good.
> Found a number of minor gotchas but, none of the issues are show stoppers.
> Still, the following should be addressed for the next release:
>
> DRILL-6264 - Incorrect log config path for Drill-on-YARN client
>
> DRILL-6266 - Incorrect log path when Drill launched with --site option
> DRILL-6265 - Drill pid dir not set to site directory when using --site
> option
> DRILL-6268 - Drill-on-YARN client obtains HDFS URL incorrectly
> DRILL-6263 - Improvements to DoY initial experience
> Of these, DRILL-6288 is the most serious as it prevents HDFS users from
> using anything other than the default port number for HDFS. (Newer
> instructions have the user use different port number, causing failures if
> following those instructions.)
> Overall, +1 (binding)
> Thanks,
> - Paul
> [1] https://github.com/apache/drill/blob/master/drill-yarn/USAGE.md
>
>
>
> On Tue, Mar 13, 2018 at 3:58 AM, Parth Chandra  wrote:
>
> > Hi all,
> >
> > I'd like to propose the first release candidate (RC0) of Apache Drill,
> > version 1.13.0.
> >
> > The release candidate covers a total of 113 resolved JIRAs [1]. Thanks
> > to everyone
> > who contributed to this release.
> >
> > The tarball artifacts are hosted at [2] and the maven artifacts are
> hosted
> > at
> > [3].
> >
> > This release candidate is based on commit
> > cac2882d5a9e22fbc251e4caf622fe30242ad557 located at [4].
> >
> > Please download and try out the release.
> >
> > The vote ends at 1:00 PM UTC (5:00 AM PDT, 2:00 PM EET, 5:30 PM IST), Mar
> > 16th, 2018
> >
> > [ ] +1
> > [ ] +0
> > [ ] -1
> >
> > Here's my vote: +1
> >
> >
> > [1 ]
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> > projectId=12313820=12342096
> >
> > [2] http://home.apache.org/~parthc/drill/releases/1.13.0/rc0/
> >
> > [3] https://repository.apache.org/content/repositories/
> orgapachedrill-1046
> >
> > [4] https://github.com/parthchandra/drill/tree/drill-1.13.0
> >Incorrect log config path for Drill-on-YARN client
>
  

Re: [ANNOUNCE] New Committer: Volodymyr Vysotskyi

[Volodymyr Vysotskyi]

Thank you all for your wishes, I'm very pleased to become a Drill committer!

Kind regards,
Volodymyr Vysotskyi

2018-03-16 13:36 GMT+02:00 Parth Chandra :

> Congratulations Volodymyr!
>
> On Fri, Mar 16, 2018 at 7:33 AM, Paul Rogers 
> wrote:
>
> > Congratulations! Thanks for the great contributions.
> > - Paul
> >
> >
> >
> > On Thursday, March 15, 2018, 10:26:26 AM PDT, Khurram Faraaz <
> > kfar...@mapr.com> wrote:
> >
> >  Congratulations Volodymyr!
> >
> > 
> > From: Arina Ielchiieva 
> > Sent: Thursday, March 15, 2018 10:16:51 AM
> > To: dev@drill.apache.org
> > Subject: [ANNOUNCE] New Committer: Volodymyr Vysotskyi
> >
> > The Project Management Committee (PMC) for Apache Drill has
> > invited Volodymyr Vysotskyi to become a committer, and we are pleased to
> > announce that he has accepted.
> >
> > Volodymyr has been contributing for Drill over a year. He contributed in
> > different areas, including code generation, json processing, function
> > implementations.
> > Also he actively participated in Calcite rebase and showed profound
> > knowledge
> > in planning area.
> > Currently he is working on decimal's enhancement in Drill.
> >
> > Congratulations Volodymyr and thank you for your contributions!
> >
> > - Arina
> > (on behalf of the Apache Drill PMC)
> >
>

Re: [VOTE] Apache Drill release 1.13.0 - RC0

[Parth Chandra]

Thanks for the +1 Paul. I don't know if you realized, but this came in
after the vote closed. Glad it was a +1.
Maybe we should extend the voting period for the next release so as to
allow voters more time.



On Sun, Mar 18, 2018 at 5:21 AM, Paul Rogers 
wrote:

> Downloaded the tar.gz files. Followed the USAGE.md [1] instructions for
> running Drill-on-YARN.
> * Launched Drill using DoY on a single node YARN/HDFS cluster on my Mac.*
> Played with the DoY AM UI, which looks good.* Ran a few queries on the
> Drillbit which DoY launched. Also looks good.
> Found a number of minor gotchas but, none of the issues are show stoppers.
> Still, the following should be addressed for the next release:
>
> DRILL-6264 - Incorrect log config path for Drill-on-YARN client
>
> DRILL-6266 - Incorrect log path when Drill launched with --site option
> DRILL-6265 - Drill pid dir not set to site directory when using --site
> option
> DRILL-6268 - Drill-on-YARN client obtains HDFS URL incorrectly
> DRILL-6263 - Improvements to DoY initial experience
> Of these, DRILL-6288 is the most serious as it prevents HDFS users from
> using anything other than the default port number for HDFS. (Newer
> instructions have the user use different port number, causing failures if
> following those instructions.)
> Overall, +1 (binding)
> Thanks,
> - Paul
> [1] https://github.com/apache/drill/blob/master/drill-yarn/USAGE.md
>
>
>
> On Tue, Mar 13, 2018 at 3:58 AM, Parth Chandra  wrote:
>
> > Hi all,
> >
> > I'd like to propose the first release candidate (RC0) of Apache Drill,
> > version 1.13.0.
> >
> > The release candidate covers a total of 113 resolved JIRAs [1]. Thanks
> > to everyone
> > who contributed to this release.
> >
> > The tarball artifacts are hosted at [2] and the maven artifacts are
> hosted
> > at
> > [3].
> >
> > This release candidate is based on commit
> > cac2882d5a9e22fbc251e4caf622fe30242ad557 located at [4].
> >
> > Please download and try out the release.
> >
> > The vote ends at 1:00 PM UTC (5:00 AM PDT, 2:00 PM EET, 5:30 PM IST), Mar
> > 16th, 2018
> >
> > [ ] +1
> > [ ] +0
> > [ ] -1
> >
> > Here's my vote: +1
> >
> >
> > [1 ]
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> > projectId=12313820=12342096
> >
> > [2] http://home.apache.org/~parthc/drill/releases/1.13.0/rc0/
> >
> > [3] https://repository.apache.org/content/repositories/
> orgapachedrill-1046
> >
> > [4] https://github.com/parthchandra/drill/tree/drill-1.13.0
> >Incorrect log config path for Drill-on-YARN client
>