+1 Does it make sense to add "Support Transitive Closure during Filter Push Down and Partition Pruning" feature DRILL-6173 [1]? This is one of the places where we are farther than Spark, for example [2], [3].
[1] https://issues.apache.org/jira/browse/DRILL-6173 [2] https://issues.apache.org/jira/browse/SPARK-13940 [3] https://issues.apache.org/jira/browse/SPARK-13209 Kind regards Vitalii On Wed, Nov 7, 2018 at 4:01 PM Volodymyr Vysotskyi <volody...@apache.org> wrote: > +1, sorry for the delay. > > Kind regards, > Volodymyr Vysotskyi > > > On Wed, Nov 7, 2018 at 3:56 PM Arina Ielchiieva <ar...@apache.org> wrote: > > > Hi Padma, > > > > I can include mention about batch sizing but I am not sure what I should > > mention, quick search over release notes shows a couple of changes > related > > to batch sizing: > > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/ > > Could you please propose what I should include? > > > > @PMCs and committers > > Only one PMC member has given +1 for the report. Could more folks please > > review the report? > > > > Kind regards, > > Arina > > > > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy < > > penumarthy.pa...@gmail.com> > > wrote: > > > > > Hi Arina, > > > > > > Can you add batch sizing (for bunch of operators and parquet reader) > > also ? > > > > > > Thanks > > > Padma > > > > > > > > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org> > > wrote: > > > > > > > Sure, let's mention. > > > > Updated the report. > > > > > > > > ===== > > > > > > > > ## Description: > > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and > Cloud > > > > Storage. > > > > > > > > ## Issues: > > > > - There are no issues requiring board attention at this time. > > > > > > > > ## Activity: > > > > - Since the last board report, Drill has released version 1.14.0, > > > > including the following enhancements: > > > > - Drill in a Docker container > > > > - Image metadata format plugin > > > > - Upgrade to Calcite 1.16.0 > > > > - Kafka plugin push down support > > > > - Phonetic and String functions > > > > - Enhanced decimal data support > > > > - Spill to disk for the Hash Join support > > > > - CGROUPs resource management support > > > > - Lateral / Unnest support (disabled by default) > > > > - There were active discussions about schema provision in Drill. > > > > Based on these discussions two projects are currently evolving: > > > > Drill metastore and schema provision in the file and in a query. > > > > - Apache Drill book has been written by two PMC members (Charles and > > > > Paul). > > > > - Drill developer meet up will be held on November 14, 2018. > > > > > > > > The following areas are going to be discussed: > > > > - Storage plugins > > > > - Schema discovery & Evolution > > > > - Metadata Management > > > > - Resource management > > > > - Integration with Apache Arrow > > > > > > > > ## Health report: > > > > - The project is healthy. Development activity > > > > as reflected in the pull requests and JIRAs is good. > > > > - Activity on the dev and user mailing lists are stable. > > > > - Three committers and three new PMC member were added in the last > > > period. > > > > > > > > ## PMC changes: > > > > > > > > - Currently 23 PMC members. > > > > - New PMC members: > > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018 > > > > - Charles Givre was added to the PMC on Mon Sep 03 2018 > > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018 > > > > > > > > ## Committer base changes: > > > > > > > > - Currently 48 committers. > > > > - New commmitters: > > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018 > > > > - Gautam Parai was added as a committer on Mon Oct 22 2018 > > > > - Weijie Tong was added as a committer on Fri Aug 31 2018 > > > > > > > > ## Releases: > > > > > > > > - 1.14.0 was released on Sat Aug 04 2018 > > > > > > > > ## Mailing list activity: > > > > > > > > - dev@drill.apache.org: > > > > - 427 subscribers (down -6 in the last 3 months): > > > > - 2827 emails sent to list (2126 in previous quarter) > > > > > > > > - iss...@drill.apache.org: > > > > - 18 subscribers (down -1 in the last 3 months): > > > > - 3487 emails sent to list (4769 in previous quarter) > > > > > > > > - u...@drill.apache.org: > > > > - 597 subscribers (down -6 in the last 3 months): > > > > - 332 emails sent to list (346 in previous quarter) > > > > > > > > > > > > ## JIRA activity: > > > > > > > > - 164 JIRA tickets created in the last 3 months > > > > - 128 JIRA tickets closed/resolved in the last 3 months > > > > > > > > > > > > > > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia < > > shamirwa...@mapr.com> > > > > wrote: > > > > > > > > > Hi Arina, > > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by > > > > default. > > > > > Should we mention it as part of 1.14 enhancements in the report? > > > > > > > > > > Thanks, > > > > > Sorabh > > > > > > > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva < > > > > > arina.yelchiy...@gmail.com> > > > > > wrote: > > > > > > > > > > > Thanks, Aman! Updated the report. > > > > > > I went too far with 2019, luckily the meet up will be much > earlier > > :) > > > > > > > > > > > > ===== > > > > > > > > > > > > ## Description: > > > > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and > > > Cloud > > > > > > Storage. > > > > > > > > > > > > ## Issues: > > > > > > - There are no issues requiring board attention at this time. > > > > > > > > > > > > ## Activity: > > > > > > - Since the last board report, Drill has released version > 1.14.0, > > > > > > including the following enhancements: > > > > > > - Drill in a Docker container > > > > > > - Image metadata format plugin > > > > > > - Upgrade to Calcite 1.16.0 > > > > > > - Kafka plugin push down support > > > > > > - Phonetic and String functions > > > > > > - Enhanced decimal data support > > > > > > - Spill to disk for the Hash Join support > > > > > > - CGROUPs resource management support > > > > > > - There were active discussions about schema provision in Drill. > > > > > > Based on these discussions two projects are currently > evolving: > > > > > > Drill metastore and schema provision in the file and in a > query. > > > > > > - Apache Drill book has been written by two PMC members (Charles > > and > > > > > > Paul). > > > > > > - Drill developer meet up will be held on November 14, 2018. > > > > > > The following areas are going to be discussed: > > > > > > - Storage plugins > > > > > > - Schema discovery & Evolution > > > > > > - Metadata Management > > > > > > - Resource management > > > > > > - Integration with Apache Arrow > > > > > > > > > > > > ## Health report: > > > > > > - The project is healthy. Development activity > > > > > > as reflected in the pull requests and JIRAs is good. > > > > > > - Activity on the dev and user mailing lists are stable. > > > > > > - Three committers and three new PMC member were added in the > last > > > > > period. > > > > > > > > > > > > ## PMC changes: > > > > > > > > > > > > - Currently 23 PMC members. > > > > > > - New PMC members: > > > > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018 > > > > > > - Charles Givre was added to the PMC on Mon Sep 03 2018 > > > > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018 > > > > > > > > > > > > ## Committer base changes: > > > > > > > > > > > > - Currently 48 committers. > > > > > > - New commmitters: > > > > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018 > > > > > > - Gautam Parai was added as a committer on Mon Oct 22 2018 > > > > > > - Weijie Tong was added as a committer on Fri Aug 31 2018 > > > > > > > > > > > > ## Releases: > > > > > > > > > > > > - 1.14.0 was released on Sat Aug 04 2018 > > > > > > > > > > > > ## Mailing list activity: > > > > > > > > > > > > - dev@drill.apache.org: > > > > > > - 427 subscribers (down -6 in the last 3 months): > > > > > > - 2827 emails sent to list (2126 in previous quarter) > > > > > > > > > > > > - iss...@drill.apache.org: > > > > > > - 18 subscribers (down -1 in the last 3 months): > > > > > > - 3487 emails sent to list (4769 in previous quarter) > > > > > > > > > > > > - u...@drill.apache.org: > > > > > > - 597 subscribers (down -6 in the last 3 months): > > > > > > - 332 emails sent to list (346 in previous quarter) > > > > > > > > > > > > > > > > > > ## JIRA activity: > > > > > > > > > > > > - 164 JIRA tickets created in the last 3 months > > > > > > - 128 JIRA tickets closed/resolved in the last 3 months > > > > > > > > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <amansi...@apache.org> > > > > wrote: > > > > > > > > > > > > > Docket container ==> 'Docker' > > > > > > > November 14, 2019 ==> 2018 :) (this is wrong in email > > that > > > > was > > > > > > sent > > > > > > > out) > > > > > > > > > > > > > > Rest LGTM. > > > > > > > > > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva < > > ar...@apache.org> > > > > > > wrote: > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > please take a look at the draft board report for the last > > quarter > > > > and > > > > > > let > > > > > > > > me know if you have any comments. > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Arina > > > > > > > > > > > > > > > > ===== > > > > > > > > > > > > > > > > ## Description: > > > > > > > > - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL > > and > > > > > Cloud > > > > > > > > Storage. > > > > > > > > > > > > > > > > ## Issues: > > > > > > > > - There are no issues requiring board attention at this > time. > > > > > > > > > > > > > > > > ## Activity: > > > > > > > > - Since the last board report, Drill has released version > > > 1.14.0, > > > > > > > > including the following enhancements: > > > > > > > > - Drill in a Docket container > > > > > > > > - Image metadata format plugin > > > > > > > > - Upgrade to Calcite 1.16.0 > > > > > > > > - Kafka plugin push down support > > > > > > > > - Phonetic and String functions > > > > > > > > - Enhanced decimal data support > > > > > > > > - Spill to disk for the Hash Join support > > > > > > > > - CGROUPs resource management support > > > > > > > > - There were active discussions about schema provision in > > Drill. > > > > > > > > Based on these discussions two projects are currently > > > evolving: > > > > > > > > Drill metastore and schema provision in the file and in a > > > query. > > > > > > > > - Apache Drill book has been written by two PMC members > > (Charles > > > > and > > > > > > > > Paul). > > > > > > > > - Drill developer meet up will be held on November 14, 2019. > > > > > > > > The following areas are going to be discussed: > > > > > > > > - Storage plugins > > > > > > > > - Schema discovery & Evolution > > > > > > > > - Metadata Management > > > > > > > > - Resource management > > > > > > > > - Integration with Apache Arrow > > > > > > > > > > > > > > > > ## Health report: > > > > > > > > - The project is healthy. Development activity > > > > > > > > as reflected in the pull requests and JIRAs is good. > > > > > > > > - Activity on the dev and user mailing lists are stable. > > > > > > > > - Three committers and three new PMC member were added in > the > > > last > > > > > > > period. > > > > > > > > > > > > > > > > ## PMC changes: > > > > > > > > > > > > > > > > - Currently 23 PMC members. > > > > > > > > - New PMC members: > > > > > > > > - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018 > > > > > > > > - Charles Givre was added to the PMC on Mon Sep 03 2018 > > > > > > > > - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018 > > > > > > > > > > > > > > > > ## Committer base changes: > > > > > > > > > > > > > > > > - Currently 48 committers. > > > > > > > > - New commmitters: > > > > > > > > - Chunhui Shi was added as a committer on Thu Sep 27 2018 > > > > > > > > - Gautam Parai was added as a committer on Mon Oct 22 > 2018 > > > > > > > > - Weijie Tong was added as a committer on Fri Aug 31 2018 > > > > > > > > > > > > > > > > ## Releases: > > > > > > > > > > > > > > > > - 1.14.0 was released on Sat Aug 04 2018 > > > > > > > > > > > > > > > > ## Mailing list activity: > > > > > > > > > > > > > > > > - dev@drill.apache.org: > > > > > > > > - 427 subscribers (down -6 in the last 3 months): > > > > > > > > - 2827 emails sent to list (2126 in previous quarter) > > > > > > > > > > > > > > > > - iss...@drill.apache.org: > > > > > > > > - 18 subscribers (down -1 in the last 3 months): > > > > > > > > - 3487 emails sent to list (4769 in previous quarter) > > > > > > > > > > > > > > > > - u...@drill.apache.org: > > > > > > > > - 597 subscribers (down -6 in the last 3 months): > > > > > > > > - 332 emails sent to list (346 in previous quarter) > > > > > > > > > > > > > > > > > > > > > > > > ## JIRA activity: > > > > > > > > > > > > > > > > - 164 JIRA tickets created in the last 3 months > > > > > > > > - 128 JIRA tickets closed/resolved in the last 3 months > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >