Current status: DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code reviewer - Paul) - fix is expected by the EOD in new pull request. DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code reviewer - Paul) - unit test failures are fixed. Unit test performance degraded x3 times!
Kind regards On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva < [email protected]> wrote: > Current status: > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code > reviewer - Paul) - could not cherry-pick the commits. Needs fix. > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code > reviewer - Paul) - there are unit test failures. Needs fix. > > Kind regards > > On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <[email protected]> > wrote: > >> Hi Arina, >> >> Sorry for the delay. Just now we squashed Kafka storage plugin commits >> into >> one commit and pushed. >> >> Thanks & Regards, >> B Anil Kumar. >> >> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva < >> [email protected]> wrote: >> >> > Current status: >> > >> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, >> code >> > reviewer - Paul) - needs to squash the commits. >> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code >> > reviewer - Paul) - needs to address some code review comments. >> > >> > Kind regards >> > Arina >> > >> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva < >> > [email protected]> wrote: >> > >> > > Current status, we are close to the code freeze which will happen not >> > > later then the end of the next week. >> > > >> > > Blocker: >> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., >> code >> > > reviewer - Arina) - in progress. >> > > >> > > Targeted for 1.12 release: >> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, >> code >> > > reviewer - Paul) - needs next round of code review. >> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN >> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - >> waiting >> > > for Parth code review. >> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina, >> code >> > > reviewer - Tim) - code review is done, waiting for the merge. >> > > >> > > Kind regards >> > > >> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <[email protected]> wrote: >> > > >> > >> Hi Arina, >> > >> >> > >> >> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy >> > >> loading schema for storage plugins. Could you or Paul take a look at >> the >> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032? >> I >> > >> think both of you are familiar with this part. >> > >> >> > >> >> > >> Thanks, >> > >> >> > >> >> > >> Chunhui >> > >> >> > >> ________________________________ >> > >> From: Arina Yelchiyeva <[email protected]> >> > >> Sent: Thursday, November 9, 2017 8:11:35 AM >> > >> To: [email protected] >> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release >> > >> >> > >> Yes, they are already in master. >> > >> >> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <[email protected]> >> wrote: >> > >> >> > >> > We’re including the Networking functions in this release right? >> > >> > >> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva < >> > >> [email protected]> >> > >> > wrote: >> > >> > > >> > >> > > If changes will be done before cut off date, targeting mid >> November >> > >> that >> > >> > it >> > >> > > will be possible to include this Jira. >> > >> > > >> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <[email protected]> >> > >> wrote: >> > >> > > >> > >> > >> Hi Arina, >> > >> > >> Can we include DRILL-4091 Support for additional GIS operations >> in >> > >> > version >> > >> > >> 1.12? In general the code looked pretty good. There was a unit >> > test >> > >> > >> missing which the developer submitted and some minor formatting >> > >> issues >> > >> > >> which I’m still waiting on. >> > >> > >> Thanks, >> > >> > >> —C >> > >> > >> >> > >> > >> >> > >> > >> >> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva < >> > >> [email protected] >> > >> > > >> > >> > >> wrote: >> > >> > >>> >> > >> > >>> Current status: >> > >> > >>> >> > >> > >>> Blocker: >> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - >> Vlad >> > R., >> > >> > code >> > >> > >>> reviewer - ?) - in progress. >> > >> > >>> >> > >> > >>> Targeted for 1.12 release: >> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., >> code >> > >> > >> reviewer - >> > >> > >>> Arina) - code review in final stage. >> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil & >> > Kamesh, >> > >> > code >> > >> > >>> reviewer - Paul) - in review. >> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for >> > >> PLAIN >> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth & >> Laurent) - >> > >> > waiting >> > >> > >>> for the code review. >> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - >> > Arina, >> > >> > code >> > >> > >>> reviewer - Tim) - waiting for the code review. >> > >> > >>> >> > >> > >>> Kind regards >> > >> > >>> Arina >> > >> > >>> >> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva < >> > >> > >>> [email protected]> wrote: >> > >> > >>> >> > >> > >>>> Current status: >> > >> > >>>> >> > >> > >>>> Targeted for 1.12 release: >> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager >> > >> rather >> > >> > >> than >> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the >> code >> > >> > review >> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator >> contexts >> > >> for >> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for >> the >> > >> code >> > >> > >>>> review >> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles, >> code >> > >> > reviewer >> > >> > >>>> - Arina) - waiting changes after code review >> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code >> reviewer - >> > >> > >> Arina) - waiting >> > >> > >>>> for the code review >> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default >> > >> > (developer - >> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach >> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, >> code >> > >> > >> reviewer >> > >> > >>>> - ?) - finishing implementation >> > >> > >>>> >> > >> > >>>> Under question: >> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - >> Jyothsna, >> > >> code >> > >> > >>>> reviewer - ?) - waiting for the status update from the >> developer >> > >> > >>>> >> > >> > >>>> Please free to suggest other items that are targeted for 1.12 >> > >> release. >> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it >> > >> would be >> > >> > >> good >> > >> > >>>> if developers revisit them and update fix version to the >> actual >> > >> one. >> > >> > >>>> Link to the dashboard - https://issues.apache.org/ >> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey= >> > >> > DRILL&view=detail >> > >> > >>>> >> > >> > >>>> Kind regards >> > >> > >>>> Arina >> > >> > >>>> >> > >> > >>>> >> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra < >> > [email protected]> >> > >> > >> wrote: >> > >> > >>>> >> > >> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of >> > days >> > >> > >> more to >> > >> > >>>>> see if there are any more comments before I merge the changes >> > in. >> > >> > >>>>> >> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers < >> [email protected]> >> > >> > wrote: >> > >> > >>>>> >> > >> > >>>>>> Hi Arina, >> > >> > >>>>>> >> > >> > >>>>>> In addition to my own PRs, there are several in the “active” >> > >> queue >> > >> > >> that >> > >> > >>>>> we >> > >> > >>>>>> could get in if we can just push them over the line and >> clear >> > the >> > >> > >> queue. >> > >> > >>>>>> The owners of the PRs should check if we are waiting on >> them to >> > >> take >> > >> > >>>>> action. >> > >> > >>>>>> >> > >> > >>>>>> 977 DRILL-5849: Add freemarker lib to >> dependencyManagement >> > to >> > >> > >> ensure >> > >> > >>>>>> prop… >> > >> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns >> > >> > >>>>>> 975 DRILL-5743: Handling column family and column scan >> for >> > >> hbase >> > >> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table >> > fails >> > >> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case >> of >> > >> > nested >> > >> > >>>>>> field (reg. of DRILL-4264) >> > >> > >>>>>> 950 Drill 5431: SSL Support >> > >> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup >> level >> > >> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 >> > support >> > >> can >> > >> > >> be >> > >> > >>>>>> enabled / disabled in Drill >> > >> > >>>>>> 904 DRILL-5717: change some date time test cases with >> > >> specific >> > >> > >>>>>> timezone or Local >> > >> > >>>>>> 892 DRILL-5645: negation of expression causes null >> pointer >> > >> > >> exception >> > >> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for >> the >> > >> > >>>>> cartesian >> > >> > >>>>>> join >> > >> > >>>>>> >> > >> > >>>>>> (Items not on the list above have become “inactive” for a >> > >> variety of >> > >> > >>>>>> reasons.) >> > >> > >>>>>> >> > >> > >>>>>> Thanks, >> > >> > >>>>>> >> > >> > >>>>>> - Paul >> > >> > >>>>>> >> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <[email protected]> >> > >> wrote: >> > >> > >>>>>>> >> > >> > >>>>>>> Hi Arina, >> > >> > >>>>>>> >> > >> > >>>>>>> I’d like to include the following that are needed to >> finish up >> > >> the >> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg: >> > >> > >>>>>>> >> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation >> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for >> > >> "managed" >> > >> > >>>>>> operators >> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of >> > total >> > >> > >>>>>>> >> > >> > >>>>>>> The following is needed to resolve issues with HBase >> support >> > in >> > >> > empty >> > >> > >>>>>> batches: >> > >> > >>>>>>> >> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from >> > DRILL-5546 >> > >> > >>>>>>> >> > >> > >>>>>>> The following are nice-to-haves that build on work already >> > done >> > >> in >> > >> > >>>>> this >> > >> > >>>>>> release, and that some of my own work depends on: >> > >> > >>>>>>> >> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use >> > >> > SystemOptionManager >> > >> > >>>>>> rather than mock >> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, >> operator >> > >> > >>>>> contexts >> > >> > >>>>>> for testing >> > >> > >>>>>>> >> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the >> > >> foundation >> > >> > >>>>> for a >> > >> > >>>>>> project I’m working on; would be good to get this in after >> 2-3 >> > >> > months >> > >> > >> of >> > >> > >>>>>> review time: >> > >> > >>>>>>> >> > >> > >>>>>>> #921, foundation for batch size limitation >> > >> > >>>>>>> >> > >> > >>>>>>> The key issue with each of the above is that they each >> need a >> > >> > >>>>> committer >> > >> > >>>>>> to review. Some have reviews from non-committers. Any >> > volunteers? >> > >> > >>>>>>> >> > >> > >>>>>>> Thanks, >> > >> > >>>>>>> >> > >> > >>>>>>> - Paul >> > >> > >>>>>>> >> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre < >> [email protected]> >> > >> > wrote: >> > >> > >>>>>>>> >> > >> > >>>>>>>> Hi Arina, >> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions. >> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 < >> > >> > >> https://github.com/apache/ >> > >> > >>>>>> drill/pull/971> >> > >> > >>>>>>>> >> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this >> > time >> > >> ;-) >> > >> > >>>>>>>> —C >> > >> > >>>>>>>> >> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva < >> > >> > >>>>>> [email protected]> wrote: >> > >> > >>>>>>>>> >> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try >> to >> > >> > finish >> > >> > >>>>> code >> > >> > >>>>>>>>> review during this week. >> > >> > >>>>>>>>> >> > >> > >>>>>>>>> Kind regards >> > >> > >>>>>>>>> Arina >> > >> > >>>>>>>>> >> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva < >> > >> > [email protected] >> > >> > >>> >> > >> > >>>>>> wrote: >> > >> > >>>>>>>>> >> > >> > >>>>>>>>>> Hi Drillers, >> > >> > >>>>>>>>>> >> > >> > >>>>>>>>>> It's been several months since the last release and it >> is >> > >> time >> > >> > to >> > >> > >>>>> do >> > >> > >>>>>> the >> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager. >> > >> > >>>>>>>>>> >> > >> > >>>>>>>>>> If there are any issues on which work is in progress, >> that >> > >> you >> > >> > >>>>> feel we >> > >> > >>>>>>>>>> *must* include in the release, please post in reply to >> this >> > >> > >> thread. >> > >> > >>>>>> Based >> > >> > >>>>>>>>>> on your input we'll define release cut off date. >> > >> > >>>>>>>>>> >> > >> > >>>>>>>>>> Kind regards >> > >> > >>>>>>>>>> Arina >> > >> > >>>>>>>>>> >> > >> > >>>>>>>> >> > >> > >>>>>>> >> > >> > >>>>>> >> > >> > >>>>>> >> > >> > >>>>> >> > >> > >>>> >> > >> > >>>> >> > >> > >> >> > >> > >> >> > >> > >> > >> > >> > >> >> > > >> > > >> > >> > >
