NIFI-4360 Need reviewers - Support For ADLS Processors

[Milan Chandna]

Hi,

Need reviewers for PR: https://github.com/apache/nifi/pull/2158

Please pitch in for review or recommend someone who can give insights.

ADLS is gaining attention among NIFI users lately.
Just to quote an example, Animesh yesterday asked for this on user group.

P.S: ADLS is Azure Data Lake Store, which is HDFS like filesystem.

Thanks,
Milan.

RE: Apache NiFi: Processor for Azure Data Lake(ADL)

[Milan Chandna]

Hi Animesh,

There is an ADLS connector underway but is lacking traction.
Here is the PR: https://github.com/apache/nifi/pull/2158
Probably you can self build this and use it.
Will be great if you come back and provide some feedback on this.

Thanks,
Milan.

-Original Message-
From: Animesh Jain  
Sent: Wednesday, March 21, 2018 6:39 PM
To: us...@nifi.apache.org; dev@nifi.apache.org
Subject: Apache NiFi: Processor for Azure Data Lake(ADL)

Hi Everyone,

I am looking for a processor for Azure Data Lake which can work in cluster mode 
setup with separate zookeeper instance.

If any one has worked on a similar use case, appreciate your help here. I see 
that there is no inbuilt ADL processor which comes up with Nifi. What is the 
recommendations here ?

Have a good day!

Thanks,
Animesh

RE: [DISCUSS} Closing in on a NiFi 1.4.0 release?

[Milan Chandna]

Well I think that makes sense and fair enough :)

-Original Message-
From: Joe Witt [mailto:joe.w...@gmail.com] 
Sent: Friday, September 22, 2017 10:23 PM
To: dev@nifi.apache.org
Subject: Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

Milan,

Also note that even if it isn't reviewed and merged for 1.4.0 we do releases 
fairly often and we dont really have to wait any specific period.  It is really 
matter of keeping the momentum towards and releases and having release managers 
available to do the release.  So please don't feel like if it misses this 1.4.0 
release that you missed out.  The reality is we have a lot of outstanding 
contributions and getting good reviews/feedback/testing cycles for them is not 
easy.  We need both contributions in the form of code but also thoughtful 
reviews and testing.

It is awesome that you contributed as Mark points out - now it is a matter of 
letting the process and community help get it across the finish line.  You 
might consider looking for open PRs that exist and seeing if you could help 
test and provide review feedback as well.

Thanks

On Fri, Sep 22, 2017 at 12:47 PM, Mark Payne  wrote:
> Milan,
>
> No worries - honored that you chose NiFi to be the first project that you 
> contributed to!
>
> When one of the NiFi committers has reviewed the PR and is happy with 
> it, he/she will merge the PR to master and will close your JIRA. You 
> won't need to do anything, unless the reviewer leaves feedback that something 
> needs to be addressed.
>
> Thanks!
> -Mark
>
>
> On Sep 22, 2017, at 12:41 PM, Milan Chandna 
> mailto:milan.chan...@microsoft.com.INVALID>>
>  wrote:
>
> OK, thanks for updating.
> But how will I know if my PR is ready to be merged in master so that I can 
> close JIRA?
>
> Sorry for silly questions but this is my first contribution in open source, 
> kindly bear.
>
> Regards,
> Milan.
>
> -Original Message-
> From: Jeff [mailto:jtsw...@gmail.com]
> Sent: Friday, September 22, 2017 9:58 PM
> To: dev@nifi.apache.org<mailto:dev@nifi.apache.org>
> Subject: [DISCUSS} Closing in on a NiFi 1.4.0 release?
>
> Just an update on the RC for 1.4.0.  I will be starting the release process 
> between 1530 and 1600 EST today.  That's approximately 3 hours from now.
>
> On Thu, Sep 21, 2017 at 5:30 PM Jeff 
> mailto:jtsw...@gmail.com>> wrote:
>
> FYI, I'll be starting the release candidate prep around noon EST on 
> the 22nd, which is less than 24 hours from now.  At that point, I'll 
> be moving tickets out of 1.4.0.
>
> On Thu, Sep 21, 2017, 3:52 PM Milan Chandna 
> mailto:milan.chan...@microsoft.com.invalid>>
>  wrote:
>
> Thanks Mark (and Jeff) for clearing this out.
>
> Yes I would like below mentioned Jira (supporting ADLS) and PR to be 
> reviewed asap, so that we can get it in 1.4.0.
> Jira:
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissu
> es.apache.org<https://na01.safelinks.protection.outlook.com/?url=http%
> 3A%2F%2Fes.apache.org%2F&data=02%7C01%7CMilan.Chandna%40microsoft.com%
> 7Ccb1f67dc13354a466bf708d501da5da4%7C72f988bf86f141af91ab2d7cd011db47%
> 7C1%7C0%7C636416959741612603&sdata=ZP0NT0KUvrYg3hiiyi9hraIz4r%2BF9tfWS
> utZJzPibvM%3D&reserved=0>%2Fjira%2Fbrowse%2FNIFI-4360&data=02%7C01%7CM
> ilan.Chandn
> a%40microsoft.com<https://na01.safelinks.protection.outlook.com/?url=h
> ttp%3A%2F%2F40microsoft.com%2F&data=02%7C01%7CMilan.Chandna%40microsof
> t.com%7Ccb1f67dc13354a466bf708d501da5da4%7C72f988bf86f141af91ab2d7cd01
> 1db47%7C1%7C0%7C636416959741612603&sdata=F7xRFW5k88cVnN5hkWYfMtuWK1m3z
> qsNyqWLffgKhVM%3D&reserved=0>%7C24035c0efa204e4b2f9008d501d6ff39%7C72f
> 988bf86f141 
> af91ab2d7cd011db47%7C1%7C0%7C636416945281758772&sdata=lNbSA5mMpvct6fV
> BycMzLZJBt08OeyUazjnTh8drRDA%3D&reserved=0
> PR:
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2
> Fub.com%2F&data=02%7C01%7CMilan.Chandna%40microsoft.com%7Ccb1f67dc1335
> 4a466bf708d501da5da4%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C6364
> 16959741612603&sdata=51uUrBxMk3Wc%2BV0itTjGaT4FSww1Jx00nOZUd5a6sCM%3D&
> reserved=0>%2Fapache%2Fnifi%2Fpull%2F2158&data=02%7C01%7CMilan.Chandna
> %40m 
> icrosoft.com<https://na01.safelinks.protection.outlook.com/?url=http%3
> A%2F%2Ficrosoft.com%2F&data=02%7C01%7CMilan.Chandna%40microsoft.com%7C
> cb1f67dc13354a466bf708d501da5da4%7C72f988bf86f141af91ab2d7cd011db47%7C
> 1%7C0%7C636416959741612603&sdata=w%2FeywkuuYCjzkDAmKlakdm2cucVrn%2BsH5
> To7I8cdib8%3D&reserved=0>%7C24035c0efa204e4b2f9008d501d6ff39%7C72f988b
> f86f141af91a 
> b2d7cd01

RE: [DISCUSS} Closing in on a NiFi 1.4.0 release?

[Milan Chandna]

OK, thanks for updating.
But how will I know if my PR is ready to be merged in master so that I can 
close JIRA?

Sorry for silly questions but this is my first contribution in open source, 
kindly bear.

Regards,
Milan.

-Original Message-
From: Jeff [mailto:jtsw...@gmail.com] 
Sent: Friday, September 22, 2017 9:58 PM
To: dev@nifi.apache.org
Subject: [DISCUSS} Closing in on a NiFi 1.4.0 release?

Just an update on the RC for 1.4.0.  I will be starting the release process 
between 1530 and 1600 EST today.  That's approximately 3 hours from now.

On Thu, Sep 21, 2017 at 5:30 PM Jeff  wrote:

> FYI, I'll be starting the release candidate prep around noon EST on 
> the 22nd, which is less than 24 hours from now.  At that point, I'll 
> be moving tickets out of 1.4.0.
>
> On Thu, Sep 21, 2017, 3:52 PM Milan Chandna 
>  wrote:
>
>> Thanks Mark (and Jeff) for clearing this out.
>>
>> Yes I would like below mentioned Jira (supporting ADLS) and PR to be 
>> reviewed asap, so that we can get it in 1.4.0.
>> Jira: 
>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissu
>> es.apache.org%2Fjira%2Fbrowse%2FNIFI-4360&data=02%7C01%7CMilan.Chandn
>> a%40microsoft.com%7C24035c0efa204e4b2f9008d501d6ff39%7C72f988bf86f141
>> af91ab2d7cd011db47%7C1%7C0%7C636416945281758772&sdata=lNbSA5mMpvct6fV
>> BycMzLZJBt08OeyUazjnTh8drRDA%3D&reserved=0
>> PR: 
>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
>> ub.com%2Fapache%2Fnifi%2Fpull%2F2158&data=02%7C01%7CMilan.Chandna%40m
>> icrosoft.com%7C24035c0efa204e4b2f9008d501d6ff39%7C72f988bf86f141af91a
>> b2d7cd011db47%7C1%7C0%7C636416945281758772&sdata=VGGVB%2BGP44vaevmQXa
>> T55Y5pSPhbZxZyN7UeIVyA4pU%3D&reserved=0
>>
>> Though the commits are very stable,
>> but would be great to get this reviewed by NIFI experts.
>> Really want to see ADLS shining out in NIFI along with its 
>> co-offerings like HDFS.
>>
>> P.S: These processors are similar to HDFS (in implementation), if 
>> that helps for reviewers to take it up.
>>
>> Regards,
>> -Milan.
>>
>> -Original Message-
>> From: Mark Payne [mailto:marka...@hotmail.com]
>> Sent: Thursday, September 21, 2017 6:16 PM
>> To: dev@nifi.apache.org
>> Subject: Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?
>>
>> Milan,
>>
>> There is no specific deadline. The PR would just need to be merged to 
>> master by the time that the branch is created for the Release 
>> Candidate. I don't know exactly when that is going to happen, since I 
>> am not the Release Manager for this particular release. However, I do 
>> expect it to be quite soon. If you are able to submit a PR that you'd 
>> like to have considered for inclusion in the release, you can submit 
>> it and let us know so that someone will review it if time permits.
>>
>> That said, if there are issues that need to be addressed before 
>> merging the PR, I don't think we would hold up the release to get it 
>> in unless it is considered a "BLOCKER" jira.
>>
>> Does that help?
>>
>> Thanks
>> -Mark
>>
>>
>> > On Sep 21, 2017, at 4:18 AM, Milan Chandna 
>> > 
>> wrote:
>> >
>> > Do we have a deadline to get the issue resolved, to include it in 
>> > 1.4.0
>> release.
>> >
>> > -Original Message-
>> > From: Adam Taft [mailto:a...@adamtaft.com]
>> > Sent: Thursday, September 21, 2017 9:20 AM
>> > To: dev@nifi.apache.org
>> > Subject: Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?
>> >
>> > Here's another good link to try, maybe a little easier to read:
>> >
>> > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fis
>> > sue 
>> > s.apache.org%2Fjira%2Fprojects%2FNIFI%2Fversions%2F12340589&data=02
>> > %7C 
>> > 01%7CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e9
>> > 00% 
>> > 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344144936&sda
>> > ta=
>> > kO%2ByQJA%2FchMrvYYMpUZ%2FGOj%2FYVNEWgbmtahAr6ITrVk%3D&reserved=0
>> >
>> >
>> >
>> > On Wed, Sep 20, 2017 at 8:01 AM, Brandon DeVries  wrote:
>> >
>> >> Mayank,
>> >>
>> >> Try this:
>> >>
>> >> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fi
>> >> ssu
>> >> e
>> >> s.apache.org%2Fjira%2Fissues%2F%3Fjql%3Dproject%2520%25&data=02%7C
&

NIFI-4360 Need reviewers

[Milan Chandna]

Got some reviews already but will be good if I can get some more.
Planning to merge this in master asap to get it in 1.4.0

Any help appreciated.

Thanks,
-Milan.

RE: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

[Milan Chandna]

Thanks Mark (and Jeff) for clearing this out.

Yes I would like below mentioned Jira (supporting ADLS) and PR to be reviewed 
asap, 
so that we can get it in 1.4.0.
Jira: https://issues.apache.org/jira/browse/NIFI-4360 
PR: https://github.com/apache/nifi/pull/2158 

Though the commits are very stable, 
but would be great to get this reviewed by NIFI experts.
Really want to see ADLS shining out in NIFI along with its co-offerings like 
HDFS.

P.S: These processors are similar to HDFS (in implementation), if that helps 
for reviewers to take it up.

Regards,
-Milan.

-Original Message-
From: Mark Payne [mailto:marka...@hotmail.com] 
Sent: Thursday, September 21, 2017 6:16 PM
To: dev@nifi.apache.org
Subject: Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

Milan,

There is no specific deadline. The PR would just need to be merged to master by 
the time that the branch is created for the Release Candidate. I don't know 
exactly when that is going to happen, since I am not the Release Manager for 
this particular release. However, I do expect it to be quite soon. If you are 
able to submit a PR that you'd like to have considered for inclusion in the 
release, you can submit it and let us know so that someone will review it if 
time permits.

That said, if there are issues that need to be addressed before merging the PR, 
I don't think we would hold up the release to get it in unless it is considered 
a "BLOCKER" jira.

Does that help?

Thanks
-Mark


> On Sep 21, 2017, at 4:18 AM, Milan Chandna 
>  wrote:
> 
> Do we have a deadline to get the issue resolved, to include it in 1.4.0 
> release.
> 
> -Original Message-
> From: Adam Taft [mailto:a...@adamtaft.com]
> Sent: Thursday, September 21, 2017 9:20 AM
> To: dev@nifi.apache.org
> Subject: Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?
> 
> Here's another good link to try, maybe a little easier to read:
> 
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissue
> s.apache.org%2Fjira%2Fprojects%2FNIFI%2Fversions%2F12340589&data=02%7C
> 01%7CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%
> 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344144936&sdata=
> kO%2ByQJA%2FchMrvYYMpUZ%2FGOj%2FYVNEWgbmtahAr6ITrVk%3D&reserved=0
> 
> 
> 
> On Wed, Sep 20, 2017 at 8:01 AM, Brandon DeVries  wrote:
> 
>> Mayank,
>> 
>> Try this:
>> 
>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissu
>> e
>> s.apache.org%2Fjira%2Fissues%2F%3Fjql%3Dproject%2520%25&data=02%7C01%
>> 7
>> CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%7C7
>> 2 
>> f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344144936&sdata=U5d
>> I
>> A%2FD0S3yLy4trFBag8IZ3mVJtCD1tWtdLc2hZ2rQ%3D&reserved=0
>> 3D%20NIFI%20AND%20fixVersion%20%3D%201.4.0%20ORDER%20BY%20status%20DE
>> S
>> C
>> 
>> Brandon
>> 
>> 
>> On Wed, Sep 20, 2017 at 9:57 AM mayank rathi 
>> wrote:
>> 
>>> Hello All,
>>> 
>>> How can we find out list of fixes that will go in 1.4.0 release?
>>> 
>>> Thanks!!
>>> 
>>> On Wed, Sep 20, 2017 at 9:53 AM, Brandon DeVries  wrote:
>>> 
>>>> All,
>>>> 
>>>> I think we should plan on calling for a vote on Friday.  That gives 
>>>> two days to wrap up any outstanding tickets that anyone feels 
>>>> really belong
>>> in
>>>> 1.4.  At that point the remaining tickets can be shifted to a 
>>>> future release.
>>>> 
>>>> If there are tickets that are not getting the attention they need 
>>>> to
>> make
>>>> it into the release, let the list know.
>>>> 
>>>> Any objections?
>>>> 
>>>> Brandon
>>>> 
>>>> On Wed, Sep 20, 2017 at 12:32 AM Koji Kawamura 
>>>> >> 
>>>> wrote:
>>>> 
>>>>> Hi Paul,
>>>>> 
>>>>> I was able to reproduce the GenerateTableFetch processor issue 
>>>>> reported by NIFI-4395.
>>>>> Please go ahead and provide a PR, I can review it.
>>>>> 
>>>>> Thanks,
>>>>> Koji
>>>>> 
>>>>> On Wed, Sep 20, 2017 at 1:10 PM, Paul Gibeault (pagibeault) 
>>>>>  wrote:
>>>>>> We have submitted this JIRA ticket:
>>>>>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F
>>>>>> %2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4395&data=02%7C01%
>>>>>> 7CMilan.Chandna%40m

RE: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

[Milan Chandna]

Do we have a deadline to get the issue resolved, to include it in 1.4.0 release.

-Original Message-
From: Adam Taft [mailto:a...@adamtaft.com] 
Sent: Thursday, September 21, 2017 9:20 AM
To: dev@nifi.apache.org
Subject: Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

Here's another good link to try, maybe a little easier to read:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fprojects%2FNIFI%2Fversions%2F12340589&data=02%7C01%7CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344144936&sdata=kO%2ByQJA%2FchMrvYYMpUZ%2FGOj%2FYVNEWgbmtahAr6ITrVk%3D&reserved=0



On Wed, Sep 20, 2017 at 8:01 AM, Brandon DeVries  wrote:

> Mayank,
>
> Try this:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissue
> s.apache.org%2Fjira%2Fissues%2F%3Fjql%3Dproject%2520%25&data=02%7C01%7
> CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%7C72
> f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344144936&sdata=U5dI
> A%2FD0S3yLy4trFBag8IZ3mVJtCD1tWtdLc2hZ2rQ%3D&reserved=0
> 3D%20NIFI%20AND%20fixVersion%20%3D%201.4.0%20ORDER%20BY%20status%20DES
> C
>
> Brandon
>
>
> On Wed, Sep 20, 2017 at 9:57 AM mayank rathi 
> wrote:
>
> > Hello All,
> >
> > How can we find out list of fixes that will go in 1.4.0 release?
> >
> > Thanks!!
> >
> > On Wed, Sep 20, 2017 at 9:53 AM, Brandon DeVries  wrote:
> >
> > > All,
> > >
> > > I think we should plan on calling for a vote on Friday.  That 
> > > gives two days to wrap up any outstanding tickets that anyone 
> > > feels really belong
> > in
> > > 1.4.  At that point the remaining tickets can be shifted to a 
> > > future release.
> > >
> > > If there are tickets that are not getting the attention they need 
> > > to
> make
> > > it into the release, let the list know.
> > >
> > > Any objections?
> > >
> > > Brandon
> > >
> > > On Wed, Sep 20, 2017 at 12:32 AM Koji Kawamura 
> > >  >
> > > wrote:
> > >
> > > > Hi Paul,
> > > >
> > > > I was able to reproduce the GenerateTableFetch processor issue 
> > > > reported by NIFI-4395.
> > > > Please go ahead and provide a PR, I can review it.
> > > >
> > > > Thanks,
> > > > Koji
> > > >
> > > > On Wed, Sep 20, 2017 at 1:10 PM, Paul Gibeault (pagibeault) 
> > > >  wrote:
> > > > > We have submitted this JIRA ticket:
> > > > > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F
> > > > > %2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4395&data=02%7C01%
> > > > > 7CMilan.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3
> > > > > e900%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636415626344
> > > > > 144936&sdata=cSKg20gPxzXXabttEoU4poDyu8k%2BkE2bFybrIc3NKSI%3D&
> > > > > reserved=0
> > > > >
> > > > > This issue causes GenerateTableFetch processor to malfunction
> after a
> > > > server restart.
> > > > >
> > > > > We are very interested in getting this released in 1.4.0 and 
> > > > > are
> > > willing
> > > > to provide the PR if there is still time.
> > > > >
> > > > > Thanks,
> > > > > Paul Gibeault
> > > > >
> > > > >
> > > > > -Original Message-
> > > > > From: Michael Hogue [mailto:michael.p.hogu...@gmail.com]
> > > > > Sent: Tuesday, September 19, 2017 9:36 AM
> > > > > To: dev@nifi.apache.org
> > > > > Subject: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?
> > > > >
> > > > > All,
> > > > >
> > > > >There are a couple of issues with open PRs that i think 
> > > > > would be
> > > > desirable to get into 1.4.0:
> > > > >
> > > > >   - 
> > > > > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F
> > > > > %2Fgithub.com%2Fapache%2Fnifi%2Fpull%2F2163&data=02%7C01%7CMil
> > > > > an.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%
> > > > > 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C63641562634414493
> > > > > 6&sdata=TOF8FHbjissTDtdx33E7xUb4JrHc7R5BV6SUNfTtn%2Fc%3D&reser
> > > > > ved=0 - trivial one-liner
> in
> > > > ListenGRPC
> > > > >   - 
> > > > > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F
> > > > > %2Fgithub.com%2Fapache%2Fnifi%2Fpull%2F1985&data=02%7C01%7CMil
> > > > > an.Chandna%40microsoft.com%7C21581ed9a39548be836e08d500a3e900%
> > > > > 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C63641562634414493
> > > > > 6&sdata=B3hDDiR3W6jcaas7JyoBOr96pVdtnIyeWSWXAF2MvhQ%3D&reserve
> > > > > d=0 - support TLS
> algorithm
> > > > selection via SSLContextService in HandleHTTPRequest
> > > > >
> > > > > Thanks,
> > > > > Mike
> > > > >
> > > > > On Tue, Sep 19, 2017 at 10:46 AM Mark Bean 
> > > > > 
> > > > wrote:
> > > > >
> > > > >> I agree with including only those which can be completed 
> > > > >> quickly
> in
> > > > 1.4.0.
> > > > >> We are anxious for the next release to begin exercising some 
> > > > >> of
> the
> > > > >> new features. IMO it's time to get 1.4.0 out the door.
> > > > >>
> > > > >> Thanks,
> > > > >> Mark
> > > > >>
> > > > >> On Mon, Sep 18, 2017 at 6:59 PM, Jeff  wrote:
>

RE: Want to contribute Jira[NIFI-4360]

[Milan Chandna]

Sorry if you received this mail twice.

Currently I'm working on the feature but while running full build (mvn 
-Pcontrib-check clean install) at NIFI root, as suggested in Contribution 
Guide, the build is failing in other module in Test scope.
I am certain it’s not in my module as it’s coming in master branch as well. And 
I am hitting it consistently always.
Pasted the error stack in the end of mail.

I tried searching about it and figured out there is a similar issue reported 
and it’s still unresolved.
Also have read somewhere that it is OK to skip it.
But that post is little older (around May), so is this still an issue?
So should I just skip this? 
What is the flag to skip only single test and not all?


Running org.wali.TestMinimalLockingWriteAheadLog
Tests run: 12, Failures: 0, Errors: 1, Skipped: 2, Time elapsed: 7.901 sec <<< 
FAILURE! - in org.wali.TestMinimalLockingWriteAheadLog
testRecoverFileThatHasTrailingNULBytesAndTruncation(org.wali.TestMinimalLockingWriteAheadLog)
  Time elapsed: 0.015 sec  <<< ERROR!
java.nio.channels.OverlappingFileLockException: null
at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255)
at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152)
at sun.nio.ch.FileChannelImpl.lock(FileChannelImpl.java:1063)
at java.nio.channels.FileChannel.lock(FileChannel.java:1053)
at 
org.wali.MinimalLockingWriteAheadLog.(MinimalLockingWriteAheadLog.java:187)
at 
org.wali.MinimalLockingWriteAheadLog.(MinimalLockingWriteAheadLog.java:108)
at 
org.wali.TestMinimalLockingWriteAheadLog.testRecoverFileThatHasTrailingNULBytesAndTruncation(TestMinimalLockingWriteAheadLog.java:472)


Results :


Tests in error:
  
TestMinimalLockingWriteAheadLog.testRecoverFileThatHasTrailingNULBytesAndTruncation:472
 ╗ OverlappingFileLock

-Original Message-----
From: Milan Chandna [mailto:milan.chan...@microsoft.com.INVALID] 
Sent: Friday, September 15, 2017 12:45 AM
To: dev@nifi.apache.org
Subject: RE: Want to contribute Jira[NIFI-4360]

Hi Aldrin,

I'm able to assign the issue to myself.
Thanks for your help.
Appreciate the quick replies.

Regards,
Milan.

-Original Message-
From: Aldrin Piri [mailto:aldrinp...@gmail.com]
Sent: Thursday, September 14, 2017 11:16 PM
To: dev 
Subject: Re: Want to contribute Jira[NIFI-4360]

Hi Milan,

I have added your JIRA account as a contributor to the NIFI project. You should 
be able to assign issues to yourself.  Please let us know if there are any 
problems.

On Thu, Sep 14, 2017 at 6:38 AM, Milan Chandna < 
milan.chan...@microsoft.com.invalid> wrote:

> Hi Andre,
>
> NIFI-4360 is about ADLS(Azure Data Lake Store) support whereas
> NIFI-1922 is about WASB(Azure Blob Storage also called as Windows 
> Azure Storage Blob) support.
>
> They both are different kind of repositories, meant for different purposes.
> Also the user set for both technologies might be overlapping but not same.
> So we need to support ADLS as well.
> To know more about the difference, please refer to below mentioned 
> Microsoft official link.
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.
> microsoft.com%2Fen-us%2Fazure%2Fdata-lake-store%2Fdata-&data=02%7C01%7
> CMilan.Chandna%40microsoft.com%7C410163d9c56e4fed023408d4fb98902e%7C72
> f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636410080054933260&sdata=Jh83
> tc6ip3LCEhS5iPwJfYh0uYAiFbN6oUq8EFLetIU%3D&reserved=0
> lake-store-comparison-with-blob-storage
>
> Regards,
> Milan.
>
> -Original Message-
> From: Andre [mailto:andre-li...@fucs.org]
> Sent: Thursday, September 14, 2017 10:52 AM
> To: dev@nifi.apache.org
> Subject: Re: Want to contribute Jira[NIFI-4360]
>
> Milan,
>
> Would you be able to comment on the differences between NIFI-4360 and
> NIFI-1922 ?
>
> Cheers
>
> On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna < 
> milan.chan...@microsoft.com.invalid> wrote:
>
> > Hi,
> >
> > Can admins please make me a contributor so that I can assign 
> > Jira[NIFI-4360]<https://na01.safelinks.protection.outlook.com/?url=h
> > tt
> > ps%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4360&data=02%7C0
> > 1%
> > 7CMilan.Chandna%40microsoft.com%7C3111d807fbd242266c0008d4fb307f28%7
> > C7
> > 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409633098059764&sdata=3
> > mo 1IncHZfHyQ4YjFX70ZbvJsVczIFSHRG3NUUtEuo0%3D&reserved=0> (that I
> > raised) to myself.
> >
> > Regards,
> > Milan.
> >
>

Error while building in TestMinimalLockingWriteAheadLog

[Milan Chandna]

Currently working on one of the feature but while running full build (mvn 
-Pcontrib-check clean install) at NIFI root, as suggested in Contribution 
Guide, the build is failing in other module in Test scope.
I am certain it's not in my module as it's coming in master branch as well. And 
I am hitting it consistently always.
Pasted the error stack in the end of mail.

I tried searching about it and figured out there is a similar issue reported 
and it's still unresolved.
Also have read somewhere that it is OK to skip it.
But that post is little older (around May), so is this still an issue?
So should I just skip this?
What is the flag to skip only single test and not all?


Running org.wali.TestMinimalLockingWriteAheadLog
Tests run: 12, Failures: 0, Errors: 1, Skipped: 2, Time elapsed: 7.901 sec <<< 
FAILURE! - in org.wali.TestMinimalLockingWriteAheadLog
testRecoverFileThatHasTrailingNULBytesAndTruncation(org.wali.TestMinimalLockingWriteAheadLog)
  Time elapsed: 0.015 sec  <<< ERROR!
java.nio.channels.OverlappingFileLockException: null
at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255)
at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152)
at sun.nio.ch.FileChannelImpl.lock(FileChannelImpl.java:1063)
at java.nio.channels.FileChannel.lock(FileChannel.java:1053)
at 
org.wali.MinimalLockingWriteAheadLog.(MinimalLockingWriteAheadLog.java:187)
at 
org.wali.MinimalLockingWriteAheadLog.(MinimalLockingWriteAheadLog.java:108)
at 
org.wali.TestMinimalLockingWriteAheadLog.testRecoverFileThatHasTrailingNULBytesAndTruncation(TestMinimalLockingWriteAheadLog.java:472)


Results :


Tests in error:
  
TestMinimalLockingWriteAheadLog.testRecoverFileThatHasTrailingNULBytesAndTruncation:472
 ╗ OverlappingFileLock

RE: Want to contribute Jira[NIFI-4360]

[Milan Chandna]

Hi Aldrin,

I'm able to assign the issue to myself.
Thanks for your help.
Appreciate the quick replies.

Regards,
Milan.

-Original Message-
From: Aldrin Piri [mailto:aldrinp...@gmail.com] 
Sent: Thursday, September 14, 2017 11:16 PM
To: dev 
Subject: Re: Want to contribute Jira[NIFI-4360]

Hi Milan,

I have added your JIRA account as a contributor to the NIFI project. You should 
be able to assign issues to yourself.  Please let us know if there are any 
problems.

On Thu, Sep 14, 2017 at 6:38 AM, Milan Chandna < 
milan.chan...@microsoft.com.invalid> wrote:

> Hi Andre,
>
> NIFI-4360 is about ADLS(Azure Data Lake Store) support whereas 
> NIFI-1922 is about WASB(Azure Blob Storage also called as Windows 
> Azure Storage Blob) support.
>
> They both are different kind of repositories, meant for different purposes.
> Also the user set for both technologies might be overlapping but not same.
> So we need to support ADLS as well.
> To know more about the difference, please refer to below mentioned 
> Microsoft official link.
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.
> microsoft.com%2Fen-us%2Fazure%2Fdata-lake-store%2Fdata-&data=02%7C01%7
> CMilan.Chandna%40microsoft.com%7C410163d9c56e4fed023408d4fb98902e%7C72
> f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636410080054933260&sdata=Jh83
> tc6ip3LCEhS5iPwJfYh0uYAiFbN6oUq8EFLetIU%3D&reserved=0
> lake-store-comparison-with-blob-storage
>
> Regards,
> Milan.
>
> -Original Message-
> From: Andre [mailto:andre-li...@fucs.org]
> Sent: Thursday, September 14, 2017 10:52 AM
> To: dev@nifi.apache.org
> Subject: Re: Want to contribute Jira[NIFI-4360]
>
> Milan,
>
> Would you be able to comment on the differences between NIFI-4360 and
> NIFI-1922 ?
>
> Cheers
>
> On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna < 
> milan.chan...@microsoft.com.invalid> wrote:
>
> > Hi,
> >
> > Can admins please make me a contributor so that I can assign 
> > Jira[NIFI-4360]<https://na01.safelinks.protection.outlook.com/?url=h
> > tt 
> > ps%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4360&data=02%7C0
> > 1%
> > 7CMilan.Chandna%40microsoft.com%7C3111d807fbd242266c0008d4fb307f28%7
> > C7 
> > 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409633098059764&sdata=3
> > mo 1IncHZfHyQ4YjFX70ZbvJsVczIFSHRG3NUUtEuo0%3D&reserved=0> (that I
> > raised) to myself.
> >
> > Regards,
> > Milan.
> >
>

RE: Want to contribute Jira[NIFI-4360]

[Milan Chandna]

Hi Andre,

NIFI-4360 is about ADLS(Azure Data Lake Store) support whereas NIFI-1922 is 
about WASB(Azure Blob Storage also called as Windows Azure Storage Blob) 
support.

They both are different kind of repositories, meant for different purposes.
Also the user set for both technologies might be overlapping but not same.
So we need to support ADLS as well.
To know more about the difference, please refer to below mentioned Microsoft 
official link.
https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-comparison-with-blob-storage
 

Regards,
Milan.

-Original Message-
From: Andre [mailto:andre-li...@fucs.org] 
Sent: Thursday, September 14, 2017 10:52 AM
To: dev@nifi.apache.org
Subject: Re: Want to contribute Jira[NIFI-4360]

Milan,

Would you be able to comment on the differences between NIFI-4360 and
NIFI-1922 ?

Cheers

On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna < 
milan.chan...@microsoft.com.invalid> wrote:

> Hi,
>
> Can admins please make me a contributor so that I can assign 
> Jira[NIFI-4360]<https://na01.safelinks.protection.outlook.com/?url=htt
> ps%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FNIFI-4360&data=02%7C01%
> 7CMilan.Chandna%40microsoft.com%7C3111d807fbd242266c0008d4fb307f28%7C7
> 2f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409633098059764&sdata=3mo
> 1IncHZfHyQ4YjFX70ZbvJsVczIFSHRG3NUUtEuo0%3D&reserved=0> (that I
> raised) to myself.
>
> Regards,
> Milan.
>

Want to contribute Jira[NIFI-4360]

[Milan Chandna]

Hi,

Can admins please make me a contributor so that I can assign 
Jira[NIFI-4360] (that I 
raised) to myself.

Regards,
Milan.