Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Sean Busbey
+1

On Sat, Apr 9, 2016 at 12:13 AM, Joe Witt  wrote:
> Team,
>
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
>
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
>
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
>
> I am a +1 and am very excited by the progress made thus far!
>
> The vote will be open for 72 hours and be a majority rule vote.
>
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
>
> Thanks
> Joe


Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Skora
PROBLEM SOLVED.  The problem was a mixture of DNS and routing.

For a couple of reasons, including possibly bad router config, each had a
mixture of a bad nameserver configuration or bad routing to the
nameserver.  So, they couldn't resolve their own hostnames to an IP
address.  That's not unique to NiFi or Kafka as a failure mode, but it
might be good to add an upfront test for that to make it clear that other
things will fail if it isn't fixed.

All 3 systems have successfully run the Kafka tests now while connected to
the new router.  OSX ran with JDK1.8.0_77 and the Ubuntu boxes with
JDK1.7.0_80.  I'll run JDK1.8.0_77 on the Ubuntu boxes later.

(FYI, the CentOS box is on a completely different network which is why it
wasn't affected.)

Thank you Oleg and Aldrin for helping track it down!!!


On Sat, Apr 9, 2016 at 5:02 PM, Aldrin Piri  wrote:

> Well that's great to hear, Joe.  Thanks for gathering a bit more info.
>
> We should have tests that are a bit more resilient to varying network
> conditions.  I know we got nabbed by a few when the project first started
> incubation  To that end, if you know of anything specific between the two
> routers so that we can address in the tests and/or potentially in the code
> itself would be supremely helpful.  As another point of data, just ran a
> full build completely network disconnected and things seemed fine with
> Kafka although a few others had issues.  Will create a ticket for those.
>
> A bit bewildering as to how OS X and Ubuntu failed but CentOS was fine.
>
> On Sat, Apr 9, 2016 at 4:32 PM, Joe Skora  wrote:
>
> > Aldrin,
> >
> > Wow, great catch on it being a network issue, the OSX system has
> > successfully finished a "mvn -Pcontrib-check clean install" run!
> >
> > I haven't had any other problems on this router, but something must be
> up.
> > Now the "fun" starts now to figure out what's wrong?  ;-)
> >
> > I'll let you know if it's something interesting or just a PEBKAC error.
> >
> > Joe
> >
> >
> >
> >
> > On Sat, Apr 9, 2016 at 3:39 PM, Joe Skora  wrote:
> >
> > > Aldrin,
> > >
> > > Yes same network, nothing novel that I know of, they all have internet
> > > access and I've disabled firewalls for comparison with no affect.  This
> > is
> > > a new router, so I will move one to the old router and see if that
> makes
> > a
> > > difference.
> > >
> > > The validate/valudate mismatch is a fat fingering error on my part, I
> > > copied and pasted the stacktrace but I typed the details manually into
> > the
> > > breakdown by system and JVM.
> > >
> > > The source start point is the "nifi-0.6.1-source-release.zip" file,
> after
> > > checksum validation and unzipping.
> > >
> > > I let you know if network makes a difference.
> > >
> > > Joe
> > >
> > >
> > >
> > > On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri 
> > wrote:
> > >
> > >> Joe,
> > >>
> > >> Are these all running on the same network? If so, anything novel or
> > >> different about it?
> > >>
> > >> Also, a I assume these are remnants of debugging, but noticed some
> > >> differences in terms of the source at the tagged RC and your
> > stacktraces.
> > >>
> > >> TestGetHTTP, for instance, only has 431 lines and the test listed
> > >> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not
> > seem
> > >> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2
> > does.
> > >>
> > >> Thanks for the detailed report and matrix of JDKs and operating
> systems.
> > >>
> > >> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:
> > >>
> > >> > -1 (non-binding)
> > >> >
> > >> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> > >> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and
> > >> sample
> > >> > results are included below.
> > >> >
> > >> > The tests appear to handle ConsumerTimeoutException when it is
> > expected,
> > >> > but the very first call to ConsumerIterator.next() appears to fail
> and
> > >> that
> > >> > is unchecked.
> > >> >
> > >> > Note: I also think KafkaPublisherTest should use sample text that is
> > not
> > >> > copyrighted or possibly considered offensive.
> > >> >
> > >> > * builds and tests ok on Centos 6.7 with Java 7
> > >> >
> > >> > * tests fail on 3 systems in KafkaPublisherTest
> > >> >
> > >> >  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
> > >> >   * Maven 3.3.9
> > >> >   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
> > >> others
> > >> > fail with "java.net.SocketException: Invalid argument"
> > >> > in Apache HTTP
> > SessionInputBufferImpl.streamRead():139.
> > >> >   * JDK1.7.0_80
> > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and
> others
> > >> > error out with "kafka.consumer.ConsumerTimeoutException".
> > >> >   * JDK1.8.0_77
> > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 

[GitHub] nifi pull request: NIFI-1748 removed un-used test data

2016-04-09 Thread olegz
GitHub user olegz opened a pull request:

https://github.com/apache/nifi/pull/341

NIFI-1748 removed un-used test data



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/olegz/nifi NIFI-1748

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/341.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #341


commit 2581f7162f01c09ffd55d219f2af7f3b781dd6eb
Author: Oleg Zhurakousky 
Date:   2016-04-09T21:24:37Z

NIFI-1748 removed un-used test data




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Aldrin Piri
Well that's great to hear, Joe.  Thanks for gathering a bit more info.

We should have tests that are a bit more resilient to varying network
conditions.  I know we got nabbed by a few when the project first started
incubation  To that end, if you know of anything specific between the two
routers so that we can address in the tests and/or potentially in the code
itself would be supremely helpful.  As another point of data, just ran a
full build completely network disconnected and things seemed fine with
Kafka although a few others had issues.  Will create a ticket for those.

A bit bewildering as to how OS X and Ubuntu failed but CentOS was fine.

On Sat, Apr 9, 2016 at 4:32 PM, Joe Skora  wrote:

> Aldrin,
>
> Wow, great catch on it being a network issue, the OSX system has
> successfully finished a "mvn -Pcontrib-check clean install" run!
>
> I haven't had any other problems on this router, but something must be up.
> Now the "fun" starts now to figure out what's wrong?  ;-)
>
> I'll let you know if it's something interesting or just a PEBKAC error.
>
> Joe
>
>
>
>
> On Sat, Apr 9, 2016 at 3:39 PM, Joe Skora  wrote:
>
> > Aldrin,
> >
> > Yes same network, nothing novel that I know of, they all have internet
> > access and I've disabled firewalls for comparison with no affect.  This
> is
> > a new router, so I will move one to the old router and see if that makes
> a
> > difference.
> >
> > The validate/valudate mismatch is a fat fingering error on my part, I
> > copied and pasted the stacktrace but I typed the details manually into
> the
> > breakdown by system and JVM.
> >
> > The source start point is the "nifi-0.6.1-source-release.zip" file, after
> > checksum validation and unzipping.
> >
> > I let you know if network makes a difference.
> >
> > Joe
> >
> >
> >
> > On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri 
> wrote:
> >
> >> Joe,
> >>
> >> Are these all running on the same network? If so, anything novel or
> >> different about it?
> >>
> >> Also, a I assume these are remnants of debugging, but noticed some
> >> differences in terms of the source at the tagged RC and your
> stacktraces.
> >>
> >> TestGetHTTP, for instance, only has 431 lines and the test listed
> >> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not
> seem
> >> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2
> does.
> >>
> >> Thanks for the detailed report and matrix of JDKs and operating systems.
> >>
> >> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:
> >>
> >> > -1 (non-binding)
> >> >
> >> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> >> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and
> >> sample
> >> > results are included below.
> >> >
> >> > The tests appear to handle ConsumerTimeoutException when it is
> expected,
> >> > but the very first call to ConsumerIterator.next() appears to fail and
> >> that
> >> > is unchecked.
> >> >
> >> > Note: I also think KafkaPublisherTest should use sample text that is
> not
> >> > copyrighted or possibly considered offensive.
> >> >
> >> > * builds and tests ok on Centos 6.7 with Java 7
> >> >
> >> > * tests fail on 3 systems in KafkaPublisherTest
> >> >
> >> >  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
> >> >   * Maven 3.3.9
> >> >   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
> >> others
> >> > fail with "java.net.SocketException: Invalid argument"
> >> > in Apache HTTP
> SessionInputBufferImpl.streamRead():139.
> >> >   * JDK1.7.0_80
> >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> >> > error out with "kafka.consumer.ConsumerTimeoutException".
> >> >   * JDK1.8.0_77
> >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> >> > error out with "kafka.consumer.ConsumerTimeoutException".
> >> >
> >> >  * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
> >> >   * Maven 3.3.3
> >> >   * JDK1.7.0_80
> >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> >> test
> >> > error out with "kafka.consumer.ConsumerTimeoutException".
> >> >
> >> >  * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
> >> >   * JDK1.7.0_80
> >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> >> test
> >> > error out with "kafka.consumer.ConsumerTimeoutException".
> >> >   * JDK1.8.0_77
> >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> >> test
> >> > error out with "kafka.consumer.ConsumerTimeoutException".
> >> >
> >> >
> >> > ---
> >> >  T E S T S
> >> > ---
> >> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> >> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed:
> 

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Oleg Zhurakousky
Perfect

I was just replying too you again ;). Indeed ‘test’ was not used and I already 
commented to that effect in JIRA and removed.
Yes, I was wondering why they fail as this is the first time someone reported 
KafkaPublisherTest failures, so kind of curious, so please feed all the info 
you can get if they fail again.

Cheers
Oleg

> On Apr 9, 2016, at 4:45 PM, Joe Skora  wrote:
> 
> Oleg,
> 
> I'm not familiar enough with Kafka to know what the tests need, but looking
> at the test source now I don't think the "String test" on line 70 is used
> anywhere, so I think you can just remove it.
> 
> The failures where pretty much the same on all 3 systems.  But based on
> Aldrin's question about the network I moved the OS X to a different network
> and it passed.  I'm running one of the Ubuntu boxes now.
> 
> Thanks,
> Joe
> 
> On Sat, Apr 9, 2016 at 4:30 PM, Oleg Zhurakousky <
> ozhurakou...@hortonworks.com> wrote:
> 
>> Joe
>> 
>> Thanks for pointing that out. I’ll remove the quote from CNN article, just
>> used it as sample text. Do you see any other issue with sample data?
>> Also, which systems did you observe failures described below?
>> 
>> Cheers
>> Oleg
>> 
>>> On Apr 9, 2016, at 2:47 PM, Joe Skora  wrote:
>>> 
>>> -1 (non-binding)
>>> 
>>> Builds and checkouts out ok, but 3 of 4 systems I tried fail in
>>> KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
>>> results are included below.
>>> 
>>> The tests appear to handle ConsumerTimeoutException when it is expected,
>>> but the very first call to ConsumerIterator.next() appears to fail and
>> that
>>> is unchecked.
>>> 
>>> Note: I also think KafkaPublisherTest should use sample text that is not
>>> copyrighted or possibly considered offensive.
>>> 
>>> * builds and tests ok on Centos 6.7 with Java 7
>>> 
>>> * tests fail on 3 systems in KafkaPublisherTest
>>> 
>>>* OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
>>> * Maven 3.3.9
>>> * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
>> others
>>> fail with "java.net.SocketException: Invalid argument"
>>>   in Apache HTTP SessionInputBufferImpl.streamRead():139.
>>> * JDK1.7.0_80
>>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
>>> error out with "kafka.consumer.ConsumerTimeoutException".
>>> * JDK1.8.0_77
>>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
>>> error out with "kafka.consumer.ConsumerTimeoutException".
>>> 
>>>* Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
>>> * Maven 3.3.3
>>> * JDK1.7.0_80
>>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>>> error out with "kafka.consumer.ConsumerTimeoutException".
>>> 
>>>* Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
>>> * JDK1.7.0_80
>>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>>> error out with "kafka.consumer.ConsumerTimeoutException".
>>> * JDK1.8.0_77
>>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>>> error out with "kafka.consumer.ConsumerTimeoutException".
>>> 
>>> 
>>> ---
>>> T E S T S
>>> ---
>>> Running org.apache.nifi.processors.kafka.KafkaPublisherTest
>>> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885
>> sec
>>> <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
>>> 
>> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
>>> Time elapsed: 185.158 sec  <<< ERROR!
>>> kafka.consumer.ConsumerTimeoutException: null
>>>   at
>>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>>>   at
>>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>>>   at
>>> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>>>   at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>>>   at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>>>   at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>>>   at
>>> 
>> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
>>> 
>>> 
>> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
>>> Time elapsed: 245.077 sec  <<< ERROR!
>>> kafka.consumer.ConsumerTimeoutException: null
>>>   at
>>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>>>   at
>>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>>>   at
>>> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>>>   at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>>>   at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>>> 

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Skora
Oleg,

I'm not familiar enough with Kafka to know what the tests need, but looking
at the test source now I don't think the "String test" on line 70 is used
anywhere, so I think you can just remove it.

The failures where pretty much the same on all 3 systems.  But based on
Aldrin's question about the network I moved the OS X to a different network
and it passed.  I'm running one of the Ubuntu boxes now.

Thanks,
Joe

On Sat, Apr 9, 2016 at 4:30 PM, Oleg Zhurakousky <
ozhurakou...@hortonworks.com> wrote:

> Joe
>
> Thanks for pointing that out. I’ll remove the quote from CNN article, just
> used it as sample text. Do you see any other issue with sample data?
> Also, which systems did you observe failures described below?
>
> Cheers
> Oleg
>
> > On Apr 9, 2016, at 2:47 PM, Joe Skora  wrote:
> >
> > -1 (non-binding)
> >
> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
> > results are included below.
> >
> > The tests appear to handle ConsumerTimeoutException when it is expected,
> > but the very first call to ConsumerIterator.next() appears to fail and
> that
> > is unchecked.
> >
> > Note: I also think KafkaPublisherTest should use sample text that is not
> > copyrighted or possibly considered offensive.
> >
> > * builds and tests ok on Centos 6.7 with Java 7
> >
> > * tests fail on 3 systems in KafkaPublisherTest
> >
> > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
> >  * Maven 3.3.9
> >  * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
> others
> > fail with "java.net.SocketException: Invalid argument"
> >in Apache HTTP SessionInputBufferImpl.streamRead():139.
> >  * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >  * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
> >  * Maven 3.3.3
> >  * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
> >  * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >  * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >
> > ---
> > T E S T S
> > ---
> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885
> sec
> > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
> >
> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 185.158 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> >at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> >at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> >at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> >at
> >
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
> >
> >
> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 245.077 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> >at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> >at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> >at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> >at
> >
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114)
> >
> >
> validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 125.07 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> >at
> > 

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Skora
Aldrin,

Wow, great catch on it being a network issue, the OSX system has
successfully finished a "mvn -Pcontrib-check clean install" run!

I haven't had any other problems on this router, but something must be up.
Now the "fun" starts now to figure out what's wrong?  ;-)

I'll let you know if it's something interesting or just a PEBKAC error.

Joe




On Sat, Apr 9, 2016 at 3:39 PM, Joe Skora  wrote:

> Aldrin,
>
> Yes same network, nothing novel that I know of, they all have internet
> access and I've disabled firewalls for comparison with no affect.  This is
> a new router, so I will move one to the old router and see if that makes a
> difference.
>
> The validate/valudate mismatch is a fat fingering error on my part, I
> copied and pasted the stacktrace but I typed the details manually into the
> breakdown by system and JVM.
>
> The source start point is the "nifi-0.6.1-source-release.zip" file, after
> checksum validation and unzipping.
>
> I let you know if network makes a difference.
>
> Joe
>
>
>
> On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri  wrote:
>
>> Joe,
>>
>> Are these all running on the same network? If so, anything novel or
>> different about it?
>>
>> Also, a I assume these are remnants of debugging, but noticed some
>> differences in terms of the source at the tagged RC and your stacktraces.
>>
>> TestGetHTTP, for instance, only has 431 lines and the test listed
>> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem
>> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does.
>>
>> Thanks for the detailed report and matrix of JDKs and operating systems.
>>
>> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:
>>
>> > -1 (non-binding)
>> >
>> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
>> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and
>> sample
>> > results are included below.
>> >
>> > The tests appear to handle ConsumerTimeoutException when it is expected,
>> > but the very first call to ConsumerIterator.next() appears to fail and
>> that
>> > is unchecked.
>> >
>> > Note: I also think KafkaPublisherTest should use sample text that is not
>> > copyrighted or possibly considered offensive.
>> >
>> > * builds and tests ok on Centos 6.7 with Java 7
>> >
>> > * tests fail on 3 systems in KafkaPublisherTest
>> >
>> >  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
>> >   * Maven 3.3.9
>> >   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
>> others
>> > fail with "java.net.SocketException: Invalid argument"
>> > in Apache HTTP SessionInputBufferImpl.streamRead():139.
>> >   * JDK1.7.0_80
>> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
>> > error out with "kafka.consumer.ConsumerTimeoutException".
>> >   * JDK1.8.0_77
>> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
>> > error out with "kafka.consumer.ConsumerTimeoutException".
>> >
>> >  * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
>> >   * Maven 3.3.3
>> >   * JDK1.7.0_80
>> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>> > error out with "kafka.consumer.ConsumerTimeoutException".
>> >
>> >  * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
>> >   * JDK1.7.0_80
>> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>> > error out with "kafka.consumer.ConsumerTimeoutException".
>> >   * JDK1.8.0_77
>> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
>> test
>> > error out with "kafka.consumer.ConsumerTimeoutException".
>> >
>> >
>> > ---
>> >  T E S T S
>> > ---
>> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest
>> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885
>> sec
>> > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
>> >
>> >
>> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
>> > Time elapsed: 185.158 sec  <<< ERROR!
>> > kafka.consumer.ConsumerTimeoutException: null
>> > at
>> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>> > at
>> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>> > at
>> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>> > at
>> kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>> > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>> > at
>> kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>> > at
>> >
>> >
>> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
>> >
>> >
>> >
>> 

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Oleg Zhurakousky
Joe

Thanks for pointing that out. I’ll remove the quote from CNN article, just used 
it as sample text. Do you see any other issue with sample data?
Also, which systems did you observe failures described below? 

Cheers
Oleg

> On Apr 9, 2016, at 2:47 PM, Joe Skora  wrote:
> 
> -1 (non-binding)
> 
> Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
> results are included below.
> 
> The tests appear to handle ConsumerTimeoutException when it is expected,
> but the very first call to ConsumerIterator.next() appears to fail and that
> is unchecked.
> 
> Note: I also think KafkaPublisherTest should use sample text that is not
> copyrighted or possibly considered offensive.
> 
> * builds and tests ok on Centos 6.7 with Java 7
> 
> * tests fail on 3 systems in KafkaPublisherTest
> 
> * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
>  * Maven 3.3.9
>  * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others
> fail with "java.net.SocketException: Invalid argument"
>in Apache HTTP SessionInputBufferImpl.streamRead():139.
>  * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> error out with "kafka.consumer.ConsumerTimeoutException".
>  * JDK1.8.0_77
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> error out with "kafka.consumer.ConsumerTimeoutException".
> 
> * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
>  * Maven 3.3.3
>  * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
> 
> * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
>  * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
>  * JDK1.8.0_77
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
> 
> 
> ---
> T E S T S
> ---
> Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec
> <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 185.158 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>at
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
> 
> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 245.077 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>at
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114)
> 
> validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 125.07 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
>at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
>at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
>at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
>at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
>at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>at
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulReSendOfFailedSegments(KafkaPublisherTest.java:167)
> 
> validateWithMultiByteCharacters(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 65.09 sec  <<< ERROR!
> 

[GitHub] nifi pull request: NIFI-1738 - Repair logger names for ControllerS...

2016-04-09 Thread jvwing
Github user jvwing commented on the pull request:

https://github.com/apache/nifi/pull/334#issuecomment-207841740
  
@Hejki, this looks like a solid fix to me.  One thing I suggest you add is 
some unit tests, which I missed when I "fixed" this a couple months ago.  If 
that sounds like overkill for such a simple change, well... I use to agree :).

I made some [sample tests to verify your 
fix](https://github.com/jvwing/nifi/commit/004ca21e50dd4f4c98923dbb9a49528ad8544179),
 you are welcome to use them.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Skora
Aldrin,

Yes same network, nothing novel that I know of, they all have internet
access and I've disabled firewalls for comparison with no affect.  This is
a new router, so I will move one to the old router and see if that makes a
difference.

The validate/valudate mismatch is a fat fingering error on my part, I
copied and pasted the stacktrace but I typed the details manually into the
breakdown by system and JVM.

The source start point is the "nifi-0.6.1-source-release.zip" file, after
checksum validation and unzipping.

I let you know if network makes a difference.

Joe



On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri  wrote:

> Joe,
>
> Are these all running on the same network? If so, anything novel or
> different about it?
>
> Also, a I assume these are remnants of debugging, but noticed some
> differences in terms of the source at the tagged RC and your stacktraces.
>
> TestGetHTTP, for instance, only has 431 lines and the test listed
> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem
> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does.
>
> Thanks for the detailed report and matrix of JDKs and operating systems.
>
> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:
>
> > -1 (non-binding)
> >
> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
> > results are included below.
> >
> > The tests appear to handle ConsumerTimeoutException when it is expected,
> > but the very first call to ConsumerIterator.next() appears to fail and
> that
> > is unchecked.
> >
> > Note: I also think KafkaPublisherTest should use sample text that is not
> > copyrighted or possibly considered offensive.
> >
> > * builds and tests ok on Centos 6.7 with Java 7
> >
> > * tests fail on 3 systems in KafkaPublisherTest
> >
> >  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
> >   * Maven 3.3.9
> >   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
> others
> > fail with "java.net.SocketException: Invalid argument"
> > in Apache HTTP SessionInputBufferImpl.streamRead():139.
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >   * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >  * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
> >   * Maven 3.3.3
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >  * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >   * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
> test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >
> > ---
> >  T E S T S
> > ---
> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885
> sec
> > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
> >
> >
> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 185.158 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> > at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> > at
> kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> > at
> kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> > at
> >
> >
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
> >
> >
> >
> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 245.077 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> > at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> > at
> kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> > at 

[CANCEL][VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Witt
The vote for nifi 0.6.1 is cancelled.

While test issues are one thing copyright issues are another.  I looked at
the test Joe highlighted and believe we must remove both the quote and the
apparent news article.  Will address and send another rc asap.  If someone
could tackle the test failing tests on the highlighted platform that would
be a nice step as well.

Thanks
Joe

On Apr 9, 2016 3:27 PM, "Aldrin Piri"  wrote:

>

> Joe,
>
> Are these all running on the same network? If so, anything novel or
> different about it?
>
> Also, a I assume these are remnants of debugging, but noticed some
> differences in terms of the source at the tagged RC and your stacktraces.
>
> TestGetHTTP, for instance, only has 431 lines and the test listed
> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem
> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does.
>
> Thanks for the detailed report and matrix of JDKs and operating systems.
>
> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:
>
> > -1 (non-binding)
> >
> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> > KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and
sample
> > results are included below.
> >
> > The tests appear to handle ConsumerTimeoutException when it is expected,
> > but the very first call to ConsumerIterator.next() appears to fail and
that
> > is unchecked.
> >
> > Note: I also think KafkaPublisherTest should use sample text that is not
> > copyrighted or possibly considered offensive.
> >
> > * builds and tests ok on Centos 6.7 with Java 7
> >
> > * tests fail on 3 systems in KafkaPublisherTest
> >
> >  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
> >   * Maven 3.3.9
> >   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and
others
> > fail with "java.net.SocketException: Invalid argument"
> > in Apache HTTP SessionInputBufferImpl.streamRead():139.
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >   * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >  * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
> >   * Maven 3.3.3
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >  * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
> >   * JDK1.7.0_80
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >   * JDK1.8.0_77
> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other
test
> > error out with "kafka.consumer.ConsumerTimeoutException".
> >
> >
> > ---
> >  T E S T S
> > ---
> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885
sec
> > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
> >
> >
validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 185.158 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> > at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> > at
kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> > at
kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> > at
> >
> >
org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
> >
> >
> >
validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> > Time elapsed: 245.077 sec  <<< ERROR!
> > kafka.consumer.ConsumerTimeoutException: null
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> > at
> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> > at
> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> > at
kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> > at
kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> > at
> >
> >

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Aldrin Piri
Joe,

Are these all running on the same network? If so, anything novel or
different about it?

Also, a I assume these are remnants of debugging, but noticed some
differences in terms of the source at the tagged RC and your stacktraces.

TestGetHTTP, for instance, only has 431 lines and the test listed
"KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem
to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does.

Thanks for the detailed report and matrix of JDKs and operating systems.

On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora  wrote:

> -1 (non-binding)
>
> Builds and checkouts out ok, but 3 of 4 systems I tried fail in
> KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
> results are included below.
>
> The tests appear to handle ConsumerTimeoutException when it is expected,
> but the very first call to ConsumerIterator.next() appears to fail and that
> is unchecked.
>
> Note: I also think KafkaPublisherTest should use sample text that is not
> copyrighted or possibly considered offensive.
>
> * builds and tests ok on Centos 6.7 with Java 7
>
> * tests fail on 3 systems in KafkaPublisherTest
>
>  * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
>   * Maven 3.3.9
>   * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others
> fail with "java.net.SocketException: Invalid argument"
> in Apache HTTP SessionInputBufferImpl.streamRead():139.
>   * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> error out with "kafka.consumer.ConsumerTimeoutException".
>   * JDK1.8.0_77
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
> error out with "kafka.consumer.ConsumerTimeoutException".
>
>  * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
>   * Maven 3.3.3
>   * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
>
>  * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
>   * JDK1.7.0_80
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
>   * JDK1.8.0_77
> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
> error out with "kafka.consumer.ConsumerTimeoutException".
>
>
> ---
>  T E S T S
> ---
> Running org.apache.nifi.processors.kafka.KafkaPublisherTest
> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec
> <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
>
> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 185.158 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> at
>
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)
>
>
> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 245.077 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
> at
>
> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114)
>
>
> validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest)
> Time elapsed: 125.07 sec  <<< ERROR!
> kafka.consumer.ConsumerTimeoutException: null
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
> at
> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
> at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
> at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
> at 

[GitHub] nifi pull request: NIFI-1747 add maven-war-plugin to create jar as...

2016-04-09 Thread jdye64
GitHub user jdye64 opened a pull request:

https://github.com/apache/nifi/pull/340

NIFI-1747 add maven-war-plugin to create jar as part of the existing …

…nifi-web-api build process

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jdye64/nifi NIFI-1747

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/340.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #340


commit 77047b53707cabbc6797397e39557eebf5958e32
Author: Jeremy Dyer 
Date:   2016-04-09T19:24:54Z

NIFI-1747 add maven-war-plugin to create jar as part of the existing 
nifi-web-api build process




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Joe Skora
-1 (non-binding)

Builds and checkouts out ok, but 3 of 4 systems I tried fail in
KafkaPublisherTest unit tests with Java 7 and Java 8.  Details and sample
results are included below.

The tests appear to handle ConsumerTimeoutException when it is expected,
but the very first call to ConsumerIterator.next() appears to fail and that
is unchecked.

Note: I also think KafkaPublisherTest should use sample text that is not
copyrighted or possibly considered offensive.

* builds and tests ok on Centos 6.7 with Java 7

* tests fail on 3 systems in KafkaPublisherTest

 * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB
  * Maven 3.3.9
  * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others
fail with "java.net.SocketException: Invalid argument"
in Apache HTTP SessionInputBufferImpl.streamRead():139.
  * JDK1.7.0_80
KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
error out with "kafka.consumer.ConsumerTimeoutException".
  * JDK1.8.0_77
KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others
error out with "kafka.consumer.ConsumerTimeoutException".

 * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB
  * Maven 3.3.3
  * JDK1.7.0_80
KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
error out with "kafka.consumer.ConsumerTimeoutException".

 * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB
  * JDK1.7.0_80
KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
error out with "kafka.consumer.ConsumerTimeoutException".
  * JDK1.8.0_77
KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test
error out with "kafka.consumer.ConsumerTimeoutException".


---
 T E S T S
---
Running org.apache.nifi.processors.kafka.KafkaPublisherTest
Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec
<<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest
validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest)
Time elapsed: 185.158 sec  <<< ERROR!
kafka.consumer.ConsumerTimeoutException: null
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at
kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
at
org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140)

validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest)
Time elapsed: 245.077 sec  <<< ERROR!
kafka.consumer.ConsumerTimeoutException: null
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at
kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
at
org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114)

validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest)
Time elapsed: 125.07 sec  <<< ERROR!
kafka.consumer.ConsumerTimeoutException: null
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at
kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
at
org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulReSendOfFailedSegments(KafkaPublisherTest.java:167)

validateWithMultiByteCharacters(org.apache.nifi.processors.kafka.KafkaPublisherTest)
Time elapsed: 65.09 sec  <<< ERROR!
kafka.consumer.ConsumerTimeoutException: null
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69)
at
kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33)
at
kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58)
at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38)
at 

Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Andrew Lim
+1


> On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
> 
> Team,
> 
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
> 
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
> 
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> 
> I am a +1 and am very excited by the progress made thus far!
> 
> The vote will be open for 72 hours and be a majority rule vote.
> 
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
> 
> Thanks
> Joe



Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Joe Percivall
+1
 - - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com




On Saturday, April 9, 2016 10:40 AM, Suneel Marthi  wrote:
+1


On Sat, Apr 9, 2016 at 9:36 AM, Toivo Adams  wrote:

> +1
>
>
>
> --
> View this message in context:
> http://apache-nifi-developer-list.39713.n7.nabble.com/VOTE-Establish-Apache-MiNiFi-a-subproject-of-Apache-NIFi-tp8930p8947.html
> Sent from the Apache NiFi Developer List mailing list archive at
> Nabble.com.
>


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Suneel Marthi
+1

On Sat, Apr 9, 2016 at 9:36 AM, Toivo Adams  wrote:

> +1
>
>
>
> --
> View this message in context:
> http://apache-nifi-developer-list.39713.n7.nabble.com/VOTE-Establish-Apache-MiNiFi-a-subproject-of-Apache-NIFi-tp8930p8947.html
> Sent from the Apache NiFi Developer List mailing list archive at
> Nabble.com.
>


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Brandon DeVries
+1
On Sat, Apr 9, 2016 at 8:17 AM Mark Payne  wrote:

> +1
>
> Sent from my iPhone
>
> > On Apr 9, 2016, at 7:51 AM, Matt Gilman  wrote:
> >
> > +1
> >
> > Sent from my iPhone
> >
> >> On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
> >>
> >> Team,
> >>
> >> Following a solid discussion [1] in early January regarding
> >> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> >> formal vote to record this important community decision and
> >> established consensus.
> >>
> >> Through lazy consensus [2] the repositories were setup for source,
> >> JIRA, and git-hub mirror [3].  There has since been solid progress and
> >> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> >> been documented on Confluence/Wiki [4].  It was also reported in our
> >> April 2016 board report that we have established MiNiFi based on these
> >> things.  But, lets make sure we get this right.
> >>
> >> [1] https://s.apache.org/czuz
> >> [2] https://s.apache.org/Ucxs
> >> [3]
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> >> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> >>
> >> I am a +1 and am very excited by the progress made thus far!
> >>
> >> The vote will be open for 72 hours and be a majority rule vote.
> >>
> >> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> >> [ ]   0 Do not care
> >> [ ]  -1 Do not establish Apache MiNiFi
> >>
> >> Thanks
> >> Joe
>


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Mark Payne
+1

Sent from my iPhone

> On Apr 9, 2016, at 7:51 AM, Matt Gilman  wrote:
> 
> +1
> 
> Sent from my iPhone
> 
>> On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
>> 
>> Team,
>> 
>> Following a solid discussion [1] in early January regarding
>> establishment of MiNiFi as a subproject of NiFi I'd like to call a
>> formal vote to record this important community decision and
>> established consensus.
>> 
>> Through lazy consensus [2] the repositories were setup for source,
>> JIRA, and git-hub mirror [3].  There has since been solid progress and
>> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
>> been documented on Confluence/Wiki [4].  It was also reported in our
>> April 2016 board report that we have established MiNiFi based on these
>> things.  But, lets make sure we get this right.
>> 
>> [1] https://s.apache.org/czuz
>> [2] https://s.apache.org/Ucxs
>> [3] 
>> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
>> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
>> 
>> I am a +1 and am very excited by the progress made thus far!
>> 
>> The vote will be open for 72 hours and be a majority rule vote.
>> 
>> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
>> [ ]   0 Do not care
>> [ ]  -1 Do not establish Apache MiNiFi
>> 
>> Thanks
>> Joe


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Matt Gilman
+1

Sent from my iPhone

> On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
> 
> Team,
> 
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
> 
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
> 
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> 
> I am a +1 and am very excited by the progress made thus far!
> 
> The vote will be open for 72 hours and be a majority rule vote.
> 
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
> 
> Thanks
> Joe


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Tony Kurc
+1

On Sat, Apr 9, 2016 at 7:08 AM, Matt Burgess  wrote:

> +1
>
> > On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
> >
> > Team,
> >
> > Following a solid discussion [1] in early January regarding
> > establishment of MiNiFi as a subproject of NiFi I'd like to call a
> > formal vote to record this important community decision and
> > established consensus.
> >
> > Through lazy consensus [2] the repositories were setup for source,
> > JIRA, and git-hub mirror [3].  There has since been solid progress and
> > discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> > been documented on Confluence/Wiki [4].  It was also reported in our
> > April 2016 board report that we have established MiNiFi based on these
> > things.  But, lets make sure we get this right.
> >
> > [1] https://s.apache.org/czuz
> > [2] https://s.apache.org/Ucxs
> > [3]
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> >
> > I am a +1 and am very excited by the progress made thus far!
> >
> > The vote will be open for 72 hours and be a majority rule vote.
> >
> > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> > [ ]   0 Do not care
> > [ ]  -1 Do not establish Apache MiNiFi
> >
> > Thanks
> > Joe
>


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Matt Burgess
+1

> On Apr 9, 2016, at 1:13 AM, Joe Witt  wrote:
> 
> Team,
> 
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
> 
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
> 
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> 
> I am a +1 and am very excited by the progress made thus far!
> 
> The vote will be open for 72 hours and be a majority rule vote.
> 
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
> 
> Thanks
> Joe


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Rob Moran
+1

Rob

On Sat, Apr 9, 2016 at 3:48 AM, Jennifer Barnabee <
jennifer.barna...@gmail.com> wrote:

> +1
>
> On Sat, Apr 9, 2016 at 1:13 AM, Joe Witt  wrote:
>
> > Team,
> >
> > Following a solid discussion [1] in early January regarding
> > establishment of MiNiFi as a subproject of NiFi I'd like to call a
> > formal vote to record this important community decision and
> > established consensus.
> >
> > Through lazy consensus [2] the repositories were setup for source,
> > JIRA, and git-hub mirror [3].  There has since been solid progress and
> > discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> > been documented on Confluence/Wiki [4].  It was also reported in our
> > April 2016 board report that we have established MiNiFi based on these
> > things.  But, lets make sure we get this right.
> >
> > [1] https://s.apache.org/czuz
> > [2] https://s.apache.org/Ucxs
> > [3]
> >
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> >
> > I am a +1 and am very excited by the progress made thus far!
> >
> > The vote will be open for 72 hours and be a majority rule vote.
> >
> > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> > [ ]   0 Do not care
> > [ ]  -1 Do not establish Apache MiNiFi
> >
> > Thanks
> > Joe
> >
>


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Jennifer Barnabee
+1

On Sat, Apr 9, 2016 at 1:13 AM, Joe Witt  wrote:

> Team,
>
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
>
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
>
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3]
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
>
> I am a +1 and am very excited by the progress made thus far!
>
> The vote will be open for 72 hours and be a majority rule vote.
>
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
>
> Thanks
> Joe
>


Re: Initial Commit of New In-Depth Developer Doc

2016-04-09 Thread Pierre Villard
Great addition in the documentation. Very clear and useful.

Thanks,
Pierre
Le 8 avr. 2016 8:12 PM, "Joe Percivall"  a
écrit :

Hello Dev,

I recently finished up an initial version of a new developer doc "Apache
NiFi In Depth". It goes in depth on the design decisions, the Repos, how a
FlowFile gets processed and more. It assumes the reader has read the other
documentation prior to reading.

To complete this document I was able to talk to the people who wrote much
of the underlying implementations (shout out to Mark and Aldrin) and format
the information as a new ascii document to be bundled with NiFi. If anyone
wants a sneak peak or to provide feedback the ticket is NIFI-1028[1].

[1] https://issues.apache.org/jira/browse/NIFI-1028

Looking forward to getting some feedback,
Joe
- - - - - -
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Pierre Villard
+1

Pierre
Le 9 avr. 2016 8:16 AM, "Andre"  a écrit :

> +1
>
> Had a look at the Community Driven Requirements and I must say they match
> my needs like a glove! :-)
>
>
>
> On Sat, Apr 9, 2016 at 3:13 PM, Joe Witt  wrote:
>
> > Team,
> >
> > Following a solid discussion [1] in early January regarding
> > establishment of MiNiFi as a subproject of NiFi I'd like to call a
> > formal vote to record this important community decision and
> > established consensus.
> >
> > Through lazy consensus [2] the repositories were setup for source,
> > JIRA, and git-hub mirror [3].  There has since been solid progress and
> > discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> > been documented on Confluence/Wiki [4].  It was also reported in our
> > April 2016 board report that we have established MiNiFi based on these
> > things.  But, lets make sure we get this right.
> >
> > [1] https://s.apache.org/czuz
> > [2] https://s.apache.org/Ucxs
> > [3]
> >
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
> >
> > I am a +1 and am very excited by the progress made thus far!
> >
> > The vote will be open for 72 hours and be a majority rule vote.
> >
> > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> > [ ]   0 Do not care
> > [ ]  -1 Do not establish Apache MiNiFi
> >
> > Thanks
> > Joe
> >
>


[GitHub] nifi pull request: NIFI-1028 initial commit of NiFi In Depth docum...

2016-04-09 Thread trixpan
Github user trixpan commented on the pull request:

https://github.com/apache/nifi/pull/339#issuecomment-207723976
  
@JPercivall 

great commit. Very good to have a clear and concise source to understand 
what happens under the nice and friendly web UI. :-)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi

2016-04-09 Thread Andre
+1

Had a look at the Community Driven Requirements and I must say they match
my needs like a glove! :-)



On Sat, Apr 9, 2016 at 3:13 PM, Joe Witt  wrote:

> Team,
>
> Following a solid discussion [1] in early January regarding
> establishment of MiNiFi as a subproject of NiFi I'd like to call a
> formal vote to record this important community decision and
> established consensus.
>
> Through lazy consensus [2] the repositories were setup for source,
> JIRA, and git-hub mirror [3].  There has since been solid progress and
> discussion on a number of MINIFI JIRAs.  The core goals of MiNiFi have
> been documented on Confluence/Wiki [4].  It was also reported in our
> April 2016 board report that we have established MiNiFi based on these
> things.  But, lets make sure we get this right.
>
> [1] https://s.apache.org/czuz
> [2] https://s.apache.org/Ucxs
> [3]
> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure
> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi
>
> I am a +1 and am very excited by the progress made thus far!
>
> The vote will be open for 72 hours and be a majority rule vote.
>
> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi
> [ ]   0 Do not care
> [ ]  -1 Do not establish Apache MiNiFi
>
> Thanks
> Joe
>