Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 On Sat, Apr 9, 2016 at 12:13 AM, Joe Wittwrote: > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
PROBLEM SOLVED. The problem was a mixture of DNS and routing. For a couple of reasons, including possibly bad router config, each had a mixture of a bad nameserver configuration or bad routing to the nameserver. So, they couldn't resolve their own hostnames to an IP address. That's not unique to NiFi or Kafka as a failure mode, but it might be good to add an upfront test for that to make it clear that other things will fail if it isn't fixed. All 3 systems have successfully run the Kafka tests now while connected to the new router. OSX ran with JDK1.8.0_77 and the Ubuntu boxes with JDK1.7.0_80. I'll run JDK1.8.0_77 on the Ubuntu boxes later. (FYI, the CentOS box is on a completely different network which is why it wasn't affected.) Thank you Oleg and Aldrin for helping track it down!!! On Sat, Apr 9, 2016 at 5:02 PM, Aldrin Piriwrote: > Well that's great to hear, Joe. Thanks for gathering a bit more info. > > We should have tests that are a bit more resilient to varying network > conditions. I know we got nabbed by a few when the project first started > incubation To that end, if you know of anything specific between the two > routers so that we can address in the tests and/or potentially in the code > itself would be supremely helpful. As another point of data, just ran a > full build completely network disconnected and things seemed fine with > Kafka although a few others had issues. Will create a ticket for those. > > A bit bewildering as to how OS X and Ubuntu failed but CentOS was fine. > > On Sat, Apr 9, 2016 at 4:32 PM, Joe Skora wrote: > > > Aldrin, > > > > Wow, great catch on it being a network issue, the OSX system has > > successfully finished a "mvn -Pcontrib-check clean install" run! > > > > I haven't had any other problems on this router, but something must be > up. > > Now the "fun" starts now to figure out what's wrong? ;-) > > > > I'll let you know if it's something interesting or just a PEBKAC error. > > > > Joe > > > > > > > > > > On Sat, Apr 9, 2016 at 3:39 PM, Joe Skora wrote: > > > > > Aldrin, > > > > > > Yes same network, nothing novel that I know of, they all have internet > > > access and I've disabled firewalls for comparison with no affect. This > > is > > > a new router, so I will move one to the old router and see if that > makes > > a > > > difference. > > > > > > The validate/valudate mismatch is a fat fingering error on my part, I > > > copied and pasted the stacktrace but I typed the details manually into > > the > > > breakdown by system and JVM. > > > > > > The source start point is the "nifi-0.6.1-source-release.zip" file, > after > > > checksum validation and unzipping. > > > > > > I let you know if network makes a difference. > > > > > > Joe > > > > > > > > > > > > On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri > > wrote: > > > > > >> Joe, > > >> > > >> Are these all running on the same network? If so, anything novel or > > >> different about it? > > >> > > >> Also, a I assume these are remnants of debugging, but noticed some > > >> differences in terms of the source at the tagged RC and your > > stacktraces. > > >> > > >> TestGetHTTP, for instance, only has 431 lines and the test listed > > >> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not > > seem > > >> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 > > does. > > >> > > >> Thanks for the detailed report and matrix of JDKs and operating > systems. > > >> > > >> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora wrote: > > >> > > >> > -1 (non-binding) > > >> > > > >> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > > >> > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and > > >> sample > > >> > results are included below. > > >> > > > >> > The tests appear to handle ConsumerTimeoutException when it is > > expected, > > >> > but the very first call to ConsumerIterator.next() appears to fail > and > > >> that > > >> > is unchecked. > > >> > > > >> > Note: I also think KafkaPublisherTest should use sample text that is > > not > > >> > copyrighted or possibly considered offensive. > > >> > > > >> > * builds and tests ok on Centos 6.7 with Java 7 > > >> > > > >> > * tests fail on 3 systems in KafkaPublisherTest > > >> > > > >> > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > > >> > * Maven 3.3.9 > > >> > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and > > >> others > > >> > fail with "java.net.SocketException: Invalid argument" > > >> > in Apache HTTP > > SessionInputBufferImpl.streamRead():139. > > >> > * JDK1.7.0_80 > > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and > others > > >> > error out with "kafka.consumer.ConsumerTimeoutException". > > >> > * JDK1.8.0_77 > > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140
[GitHub] nifi pull request: NIFI-1748 removed un-used test data
GitHub user olegz opened a pull request: https://github.com/apache/nifi/pull/341 NIFI-1748 removed un-used test data You can merge this pull request into a Git repository by running: $ git pull https://github.com/olegz/nifi NIFI-1748 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/nifi/pull/341.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #341 commit 2581f7162f01c09ffd55d219f2af7f3b781dd6eb Author: Oleg ZhurakouskyDate: 2016-04-09T21:24:37Z NIFI-1748 removed un-used test data --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Well that's great to hear, Joe. Thanks for gathering a bit more info. We should have tests that are a bit more resilient to varying network conditions. I know we got nabbed by a few when the project first started incubation To that end, if you know of anything specific between the two routers so that we can address in the tests and/or potentially in the code itself would be supremely helpful. As another point of data, just ran a full build completely network disconnected and things seemed fine with Kafka although a few others had issues. Will create a ticket for those. A bit bewildering as to how OS X and Ubuntu failed but CentOS was fine. On Sat, Apr 9, 2016 at 4:32 PM, Joe Skorawrote: > Aldrin, > > Wow, great catch on it being a network issue, the OSX system has > successfully finished a "mvn -Pcontrib-check clean install" run! > > I haven't had any other problems on this router, but something must be up. > Now the "fun" starts now to figure out what's wrong? ;-) > > I'll let you know if it's something interesting or just a PEBKAC error. > > Joe > > > > > On Sat, Apr 9, 2016 at 3:39 PM, Joe Skora wrote: > > > Aldrin, > > > > Yes same network, nothing novel that I know of, they all have internet > > access and I've disabled firewalls for comparison with no affect. This > is > > a new router, so I will move one to the old router and see if that makes > a > > difference. > > > > The validate/valudate mismatch is a fat fingering error on my part, I > > copied and pasted the stacktrace but I typed the details manually into > the > > breakdown by system and JVM. > > > > The source start point is the "nifi-0.6.1-source-release.zip" file, after > > checksum validation and unzipping. > > > > I let you know if network makes a difference. > > > > Joe > > > > > > > > On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri > wrote: > > > >> Joe, > >> > >> Are these all running on the same network? If so, anything novel or > >> different about it? > >> > >> Also, a I assume these are remnants of debugging, but noticed some > >> differences in terms of the source at the tagged RC and your > stacktraces. > >> > >> TestGetHTTP, for instance, only has 431 lines and the test listed > >> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not > seem > >> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 > does. > >> > >> Thanks for the detailed report and matrix of JDKs and operating systems. > >> > >> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora wrote: > >> > >> > -1 (non-binding) > >> > > >> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > >> > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and > >> sample > >> > results are included below. > >> > > >> > The tests appear to handle ConsumerTimeoutException when it is > expected, > >> > but the very first call to ConsumerIterator.next() appears to fail and > >> that > >> > is unchecked. > >> > > >> > Note: I also think KafkaPublisherTest should use sample text that is > not > >> > copyrighted or possibly considered offensive. > >> > > >> > * builds and tests ok on Centos 6.7 with Java 7 > >> > > >> > * tests fail on 3 systems in KafkaPublisherTest > >> > > >> > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > >> > * Maven 3.3.9 > >> > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and > >> others > >> > fail with "java.net.SocketException: Invalid argument" > >> > in Apache HTTP > SessionInputBufferImpl.streamRead():139. > >> > * JDK1.7.0_80 > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > >> > error out with "kafka.consumer.ConsumerTimeoutException". > >> > * JDK1.8.0_77 > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > >> > error out with "kafka.consumer.ConsumerTimeoutException". > >> > > >> > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > >> > * Maven 3.3.3 > >> > * JDK1.7.0_80 > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > >> test > >> > error out with "kafka.consumer.ConsumerTimeoutException". > >> > > >> > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > >> > * JDK1.7.0_80 > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > >> test > >> > error out with "kafka.consumer.ConsumerTimeoutException". > >> > * JDK1.8.0_77 > >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > >> test > >> > error out with "kafka.consumer.ConsumerTimeoutException". > >> > > >> > > >> > --- > >> > T E S T S > >> > --- > >> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > >> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: >
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Perfect I was just replying too you again ;). Indeed ‘test’ was not used and I already commented to that effect in JIRA and removed. Yes, I was wondering why they fail as this is the first time someone reported KafkaPublisherTest failures, so kind of curious, so please feed all the info you can get if they fail again. Cheers Oleg > On Apr 9, 2016, at 4:45 PM, Joe Skorawrote: > > Oleg, > > I'm not familiar enough with Kafka to know what the tests need, but looking > at the test source now I don't think the "String test" on line 70 is used > anywhere, so I think you can just remove it. > > The failures where pretty much the same on all 3 systems. But based on > Aldrin's question about the network I moved the OS X to a different network > and it passed. I'm running one of the Ubuntu boxes now. > > Thanks, > Joe > > On Sat, Apr 9, 2016 at 4:30 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> Joe >> >> Thanks for pointing that out. I’ll remove the quote from CNN article, just >> used it as sample text. Do you see any other issue with sample data? >> Also, which systems did you observe failures described below? >> >> Cheers >> Oleg >> >>> On Apr 9, 2016, at 2:47 PM, Joe Skora wrote: >>> >>> -1 (non-binding) >>> >>> Builds and checkouts out ok, but 3 of 4 systems I tried fail in >>> KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample >>> results are included below. >>> >>> The tests appear to handle ConsumerTimeoutException when it is expected, >>> but the very first call to ConsumerIterator.next() appears to fail and >> that >>> is unchecked. >>> >>> Note: I also think KafkaPublisherTest should use sample text that is not >>> copyrighted or possibly considered offensive. >>> >>> * builds and tests ok on Centos 6.7 with Java 7 >>> >>> * tests fail on 3 systems in KafkaPublisherTest >>> >>>* OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB >>> * Maven 3.3.9 >>> * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and >> others >>> fail with "java.net.SocketException: Invalid argument" >>> in Apache HTTP SessionInputBufferImpl.streamRead():139. >>> * JDK1.7.0_80 >>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others >>> error out with "kafka.consumer.ConsumerTimeoutException". >>> * JDK1.8.0_77 >>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others >>> error out with "kafka.consumer.ConsumerTimeoutException". >>> >>>* Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB >>> * Maven 3.3.3 >>> * JDK1.7.0_80 >>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >>> error out with "kafka.consumer.ConsumerTimeoutException". >>> >>>* Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB >>> * JDK1.7.0_80 >>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >>> error out with "kafka.consumer.ConsumerTimeoutException". >>> * JDK1.8.0_77 >>> KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >>> error out with "kafka.consumer.ConsumerTimeoutException". >>> >>> >>> --- >>> T E S T S >>> --- >>> Running org.apache.nifi.processors.kafka.KafkaPublisherTest >>> Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 >> sec >>> <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest >>> >> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) >>> Time elapsed: 185.158 sec <<< ERROR! >>> kafka.consumer.ConsumerTimeoutException: null >>> at >>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >>> at >>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >>> at >>> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >>> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >>> at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >>> at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) >>> at >>> >> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) >>> >>> >> validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) >>> Time elapsed: 245.077 sec <<< ERROR! >>> kafka.consumer.ConsumerTimeoutException: null >>> at >>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >>> at >>> kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >>> at >>> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >>> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >>> at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >>>
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Oleg, I'm not familiar enough with Kafka to know what the tests need, but looking at the test source now I don't think the "String test" on line 70 is used anywhere, so I think you can just remove it. The failures where pretty much the same on all 3 systems. But based on Aldrin's question about the network I moved the OS X to a different network and it passed. I'm running one of the Ubuntu boxes now. Thanks, Joe On Sat, Apr 9, 2016 at 4:30 PM, Oleg Zhurakousky < ozhurakou...@hortonworks.com> wrote: > Joe > > Thanks for pointing that out. I’ll remove the quote from CNN article, just > used it as sample text. Do you see any other issue with sample data? > Also, which systems did you observe failures described below? > > Cheers > Oleg > > > On Apr 9, 2016, at 2:47 PM, Joe Skorawrote: > > > > -1 (non-binding) > > > > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample > > results are included below. > > > > The tests appear to handle ConsumerTimeoutException when it is expected, > > but the very first call to ConsumerIterator.next() appears to fail and > that > > is unchecked. > > > > Note: I also think KafkaPublisherTest should use sample text that is not > > copyrighted or possibly considered offensive. > > > > * builds and tests ok on Centos 6.7 with Java 7 > > > > * tests fail on 3 systems in KafkaPublisherTest > > > > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > > * Maven 3.3.9 > > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and > others > > fail with "java.net.SocketException: Invalid argument" > >in Apache HTTP SessionInputBufferImpl.streamRead():139. > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > > * Maven 3.3.3 > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > > > --- > > T E S T S > > --- > > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 > sec > > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest > > > validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 185.158 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > >at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > >at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > >at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > >at > > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) > > > > > validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 245.077 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > >at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > >at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > >at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > >at > > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114) > > > > > validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 125.07 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > >at > >
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Aldrin, Wow, great catch on it being a network issue, the OSX system has successfully finished a "mvn -Pcontrib-check clean install" run! I haven't had any other problems on this router, but something must be up. Now the "fun" starts now to figure out what's wrong? ;-) I'll let you know if it's something interesting or just a PEBKAC error. Joe On Sat, Apr 9, 2016 at 3:39 PM, Joe Skorawrote: > Aldrin, > > Yes same network, nothing novel that I know of, they all have internet > access and I've disabled firewalls for comparison with no affect. This is > a new router, so I will move one to the old router and see if that makes a > difference. > > The validate/valudate mismatch is a fat fingering error on my part, I > copied and pasted the stacktrace but I typed the details manually into the > breakdown by system and JVM. > > The source start point is the "nifi-0.6.1-source-release.zip" file, after > checksum validation and unzipping. > > I let you know if network makes a difference. > > Joe > > > > On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piri wrote: > >> Joe, >> >> Are these all running on the same network? If so, anything novel or >> different about it? >> >> Also, a I assume these are remnants of debugging, but noticed some >> differences in terms of the source at the tagged RC and your stacktraces. >> >> TestGetHTTP, for instance, only has 431 lines and the test listed >> "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem >> to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does. >> >> Thanks for the detailed report and matrix of JDKs and operating systems. >> >> On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora wrote: >> >> > -1 (non-binding) >> > >> > Builds and checkouts out ok, but 3 of 4 systems I tried fail in >> > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and >> sample >> > results are included below. >> > >> > The tests appear to handle ConsumerTimeoutException when it is expected, >> > but the very first call to ConsumerIterator.next() appears to fail and >> that >> > is unchecked. >> > >> > Note: I also think KafkaPublisherTest should use sample text that is not >> > copyrighted or possibly considered offensive. >> > >> > * builds and tests ok on Centos 6.7 with Java 7 >> > >> > * tests fail on 3 systems in KafkaPublisherTest >> > >> > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB >> > * Maven 3.3.9 >> > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and >> others >> > fail with "java.net.SocketException: Invalid argument" >> > in Apache HTTP SessionInputBufferImpl.streamRead():139. >> > * JDK1.7.0_80 >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others >> > error out with "kafka.consumer.ConsumerTimeoutException". >> > * JDK1.8.0_77 >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others >> > error out with "kafka.consumer.ConsumerTimeoutException". >> > >> > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB >> > * Maven 3.3.3 >> > * JDK1.7.0_80 >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >> > error out with "kafka.consumer.ConsumerTimeoutException". >> > >> > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB >> > * JDK1.7.0_80 >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >> > error out with "kafka.consumer.ConsumerTimeoutException". >> > * JDK1.8.0_77 >> > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other >> test >> > error out with "kafka.consumer.ConsumerTimeoutException". >> > >> > >> > --- >> > T E S T S >> > --- >> > Running org.apache.nifi.processors.kafka.KafkaPublisherTest >> > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 >> sec >> > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest >> > >> > >> validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) >> > Time elapsed: 185.158 sec <<< ERROR! >> > kafka.consumer.ConsumerTimeoutException: null >> > at >> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >> > at >> > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >> > at >> > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >> > at >> kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >> > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >> > at >> kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) >> > at >> > >> > >> org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) >> > >> > >> > >>
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Joe Thanks for pointing that out. I’ll remove the quote from CNN article, just used it as sample text. Do you see any other issue with sample data? Also, which systems did you observe failures described below? Cheers Oleg > On Apr 9, 2016, at 2:47 PM, Joe Skorawrote: > > -1 (non-binding) > > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample > results are included below. > > The tests appear to handle ConsumerTimeoutException when it is expected, > but the very first call to ConsumerIterator.next() appears to fail and that > is unchecked. > > Note: I also think KafkaPublisherTest should use sample text that is not > copyrighted or possibly considered offensive. > > * builds and tests ok on Centos 6.7 with Java 7 > > * tests fail on 3 systems in KafkaPublisherTest > > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > * Maven 3.3.9 > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others > fail with "java.net.SocketException: Invalid argument" >in Apache HTTP SessionInputBufferImpl.streamRead():139. > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > error out with "kafka.consumer.ConsumerTimeoutException". > * JDK1.8.0_77 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > error out with "kafka.consumer.ConsumerTimeoutException". > > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > * Maven 3.3.3 > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > * JDK1.8.0_77 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > > > --- > T E S T S > --- > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest > validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 185.158 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) >at > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) > > validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 245.077 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) >at > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114) > > validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 125.07 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) >at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) >at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) >at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) >at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) >at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) >at > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulReSendOfFailedSegments(KafkaPublisherTest.java:167) > > validateWithMultiByteCharacters(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 65.09 sec <<< ERROR! >
[GitHub] nifi pull request: NIFI-1738 - Repair logger names for ControllerS...
Github user jvwing commented on the pull request: https://github.com/apache/nifi/pull/334#issuecomment-207841740 @Hejki, this looks like a solid fix to me. One thing I suggest you add is some unit tests, which I missed when I "fixed" this a couple months ago. If that sounds like overkill for such a simple change, well... I use to agree :). I made some [sample tests to verify your fix](https://github.com/jvwing/nifi/commit/004ca21e50dd4f4c98923dbb9a49528ad8544179), you are welcome to use them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Aldrin, Yes same network, nothing novel that I know of, they all have internet access and I've disabled firewalls for comparison with no affect. This is a new router, so I will move one to the old router and see if that makes a difference. The validate/valudate mismatch is a fat fingering error on my part, I copied and pasted the stacktrace but I typed the details manually into the breakdown by system and JVM. The source start point is the "nifi-0.6.1-source-release.zip" file, after checksum validation and unzipping. I let you know if network makes a difference. Joe On Sat, Apr 9, 2016 at 3:26 PM, Aldrin Piriwrote: > Joe, > > Are these all running on the same network? If so, anything novel or > different about it? > > Also, a I assume these are remnants of debugging, but noticed some > differences in terms of the source at the tagged RC and your stacktraces. > > TestGetHTTP, for instance, only has 431 lines and the test listed > "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem > to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does. > > Thanks for the detailed report and matrix of JDKs and operating systems. > > On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora wrote: > > > -1 (non-binding) > > > > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample > > results are included below. > > > > The tests appear to handle ConsumerTimeoutException when it is expected, > > but the very first call to ConsumerIterator.next() appears to fail and > that > > is unchecked. > > > > Note: I also think KafkaPublisherTest should use sample text that is not > > copyrighted or possibly considered offensive. > > > > * builds and tests ok on Centos 6.7 with Java 7 > > > > * tests fail on 3 systems in KafkaPublisherTest > > > > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > > * Maven 3.3.9 > > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and > others > > fail with "java.net.SocketException: Invalid argument" > > in Apache HTTP SessionInputBufferImpl.streamRead():139. > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > > * Maven 3.3.3 > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other > test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > > > --- > > T E S T S > > --- > > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 > sec > > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest > > > > > validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 185.158 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > > at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > > at > kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > > at > kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > > at > > > > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) > > > > > > > validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 245.077 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > > at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > > at > kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > > at
[CANCEL][VOTE] Release Apache NiFi 0.6.1 (RC1)
The vote for nifi 0.6.1 is cancelled. While test issues are one thing copyright issues are another. I looked at the test Joe highlighted and believe we must remove both the quote and the apparent news article. Will address and send another rc asap. If someone could tackle the test failing tests on the highlighted platform that would be a nice step as well. Thanks Joe On Apr 9, 2016 3:27 PM, "Aldrin Piri"wrote: > > Joe, > > Are these all running on the same network? If so, anything novel or > different about it? > > Also, a I assume these are remnants of debugging, but noticed some > differences in terms of the source at the tagged RC and your stacktraces. > > TestGetHTTP, for instance, only has 431 lines and the test listed > "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem > to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does. > > Thanks for the detailed report and matrix of JDKs and operating systems. > > On Sat, Apr 9, 2016 at 2:47 PM, Joe Skora wrote: > > > -1 (non-binding) > > > > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample > > results are included below. > > > > The tests appear to handle ConsumerTimeoutException when it is expected, > > but the very first call to ConsumerIterator.next() appears to fail and that > > is unchecked. > > > > Note: I also think KafkaPublisherTest should use sample text that is not > > copyrighted or possibly considered offensive. > > > > * builds and tests ok on Centos 6.7 with Java 7 > > > > * tests fail on 3 systems in KafkaPublisherTest > > > > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > > * Maven 3.3.9 > > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others > > fail with "java.net.SocketException: Invalid argument" > > in Apache HTTP SessionInputBufferImpl.streamRead():139. > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > > * Maven 3.3.3 > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > > * JDK1.7.0_80 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > > error out with "kafka.consumer.ConsumerTimeoutException". > > * JDK1.8.0_77 > > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > > error out with "kafka.consumer.ConsumerTimeoutException". > > > > > > --- > > T E S T S > > --- > > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec > > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest > > > > validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 185.158 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > > at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > > at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > > at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > > at > > > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) > > > > > > validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) > > Time elapsed: 245.077 sec <<< ERROR! > > kafka.consumer.ConsumerTimeoutException: null > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > > at > > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > > at > > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > > at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > > at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > > at > > > >
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
Joe, Are these all running on the same network? If so, anything novel or different about it? Also, a I assume these are remnants of debugging, but noticed some differences in terms of the source at the tagged RC and your stacktraces. TestGetHTTP, for instance, only has 431 lines and the test listed "KafkaPublisherTest.valudateSuccessfulSendAsDelimited2" also does not seem to exist, but KafkaPublisherTest.validateSuccessfulSendAsDelimited2 does. Thanks for the detailed report and matrix of JDKs and operating systems. On Sat, Apr 9, 2016 at 2:47 PM, Joe Skorawrote: > -1 (non-binding) > > Builds and checkouts out ok, but 3 of 4 systems I tried fail in > KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample > results are included below. > > The tests appear to handle ConsumerTimeoutException when it is expected, > but the very first call to ConsumerIterator.next() appears to fail and that > is unchecked. > > Note: I also think KafkaPublisherTest should use sample text that is not > copyrighted or possibly considered offensive. > > * builds and tests ok on Centos 6.7 with Java 7 > > * tests fail on 3 systems in KafkaPublisherTest > > * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB > * Maven 3.3.9 > * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others > fail with "java.net.SocketException: Invalid argument" > in Apache HTTP SessionInputBufferImpl.streamRead():139. > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > error out with "kafka.consumer.ConsumerTimeoutException". > * JDK1.8.0_77 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others > error out with "kafka.consumer.ConsumerTimeoutException". > > * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB > * Maven 3.3.3 > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > > * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB > * JDK1.7.0_80 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > * JDK1.8.0_77 > KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test > error out with "kafka.consumer.ConsumerTimeoutException". > > > --- > T E S T S > --- > Running org.apache.nifi.processors.kafka.KafkaPublisherTest > Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec > <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest > > validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 185.158 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > at > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) > > > validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 245.077 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) > at > > org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114) > > > validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest) > Time elapsed: 125.07 sec <<< ERROR! > kafka.consumer.ConsumerTimeoutException: null > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) > at > kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) > at > kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) > at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) > at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) > at
[GitHub] nifi pull request: NIFI-1747 add maven-war-plugin to create jar as...
GitHub user jdye64 opened a pull request: https://github.com/apache/nifi/pull/340 NIFI-1747 add maven-war-plugin to create jar as part of the existing ⦠â¦nifi-web-api build process You can merge this pull request into a Git repository by running: $ git pull https://github.com/jdye64/nifi NIFI-1747 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/nifi/pull/340.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #340 commit 77047b53707cabbc6797397e39557eebf5958e32 Author: Jeremy DyerDate: 2016-04-09T19:24:54Z NIFI-1747 add maven-war-plugin to create jar as part of the existing nifi-web-api build process --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)
-1 (non-binding) Builds and checkouts out ok, but 3 of 4 systems I tried fail in KafkaPublisherTest unit tests with Java 7 and Java 8. Details and sample results are included below. The tests appear to handle ConsumerTimeoutException when it is expected, but the very first call to ConsumerIterator.next() appears to fail and that is unchecked. Note: I also think KafkaPublisherTest should use sample text that is not copyrighted or possibly considered offensive. * builds and tests ok on Centos 6.7 with Java 7 * tests fail on 3 systems in KafkaPublisherTest * OSX 10.11.4 (El Capitan), i7-2635QM @ 2.0 GHz, 8GB * Maven 3.3.9 * JDK1.7.0_51 TestGetHTTP.testExpressionLanguage():433 and others fail with "java.net.SocketException: Invalid argument" in Apache HTTP SessionInputBufferImpl.streamRead():139. * JDK1.7.0_80 KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others error out with "kafka.consumer.ConsumerTimeoutException". * JDK1.8.0_77 KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and others error out with "kafka.consumer.ConsumerTimeoutException". * Ubuntu 15.10 (Wily Werewolf), i7-4720HQ @ 2.6 GHz, 16GB * Maven 3.3.3 * JDK1.7.0_80 KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test error out with "kafka.consumer.ConsumerTimeoutException". * Ubuntu 15.10 (Wily Werewolf), i7-4770K @ 3.5 GHz, 16GB * JDK1.7.0_80 KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test error out with "kafka.consumer.ConsumerTimeoutException". * JDK1.8.0_77 KafkaPublisherTest.valudateSuccessfulSendAsDelimited2():140 and other test error out with "kafka.consumer.ConsumerTimeoutException". --- T E S T S --- Running org.apache.nifi.processors.kafka.KafkaPublisherTest Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 701.885 sec <<< FAILURE! - in org.apache.nifi.processors.kafka.KafkaPublisherTest validateSuccessfulSendAsDelimited2(org.apache.nifi.processors.kafka.KafkaPublisherTest) Time elapsed: 185.158 sec <<< ERROR! kafka.consumer.ConsumerTimeoutException: null at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) at org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited2(KafkaPublisherTest.java:140) validateSuccessfulSendAsDelimited(org.apache.nifi.processors.kafka.KafkaPublisherTest) Time elapsed: 245.077 sec <<< ERROR! kafka.consumer.ConsumerTimeoutException: null at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) at org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulSendAsDelimited(KafkaPublisherTest.java:114) validateSuccessfulReSendOfFailedSegments(org.apache.nifi.processors.kafka.KafkaPublisherTest) Time elapsed: 125.07 sec <<< ERROR! kafka.consumer.ConsumerTimeoutException: null at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46) at org.apache.nifi.processors.kafka.KafkaPublisherTest.validateSuccessfulReSendOfFailedSegments(KafkaPublisherTest.java:167) validateWithMultiByteCharacters(org.apache.nifi.processors.kafka.KafkaPublisherTest) Time elapsed: 65.09 sec <<< ERROR! kafka.consumer.ConsumerTimeoutException: null at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:69) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:33) at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66) at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:38) at
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 > On Apr 9, 2016, at 1:13 AM, Joe Wittwrote: > > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 - - - - - - Joseph Percivall linkedin.com/in/Percivall e: joeperciv...@yahoo.com On Saturday, April 9, 2016 10:40 AM, Suneel Marthiwrote: +1 On Sat, Apr 9, 2016 at 9:36 AM, Toivo Adams wrote: > +1 > > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/VOTE-Establish-Apache-MiNiFi-a-subproject-of-Apache-NIFi-tp8930p8947.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. >
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 On Sat, Apr 9, 2016 at 9:36 AM, Toivo Adamswrote: > +1 > > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/VOTE-Establish-Apache-MiNiFi-a-subproject-of-Apache-NIFi-tp8930p8947.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. >
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 On Sat, Apr 9, 2016 at 8:17 AM Mark Paynewrote: > +1 > > Sent from my iPhone > > > On Apr 9, 2016, at 7:51 AM, Matt Gilman wrote: > > > > +1 > > > > Sent from my iPhone > > > >> On Apr 9, 2016, at 1:13 AM, Joe Witt wrote: > >> > >> Team, > >> > >> Following a solid discussion [1] in early January regarding > >> establishment of MiNiFi as a subproject of NiFi I'd like to call a > >> formal vote to record this important community decision and > >> established consensus. > >> > >> Through lazy consensus [2] the repositories were setup for source, > >> JIRA, and git-hub mirror [3]. There has since been solid progress and > >> discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > >> been documented on Confluence/Wiki [4]. It was also reported in our > >> April 2016 board report that we have established MiNiFi based on these > >> things. But, lets make sure we get this right. > >> > >> [1] https://s.apache.org/czuz > >> [2] https://s.apache.org/Ucxs > >> [3] > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > >> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > >> > >> I am a +1 and am very excited by the progress made thus far! > >> > >> The vote will be open for 72 hours and be a majority rule vote. > >> > >> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > >> [ ] 0 Do not care > >> [ ] -1 Do not establish Apache MiNiFi > >> > >> Thanks > >> Joe >
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 Sent from my iPhone > On Apr 9, 2016, at 7:51 AM, Matt Gilmanwrote: > > +1 > > Sent from my iPhone > >> On Apr 9, 2016, at 1:13 AM, Joe Witt wrote: >> >> Team, >> >> Following a solid discussion [1] in early January regarding >> establishment of MiNiFi as a subproject of NiFi I'd like to call a >> formal vote to record this important community decision and >> established consensus. >> >> Through lazy consensus [2] the repositories were setup for source, >> JIRA, and git-hub mirror [3]. There has since been solid progress and >> discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have >> been documented on Confluence/Wiki [4]. It was also reported in our >> April 2016 board report that we have established MiNiFi based on these >> things. But, lets make sure we get this right. >> >> [1] https://s.apache.org/czuz >> [2] https://s.apache.org/Ucxs >> [3] >> https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure >> [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi >> >> I am a +1 and am very excited by the progress made thus far! >> >> The vote will be open for 72 hours and be a majority rule vote. >> >> [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi >> [ ] 0 Do not care >> [ ] -1 Do not establish Apache MiNiFi >> >> Thanks >> Joe
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 Sent from my iPhone > On Apr 9, 2016, at 1:13 AM, Joe Wittwrote: > > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 On Sat, Apr 9, 2016 at 7:08 AM, Matt Burgesswrote: > +1 > > > On Apr 9, 2016, at 1:13 AM, Joe Witt wrote: > > > > Team, > > > > Following a solid discussion [1] in early January regarding > > establishment of MiNiFi as a subproject of NiFi I'd like to call a > > formal vote to record this important community decision and > > established consensus. > > > > Through lazy consensus [2] the repositories were setup for source, > > JIRA, and git-hub mirror [3]. There has since been solid progress and > > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > > been documented on Confluence/Wiki [4]. It was also reported in our > > April 2016 board report that we have established MiNiFi based on these > > things. But, lets make sure we get this right. > > > > [1] https://s.apache.org/czuz > > [2] https://s.apache.org/Ucxs > > [3] > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > > > I am a +1 and am very excited by the progress made thus far! > > > > The vote will be open for 72 hours and be a majority rule vote. > > > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > > [ ] 0 Do not care > > [ ] -1 Do not establish Apache MiNiFi > > > > Thanks > > Joe >
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 > On Apr 9, 2016, at 1:13 AM, Joe Wittwrote: > > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 Rob On Sat, Apr 9, 2016 at 3:48 AM, Jennifer Barnabee < jennifer.barna...@gmail.com> wrote: > +1 > > On Sat, Apr 9, 2016 at 1:13 AM, Joe Wittwrote: > > > Team, > > > > Following a solid discussion [1] in early January regarding > > establishment of MiNiFi as a subproject of NiFi I'd like to call a > > formal vote to record this important community decision and > > established consensus. > > > > Through lazy consensus [2] the repositories were setup for source, > > JIRA, and git-hub mirror [3]. There has since been solid progress and > > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > > been documented on Confluence/Wiki [4]. It was also reported in our > > April 2016 board report that we have established MiNiFi based on these > > things. But, lets make sure we get this right. > > > > [1] https://s.apache.org/czuz > > [2] https://s.apache.org/Ucxs > > [3] > > > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > > > I am a +1 and am very excited by the progress made thus far! > > > > The vote will be open for 72 hours and be a majority rule vote. > > > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > > [ ] 0 Do not care > > [ ] -1 Do not establish Apache MiNiFi > > > > Thanks > > Joe > > >
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 On Sat, Apr 9, 2016 at 1:13 AM, Joe Wittwrote: > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe >
Re: Initial Commit of New In-Depth Developer Doc
Great addition in the documentation. Very clear and useful. Thanks, Pierre Le 8 avr. 2016 8:12 PM, "Joe Percivall"a écrit : Hello Dev, I recently finished up an initial version of a new developer doc "Apache NiFi In Depth". It goes in depth on the design decisions, the Repos, how a FlowFile gets processed and more. It assumes the reader has read the other documentation prior to reading. To complete this document I was able to talk to the people who wrote much of the underlying implementations (shout out to Mark and Aldrin) and format the information as a new ascii document to be bundled with NiFi. If anyone wants a sneak peak or to provide feedback the ticket is NIFI-1028[1]. [1] https://issues.apache.org/jira/browse/NIFI-1028 Looking forward to getting some feedback, Joe - - - - - - Joseph Percivall linkedin.com/in/Percivall e: joeperciv...@yahoo.com
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 Pierre Le 9 avr. 2016 8:16 AM, "Andre"a écrit : > +1 > > Had a look at the Community Driven Requirements and I must say they match > my needs like a glove! :-) > > > > On Sat, Apr 9, 2016 at 3:13 PM, Joe Witt wrote: > > > Team, > > > > Following a solid discussion [1] in early January regarding > > establishment of MiNiFi as a subproject of NiFi I'd like to call a > > formal vote to record this important community decision and > > established consensus. > > > > Through lazy consensus [2] the repositories were setup for source, > > JIRA, and git-hub mirror [3]. There has since been solid progress and > > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > > been documented on Confluence/Wiki [4]. It was also reported in our > > April 2016 board report that we have established MiNiFi based on these > > things. But, lets make sure we get this right. > > > > [1] https://s.apache.org/czuz > > [2] https://s.apache.org/Ucxs > > [3] > > > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > > > I am a +1 and am very excited by the progress made thus far! > > > > The vote will be open for 72 hours and be a majority rule vote. > > > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > > [ ] 0 Do not care > > [ ] -1 Do not establish Apache MiNiFi > > > > Thanks > > Joe > > >
[GitHub] nifi pull request: NIFI-1028 initial commit of NiFi In Depth docum...
Github user trixpan commented on the pull request: https://github.com/apache/nifi/pull/339#issuecomment-207723976 @JPercivall great commit. Very good to have a clear and concise source to understand what happens under the nice and friendly web UI. :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [VOTE] Establish Apache MiNiFi, a subproject of Apache NIFi
+1 Had a look at the Community Driven Requirements and I must say they match my needs like a glove! :-) On Sat, Apr 9, 2016 at 3:13 PM, Joe Wittwrote: > Team, > > Following a solid discussion [1] in early January regarding > establishment of MiNiFi as a subproject of NiFi I'd like to call a > formal vote to record this important community decision and > established consensus. > > Through lazy consensus [2] the repositories were setup for source, > JIRA, and git-hub mirror [3]. There has since been solid progress and > discussion on a number of MINIFI JIRAs. The core goals of MiNiFi have > been documented on Confluence/Wiki [4]. It was also reported in our > April 2016 board report that we have established MiNiFi based on these > things. But, lets make sure we get this right. > > [1] https://s.apache.org/czuz > [2] https://s.apache.org/Ucxs > [3] > https://cwiki.apache.org/confluence/display/NIFI/Supporting+Infrastructure > [4] https://cwiki.apache.org/confluence/display/NIFI/MiNiFi > > I am a +1 and am very excited by the progress made thus far! > > The vote will be open for 72 hours and be a majority rule vote. > > [ ] +1 Establish Apache MiNiFi, a subproject of Apache NiFi > [ ] 0 Do not care > [ ] -1 Do not establish Apache MiNiFi > > Thanks > Joe >