[GitHub] nifi pull request: Nifi-1509 - Support aws lambda put processor

Github user mans2singh commented on the pull request: https://github.com/apache/nifi/pull/216#issuecomment-194116446 @markap14 - I've updated the code based on your comments. Please let me know if you have any other recommendation. Thanks --- If your project is set up for it, you can

[GitHub] nifi pull request: Nifi 1516 - AWS DynamoDB Get/Put/Delete Process...

Github user mans2singh commented on the pull request: https://github.com/apache/nifi/pull/224#issuecomment-194109133 @jvwing - I've add check for empty json response and it will continue to process without an error. I've also incorporated your comments about description in the code.

Re: [DISCUSS] - Class loader isolation per instance of the component

Oleg, What do you think are the downsides of doing this? Memory usage? Additional complexity? Tony On Mar 8, 2016 9:54 AM, "Oleg Zhurakousky" wrote: > Was wondering what others are thinking on the following: > > We have several components (Processors, ControllerServices etc.) both > existing and

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user alopresto commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-194034813 I looked at the Hadoop source code a little bit, but without getting too deep, it does appear that it could change during the lifetime of an application: 1. Hado

Re: nifi source code clarification

Ashraf, The UI code is included in the project. https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui is proba

[GitHub] nifi pull request: Nifi 1516 - AWS DynamoDB Get/Put/Delete Process...

Github user jvwing commented on the pull request: https://github.com/apache/nifi/pull/224#issuecomment-194031254 I also have a laundry list of nitpicking comments: * The names of the relationships for GetDynamoDB are `failure`, `success`, `unprocessed`, and `Not Found`. I rec

[GitHub] nifi pull request: Nifi 1516 - AWS DynamoDB Get/Put/Delete Process...

Github user jvwing commented on the pull request: https://github.com/apache/nifi/pull/224#issuecomment-194029775 I have [another annoying test for you](https://github.com/jvwing/nifi/commit/95d7620f45398f20f23d6f5e7cfe572616beb8d6), for the following scenario: 1. GetDynamoDB

nifi source code clarification

Hi Dev team, I was checking the source code for nifi from the download page. The source code for the most part only has interfaces implementations. I do not see for instance the user interface source code. Is the source code for the complete project made available? Please clarify. -- Regards

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user rickysaltzer commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-194026785 @alopresto The `UserGroupInformation` is all referenced statically, and before my changes the `UserGroupInformation.isSecurityEnabled()` method was called at the time

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user alopresto commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-194012946 @rickysaltzer Yes, I did not mean full-stack integration tests with a KDC, just unit tests, primarily focusing on validation, especially of user input and retrieved cred

[GitHub] nifi pull request: NIFI-1607 Fixing issue in ListenRELP where it c...

GitHub user bbende opened a pull request: https://github.com/apache/nifi/pull/264 NIFI-1607 Fixing issue in ListenRELP where it could commit the session before all flow files were transferred Was able to reproduce this exception by writing a unit test that simulated data coming fro

Re: Unable to connect Nifi to SQL Server

Hello, If you are specifying the URI for the driver jar, then you would generally put it outside of NiFi lib directory, somewhere else. The URI also needs the file:/// prefix, so for windows I think it would be: file:///D:/some/path/to/driver/sqljdbc4.jar Let us know if that works. -Bryan On

Unable to connect Nifi to SQL Server

Hi dev@Nifi, I am trying to connect Nifi to source SQL Server database. I keep getting the error " Cant load database driver" My settings are as follows: Database Driver Class NameInfo com.microsoft.sqlserver.jdbc.SQLServerDriver Database Driver Jar UrlInfo D:\nifi\nifi-0.5.1-bin\nifi-0.5.1

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user rickysaltzer commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-193964547 @lordjc I've added a few Kerberos options to the service validation tests. I've also rebased the changes on `master`. You can grab the changes from https://github.com

[GitHub] nifi pull request: Nifi-1509 - Support aws lambda put processor

Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/216#discussion_r55425686 --- Diff: nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/main/java/org/apache/nifi/processors/aws/lambda/PutLambda.java --- @@ -0,0 +1,239 @@ +/

[GitHub] nifi pull request: Nifi 1516 - AWS DynamoDB Get/Put/Delete Process...

Github user mans2singh commented on the pull request: https://github.com/apache/nifi/pull/224#issuecomment-193951585 @jvwing - I've added more unit test cases for different types of exceptions. Let me know what you think. --- If your project is set up for it, you can reply to this e

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user rickysaltzer commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-193944624 @bbende yeah, I noticed that all of the HBase tests were using a mock pattern. I think we should create a new JIRA to convert HBase tests to use a mini-hbase cluster.

EndpointConnectionPool is not reusable.

We have a use case where we would like to perform some routing based on application defined strategy. In order to be able to do this we need to have a mechanism to pass in the selcted nodes based on the app strategy. Ideally we would like to pass this strategy into the EndpointConnectionPool. C

[GitHub] nifi pull request: NIFI-1599 Changing DatagramChannelDispatcher, s...

Github user bbende commented on the pull request: https://github.com/apache/nifi/pull/262#issuecomment-193929305 @olegz I didn't want to get into a complete refactoring of the different handlers/dispatchers, as there are some complicated subtleties there, but I took another shot and t

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user bbende commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-193920825 @rickysaltzer if you rebase to master I think the RELP failures should go away. Regarding testing, a couple of thoughts... 1) Could we update the validatio

[GitHub] nifi pull request: NIFI-1488 Added hbase kerb auth with ugi

Github user rickysaltzer commented on the pull request: https://github.com/apache/nifi/pull/253#issuecomment-193912884 I was able to build and test this from scratch on a new machine. Looks like the travis-ci error is regarding the RELP processor, so not related to this patch.

[GitHub] nifi pull request: NIFI-1519 upgraded to the latest version of Spa...

Github user mattyb149 commented on the pull request: https://github.com/apache/nifi/pull/231#issuecomment-193898752 reviewing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] nifi pull request: Nifi 1540 - AWS Kinesis Get and Put Processors

Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/239#discussion_r55397257 --- Diff: nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/main/java/org/apache/nifi/processors/aws/kinesis/consumer/GetKinesis.java --- @@ -0,0 +1,238 @

[GitHub] nifi pull request: Nifi 1540 - AWS Kinesis Get and Put Processors

Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/239#discussion_r55396633 --- Diff: nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/main/java/org/apache/nifi/processors/aws/AbstractBaseAWSProcessor.java --- @@ -0,0 +1,211 @@

[GitHub] nifi pull request: Nifi 1540 - AWS Kinesis Get and Put Processors

Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/239#discussion_r55396443 --- Diff: nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/main/java/org/apache/nifi/processors/aws/AbstractBaseAWSProcessor.java --- @@ -0,0 +1,211 @@

[GitHub] nifi pull request: NIFI-1573 Allow programmatic access to a Proces...

Github user olegz commented on the pull request: https://github.com/apache/nifi/pull/251#issuecomment-193884361 While I can't see any valid reasons why would someone provide their own implementation of ProcessContext in some custom code, it is still a breaking change since it is on th

[GitHub] nifi pull request: NIFI-1605 Adjust documentation and resources to...

GitHub user apiri opened a pull request: https://github.com/apache/nifi/pull/263 NIFI-1605 Adjust documentation and resources to reflect nifi.provenance.repository.rollover.time default Adjust documentation and resources to reflect nifi.provenance.repository.rollover.time default o

[GitHub] nifi pull request: NIFI-1599 Changing DatagramChannelDispatcher, s...

GitHub user bbende opened a pull request: https://github.com/apache/nifi/pull/262 NIFI-1599 Changing DatagramChannelDispatcher, socket handlers, and RE… …LP handler to use offer() when queueing instead of put(), and log an error if the offer failed You can merge this pull reque

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

Github user pvillard31 commented on a diff in the pull request: https://github.com/apache/nifi/pull/257#discussion_r55373363 --- Diff: nifi-nar-bundles/nifi-snmp-bundle/nifi-snmp-processors/src/test/java/org/apache/nifi/snmp/processors/SetSNMPTest.java --- @@ -0,0 +1,411 @@ +/

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/257#discussion_r55371374 --- Diff: nifi-nar-bundles/nifi-snmp-bundle/nifi-snmp-processors/src/test/java/org/apache/nifi/snmp/processors/SetSNMPTest.java --- @@ -0,0 +1,411 @@ +/*

[GitHub] nifi pull request: NIFI-1534 removed SupportsBatching annotation f...

Github user mattyb149 commented on the pull request: https://github.com/apache/nifi/pull/249#issuecomment-193816176 +1 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] nifi pull request: NIFI-1534 removed SupportsBatching annotation f...

Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/249 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/257#discussion_r55369456 --- Diff: nifi-nar-bundles/nifi-snmp-bundle/nifi-snmp-processors/src/main/java/org/apache/nifi/snmp/processors/AbstractSNMPProcessor.java --- @@ -0,0 +1,414 @@

[DISCUSS] - Class loader isolation per instance of the component

Was wondering what others are thinking on the following: We have several components (Processors, ControllerServices etc.) both existing and coming down the pipeline which rely on class-level initializers (see example below from new SNMP PR) SecurityModels.getInstance().addSecurityModel(usm); Whi

Re: [ANNOUNCE] Apache NiFi 0.5.1 release

Dropping announce off the list. Ryan, The information from the vote with associated hashes and tags can be found at: http://mail-archives.apache.org/mod_mbox/nifi-dev/201602.mbox/%3CCA%2BLyY55tjmjKrX05tnjPC_%3DjJ8QL0N53o%3Djq68XCJEpywB58sQ%40mail.gmail.com%3E >From that conversation, the informa

Re: [ANNOUNCE] Apache NiFi 0.5.1 release

Hi Tkurc, For the Nifi 0.5.1 release, can I find the branch or specific tag on github ? We plan to upgrade to the new version. But I don't know which branch or tag I should follow. We supply Chinese Version Nifi web ui tier, we have 2 customers in Shanghai, we'd like to recommand them to use

Read condition from a text file - to process json file

I need to process a json file. The input is taken from a webpage using gethttp. The condition is currently set using EvaluateJsonPath processor. but the problem is that i need to set the condition using the properties in the EvaluateJsonPath processor. I need a process in which i can define the co