Re: Nifi to Titan... How?

2016-05-20 Thread Pat Trainor
Matt, Great response, and thanks for writing. I would imagine querying would be left to Java, Gephi, etc., and a Cassandra query (QueryCassandra) would seem to do well, or even the REST API in Titan 1.0.0? But then again, I see where Titan queries would be valuable, with Traversals not being the l

Re: Nifi to Titan... How?

2016-05-20 Thread Matt Burgess
Pat, No worries, this discussion is relevant to the devs group :) I appreciate and share your interest in getting connected data into graph databases in order to get more insight out of the data. It may be possible to put the data directly into the backing store (Cassandra, e.g.) via NiFi, but in

[GitHub] nifi pull request: NIFI-1909 Adding ability to process schemaless ...

2016-05-20 Thread ryanpersaud
Github user ryanpersaud commented on the pull request: https://github.com/apache/nifi/pull/459#issuecomment-220753130 I made the changes that @markap14 suggested and removed unused imports that were identified by checkstyle. I've attempted to run `mvn -Pcontrib-check` on 3 different

Re: Nifi to Titan... How?

2016-05-20 Thread Pat Trainor
Joe Witt & Andre, You guys are very nice, but I thought this was the only mailing list for Nifi... I now realize that there is a user's list, where this kind of question would be more appropriate. Thanks for not tazing me... :) As for the great replies: Joe, I want the output to be used in Tit

[GitHub] nifi pull request: NIFI-786 AWS credential refactoring and enhance...

2016-05-20 Thread jskora
Github user jskora commented on the pull request: https://github.com/apache/nifi/pull/244#issuecomment-220749583 I'm starting to review and test this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

Issues with Regex used with ReplaceTextWithMapping: where am I going wrong?

2016-05-20 Thread idioma
Hi, I have come across an issue with my regex associated with ReplaceTextWithMapping. I have attached input and mapping files together with a NiFi template. My Json looks like this: {"field1": "someText", "field2": "Text Again", "field3": "Text Again"} I am trying to match the fir

[GitHub] nifi pull request: NIFI-1909 Adding ability to process schemaless ...

2016-05-20 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/459#discussion_r64097658 --- Diff: nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/src/main/java/org/apache/nifi/processors/avro/ConvertAvroToJSON.java --- @@ -128,49 +141,77 @

[GitHub] nifi pull request: NIFI-1909 Adding ability to process schemaless ...

2016-05-20 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/459#discussion_r64097258 --- Diff: nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/src/main/java/org/apache/nifi/processors/avro/ConvertAvroToJSON.java --- @@ -92,6 +103,7 @@

[GitHub] nifi pull request: NIFI-1909 Adding ability to process schemaless ...

2016-05-20 Thread ryanpersaud
GitHub user ryanpersaud opened a pull request: https://github.com/apache/nifi/pull/459 NIFI-1909 Adding ability to process schemaless Avro records to NIFI-1909 Adding ability to process schemaless Avro records to ConvertAvroToJson. A new property named schema is added to the proces

[GitHub] nifi pull request: NIFI-1568: Add Filter Capability to UnpackConte...

2016-05-20 Thread rickysaltzer
Github user rickysaltzer commented on the pull request: https://github.com/apache/nifi/pull/248#issuecomment-220686739 @trkurc changed the default value to `.*` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] nifi pull request: NIFI-1568: Add Filter Capability to UnpackConte...

2016-05-20 Thread rickysaltzer
Github user rickysaltzer commented on a diff in the pull request: https://github.com/apache/nifi/pull/248#discussion_r64087730 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/UnpackContent.java --- @@ -111,

[GitHub] nifi pull request: NIFI-1884 Defining API for Users, Groups, and P...

2016-05-20 Thread jtstorck
Github user jtstorck commented on a diff in the pull request: https://github.com/apache/nifi/pull/452#discussion_r64086436 --- Diff: nifi-api/src/main/java/org/apache/nifi/authorization/AccessPolicy.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] nifi pull request: NIFI-1568: Add Filter Capability to UnpackConte...

2016-05-20 Thread trkurc
Github user trkurc commented on a diff in the pull request: https://github.com/apache/nifi/pull/248#discussion_r64084293 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/UnpackContent.java --- @@ -111,8 +107

[GitHub] nifi pull request: NIFI-1745: Refactor how revisions are handled a...

2016-05-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/454 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] nifi pull request: NIFI-1799 Implements auto-scaling flow layout

2016-05-20 Thread jtstorck
Github user jtstorck commented on the pull request: https://github.com/apache/nifi/pull/442#issuecomment-220668197 Hey @alopresto, I added a test case to address your previous comment regarding the flow file versioning. The two test specs, PositionScalerSpec, and StandardFlowSynchron

[GitHub] nifi pull request: NIFI-1884 Defining API for Users, Groups, and P...

2016-05-20 Thread bbende
Github user bbende commented on a diff in the pull request: https://github.com/apache/nifi/pull/452#discussion_r64076734 --- Diff: nifi-api/src/main/java/org/apache/nifi/authorization/AccessPolicy.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] nifi pull request: NIFI-1829 - Create new DebugFlow processor.

2016-05-20 Thread jskora
GitHub user jskora opened a pull request: https://github.com/apache/nifi/pull/458 NIFI-1829 - Create new DebugFlow processor. * Create DebugFlow processor for use in testing and troubleshooting the processor framework. * 0.x - commits as is. * 1.x - in o.a.n.p.s.DebugFl

[GitHub] nifi pull request: Nifi 1540 - AWS Kinesis Get and Put Processors

2016-05-20 Thread jvwing
Github user jvwing commented on the pull request: https://github.com/apache/nifi/pull/239#issuecomment-220657759 @mans2singh, I am a bit behind on this PR, but will try to get up to speed and contribute to the review. --- If your project is set up for it, you can reply to this email

[GitHub] nifi-minifi-cpp pull request: completion of C++ framework for MiNi...

2016-05-20 Thread benqiu2016
Github user benqiu2016 closed the pull request at: https://github.com/apache/nifi-minifi-cpp/pull/3 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[GitHub] nifi-minifi-cpp pull request: MINIFI-6: Basic C++ implementation f...

2016-05-20 Thread benqiu2016
GitHub user benqiu2016 opened a pull request: https://github.com/apache/nifi-minifi-cpp/pull/4 MINIFI-6: Basic C++ implementation for MiNiFi You can merge this pull request into a Git repository by running: $ git pull https://github.com/benqiu2016/nifi-minifi-cpp MINIFI-6 Alt

[GitHub] nifi pull request: Nifi 1540 - AWS Kinesis Get and Put Processors

2016-05-20 Thread mans2singh
Github user mans2singh commented on the pull request: https://github.com/apache/nifi/pull/239#issuecomment-220644414 Hey @olegz @apiri @jvwing @joewitt - I've tried to address your review comments above. Please let me know if you have any feedback for me. Thanks Mans --- If your p

[GitHub] nifi-minifi-cpp pull request: completion of C++ framework for MiNi...

2016-05-20 Thread benqiu2016
GitHub user benqiu2016 opened a pull request: https://github.com/apache/nifi-minifi-cpp/pull/3 completion of C++ framework for MiNiFi6 You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/nifi-minifi-cpp MINIFI-6 Alternatively

[GitHub] nifi-minifi-cpp pull request: Minifi 6

2016-05-20 Thread benqiu2016
Github user benqiu2016 closed the pull request at: https://github.com/apache/nifi-minifi-cpp/pull/2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[GitHub] nifi pull request: NIFI-1907 Moving lazy init of SSLContext...

2016-05-20 Thread bbende
GitHub user bbende opened a pull request: https://github.com/apache/nifi/pull/457 NIFI-1907 Moving lazy init of SSLContext... to StandardSiteToSiteClientConfig rather than the builder. Tested secure SiteToSite still working between two NiFi nodes, and now example Storm topo

Re: Output connection is invalid

2016-05-20 Thread Mark Payne
Hello, I believe the confusion here is coming from the fact that Output Ports on the Root Group (the very top level of your canvas) are treated a little bit differently than other ports in your graph. The idea of a port is that it lets data into or out of your process group (depending on if it'

Output connection is invalid

2016-05-20 Thread pradeepbill
I have a spark application reading from an output port in NIFI, and I have the spark application running, but when I try to start the nifi flow, it says below error message, where should I define the "Output connection" ?.Please advice Node sabn6:8282 is unable to fulfill this request due to: Loc

[GitHub] nifi pull request: NIFI-1905 enabled ExecuteProcess to terminate p...

2016-05-20 Thread olegz
Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/456#discussion_r64044369 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ExecuteProcess.java --- @@ -181,7 +183

[GitHub] nifi pull request: NIFI-1905 enabled ExecuteProcess to terminate p...

2016-05-20 Thread olegz
Github user olegz commented on a diff in the pull request: https://github.com/apache/nifi/pull/456#discussion_r64043923 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ExecuteProcess.java --- @@ -181,7 +183

[GitHub] nifi pull request: NIFI-1745: Refactor how revisions are handled a...

2016-05-20 Thread markap14
Github user markap14 commented on the pull request: https://github.com/apache/nifi/pull/454#issuecomment-220610191 @mcgilman I agree, I do think it makes more sense to handle that in the Revision. Have updated the PR to back that out so that we can instead do it in the Resource in the

[GitHub] nifi pull request: NIFI-1745: Refactor how revisions are handled a...

2016-05-20 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/454#discussion_r64043396 --- Diff: nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-optimistic-locking/src/main/java/org/apache/nifi/web/revision/NaiveRevisionManage

[GitHub] nifi pull request: NIFI-1884 Defining API for Users, Groups, and P...

2016-05-20 Thread jtstorck
Github user jtstorck commented on the pull request: https://github.com/apache/nifi/pull/452#issuecomment-220607952 +1 looks good to me at this point, though @mcgilman's earlier comment on making MutableAuthorizer a base class does sound good, since the idea of the MutableAuthorizer wa

[GitHub] nifi pull request: NIFI-1884 Defining API for Users, Groups, and P...

2016-05-20 Thread jtstorck
Github user jtstorck commented on a diff in the pull request: https://github.com/apache/nifi/pull/452#discussion_r64040788 --- Diff: nifi-api/src/main/java/org/apache/nifi/authorization/AccessPolicy.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] nifi pull request: NIFI-1905 enabled ExecuteProcess to terminate p...

2016-05-20 Thread aperepel
Github user aperepel commented on a diff in the pull request: https://github.com/apache/nifi/pull/456#discussion_r64040583 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ExecuteProcess.java --- @@ -181,7 +

[GitHub] nifi pull request: NIFI-1905 enabled ExecuteProcess to terminate p...

2016-05-20 Thread olegz
GitHub user olegz opened a pull request: https://github.com/apache/nifi/pull/456 NIFI-1905 enabled ExecuteProcess to terminate process You can merge this pull request into a Git repository by running: $ git pull https://github.com/olegz/nifi NIFI-1905 Alternatively you can re

Contribution ListFTP and FetchSTP processors

2016-05-20 Thread Joris Mees
Hi, We (Data Minded) are a company mainly active in consultancy services regarding data solutions. We have recently deployed a Nifi instance at a client and needed functionality for a ListFTP and FetchFTP processor as described in the following Jira issue: https://issues.apache.org/jira/browse

Re: Nifi to Titan... How?

2016-05-20 Thread Andre
Pat, There's a few ways of skinning this cat but the common approach is to make use of Tinkerpop's Gremlin using Groovy. I would then suggest tying the Groovy code with NiFi's ExecuteScript processor. This would ensure your code is reasonably re-usable across different Graph DBs (as long they imp