Re: Nifi + Oracle redo files?

Jason, I'm not aware of anyone reading Oracle redo logs via NiFi directly yet. More and more we're interacting with relational databases and their related logs as a source but some are more challenging than others to support in an open source capacity. Our existing SQL oriented processors have b

Nifi + Oracle redo files?

Hello… I’ve been looking through the documentation and have not found any reference to Nifi reading Oracle redo files. Are you aware of anyone who has done this successfully? …or pursued a similar alternative to directly hitting transactional Oracle tables? Thanks, Jason

S3 configuration

Greetings, I'm trying to do a PutS3Object. When I try to use it I get : 2016-01-08 15:43:17,518 INFO [Timer-Driven Process Thread-6] com.amazonaws.http.AmazonHttpClient Unable to execute HTTP request: Connection refused: conjava.net.ConnectException: Connection refused: connect at java.

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Hi Aldrin: The unfortunate things is that AWSCredentialsProvider does not inherit from AWSCredentials interface.  As far as I can see, the provider interface is much more flexible and provides everything with we/anyone can need.  As we can see, the creds based constructors (AmazonS3/SQS/SNSClien

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Mans, Thanks for sticking with this and continuing to see things through, the community certainly appreciates it as these are very popular processors and this functionality will help a wide base of users. I am poking around a bit more and thinking we might be able to work something out with a cla

Re: [DISCUSS] roadmap for the next 6-12 months

Joe! Looks amazing! Thanks for pulling this together Hello NiFi Community Please review the proposed roadmap and suggest things to add, remove, update, prioritize differently. Over the past year we have had great contributions that improved the quality of NiFi and the community. As we know there

Re: [DISCUSS] roadmap for the next 6-12 months

Looks well thought out to me! Thanks to all who put the effort into this! On Fri, Jan 8, 2016 at 6:29 AM Joe Witt wrote: > Hello NiFi Community > > Please review the proposed roadmap and suggest things to add, remove, > update, prioritize differently. > > Over the past year we have had great co

question regarding input stream from reddit.com

Hi My name is Shahzad Karamat, i am trying to read some tweets from http://stream.pushshift.io/ into nifi. I am using a mac and can read the stream using curl -i 'http://stream.pushshift.io/?subreddit=askreddit' I can get the stream into my terminal and i have also

[GitHub] nifi pull request: NiFi 1357

GitHub user jdye64 opened a pull request: https://github.com/apache/nifi/pull/164 NiFi 1357 You can merge this pull request into a Git repository by running: $ git pull https://github.com/jdye64/nifi NIFI-1357 Alternatively you can review and apply these changes as the patch

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Just one more note Joe (as mentioned in the Jira Ticket) >From what I can see, we cannot just deprecate createClient method in the >AbstractAWSProcessor which uses the AWSCredentials argument, since the >subclasses AbstractS3/SNS/SQSProcessor call that to create the respective >clients.  We will

[DISCUSS] roadmap for the next 6-12 months

Hello NiFi Community Please review the proposed roadmap and suggest things to add, remove, update, prioritize differently. Over the past year we have had great contributions that improved the quality of NiFi and the community. As we know there are many JIRAs related to improvements or new featur

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

An AWS controller service may be a good idea. I've been talking to Tony about and working on state management for the S3 Multipart upload, to make sure that aborted uploads get cleaned up. I'm keeping it in the processor for now, but if there's other benefit to an AWS controller service, such as

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Thanks Joe. If you think that we can accept the change to creds provider, I will work on making all the components in nifi aws processors to be consistent.  I think using the creds provider interface is the way to go since it is more flexible and at this moment we just have 3 aws processors to m

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Mans, I am working to put out a proposed roadmap and then probably won't be very responsive until later tonight. Will try to help then if no one else has had a chance to. That said I see what you mean in terms of a breaking change in the processor implementation as far as anyone else that has ex

Re: How to remote debug Jetty UI part

Lei, Are you interested in debugging Jetty or NiFi's UI? Assuming you're referring to the NiFi UI, you'll need to rebuild because by default all the JS/CSS files are aggregated and minified. When you rebuild, you'll need to disable the minify-and-compress maven profile. Assuming your running from

Re: Nifi-1325 - Enhancing Nifi AWS S3 for cross account access - Refactoring Nifi-AWS Processor credentials to use credentials provider

Hi Joe: I have not worked with the controller interface and aws processors so perhaps you can help me understand it .   >From what I can see (as mentioned in >https://issues.apache.org/jira/browse/NIFI-1325):  currently, the Nifi >AbstractAWSProcessor has a method protected abstract ClientType c

How to remote debug Jetty UI part

Hi, I am a newbie to Nifi community. Although i read Hortonwork's announcement on the dataflow months ago, i just realize how amazing the Nifi is. However, when i am eager to learn more and more about Nifi, i got some trouble to debug it. Could you please tell me how to remote debug the Jetty