Re: Start flow automatically on Nifi start

2015-10-15 Thread Andrew Grande
- I would like to start some of the flows whenever the nifi server is restarted. I think I can use 'nifi.flowcontroller.autoResumeState' to achieve that. Or would that start all processors? Yes, that's the purpose of this property and it's enabled by default. Did you try it and not see

RE: Start flow automatically on Nifi start

2015-10-15 Thread David Klim
Thanks for the answers! So I guess I will need to create the flow programatically using Nifi REST API depending on the specifics of the cluster being setup, essentially: Create processor group -> instantiate template Will give that a try. Long term, I thing Nifi could accept several flows

Re: Start flow automatically on Nifi start

2015-10-15 Thread Brandon DeVries
David, To expand on the second part of Andrew's answer, you can make templates of the Process Groups you divide your flow into so that you can add only the ones you need to any given cluster. Brandon On Thu, Oct 15, 2015 at 12:16 PM, Andrew Grande wrote: > > > - I

Provenance doesn't work with FetchS3Object

2015-10-15 Thread Ben Meng
I understand that FetchS3Object processor requires an incoming FlowFile to trigger it. The problem is that FetchS3Object emits a RECEIVE provenance event for the existing FlowFile. That event causes following error when I try to open the lineage chart for a simple flow: GenerateFlowFile ->

Re: Provenance doesn't work with FetchS3Object

2015-10-15 Thread Oleg Zhurakousky
Ben I don’t think it needs an incoming FlowFile. It is a scheduled component and will retrieve contents based on how you configure scheduling. Have you tried it without incoming FlowFiles? Cheers Oleg On Oct 15, 2015, at 3:38 PM, Ben Meng >

Re: StoreInKiteDataset help

2015-10-15 Thread Joe Witt
Chris, Are you seeing errors in NiFi or in HDP? If you're seeing errors in NiFi can you please send us the logs? Thanks Joe On Thu, Oct 15, 2015 at 3:02 PM, Christopher Wilson wrote: > Has anyone gotten Kite to work on HDP? I'd wanted to do this very thing but > am