NiFi Protocols for Get\PutHDFS

2016-09-07 Thread saikrishnat
Hi, Can someone please let me know what protocol NiFi uses for Get\PutHDFS.? and also is there a list of all the protocols that NiFi uses for different tasks.? i read some where for Site-2-Site it uses TCP. Thanks -- View this message in context: http://apache-nifi-developer-list.39713.n7.na

Re: How can we validate a data flow.?

2016-08-15 Thread saikrishnat
Hi, But still it would be very helpful if we have a reporting app or log on top of it. it is very hard to go in to provenance and click on each activity to see the details. and also if i want to check how did my flow run over the last week. it would be very difficult if i have hundreds of coming in

How can we validate a data flow.?

2016-08-12 Thread saikrishnat
Hi, I need to find out if there is a way to validate the data flow end-to-end and best practises for it. lets say if i have thousands of files that i want to move to a different destinations based on some attributes and\or contents. after the job is finished i want a complete track of all files lik

Re: Consuming web services through NiFi

2016-06-09 Thread saikrishnat
27;t connect, if it's on a different node or VM there might be > a connectivity problem between that node and the Internet. > > Regards, > Matt > > > On Jun 9, 2016, at 4:06 PM, saikrishnat <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=11303&am

Re: Consuming web services through NiFi

2016-06-09 Thread saikrishnat
both GetHttp and InvokeHttp, but I'm curious to see if there > is a difference. > > What version of NiFi are you using? > > Thanks, > Matt > > On Wed, Jun 8, 2016 at 4:42 PM, saikrishnat <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=11300&i=0>

Re: Consuming web services through NiFi

2016-06-08 Thread saikrishnat
go to the URL when i try from my browser directly. but not thru NiFi. i tried other sites thru GetHTTP process , getting same error.. any idea.?? On Tue, Jun 7, 2016 at 4:55 PM, Matt Burgess [via Apache NiFi Developer List] wrote: > saikrishnat, > > There are multiple processors tha

Re: Consuming web services through NiFi

2016-06-08 Thread saikrishnat
Hi Matt, Thank you for the reply , when i tried to use the example "Working_With_CSV.xml" i am getting InvokeHTTP[id=a3aab33d-76dd-4169-9a29-fd0aeae219f3] Yielding processor due to exception encountered as a source processor: java.net.SocketTimeoutException: connect timed out i could go to the UR

Consuming web services through NiFi

2016-06-07 Thread saikrishnat
Hi , I am very new to NiFi. So far i can just move files between directories :). I was trying access public web services like weather service by calling its methods like getWeather,getCitiesByCountry etc..can i do that using NiFi and how..? any help is much appreciated. also any good resources for