Thanks Bryan, Yes , I do not need a RPG, I will try with the approach you mentioned and will get back to you.
Thanks Pradeep Sent from my iPhone > On May 26, 2016, at 6:24 AM, Bryan Bende [via Apache NiFi Developer List] > <ml-node+s39713n10724...@n7.nabble.com> wrote: > > Hi Pradeep, > > Thanks for sending the information about your flow. From looking at the > picture, I'm not sure I fully understand what the flow is doing... > > It looks like there is a GetFile processor connected to a Remote Process > Group (RPG) which goes to an Input Port called app_logs, and I see the > app_logs Input Port on the graph then connected to the Output Port > Data_for_Spark. Then the RPG has a connection from Data_for_Spark to > Data_for_Spark which seems like its a circular connection. > > Do you even need a Remote Process Group in this case? > > You could have GetFile directly connected to an Output Port where Spark can > pull from. The only reason to use a Remote Process Group would be if you > are in a cluster and want to run GetFile only on the Primary Node, and then > redistributed the results to the other nodes in the cluster. If that is > what you want to do then using ListFile + FetchFile would be the > recommended approach. > > ListFile -> Remote Process Group > Input Port -> FetchFile > > Hope this helps. > > -Bryan > > > On Wed, May 25, 2016 at 1:32 PM, pradeepbill <[hidden email]> wrote: > > > Please see my dataflow . > > > > nifi.PNG > > < > > http://apache-nifi-developer-list.39713.n7.nabble.com/file/n10710/nifi.PNG > > > > > > > > > > > -- > > View this message in context: > > http://apache-nifi-developer-list.39713.n7.nabble.com/site-to-site-communication-error-on-output-port-tp10698p10710.html > > Sent from the Apache NiFi Developer List mailing list archive at > > Nabble.com. > > > > > If you reply to this email, your message will be added to the discussion > below: > http://apache-nifi-developer-list.39713.n7.nabble.com/site-to-site-communication-error-on-output-port-tp10698p10724.html > To unsubscribe from site to site communication error on output port, click > here. > NAML -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/site-to-site-communication-error-on-output-port-tp10698p10725.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
