Facing issue with Duplicate data

2016-08-10 Thread yogesh sharma
Hello Team, I am new to Apache Nifi and started working on it. Currently we have Nifi installed in cluster and that has three nodes. I am facing duplicate data while implementing below use-case, Use Case : I need to fetch data from US Earthquake(http://earthquake.usgs.gov/earthquakes/feed/v

Re: Facing issue with Duplicate data

2016-08-10 Thread Joe Witt
Hello Yogesh, Couple of quick pointers that might help. 1) Set InvokeHTTP to only run on primary node. You don't want all nodes in the cluster pulling the data 2) After SplitJSON use site-to-site to send the splits across the cluster to parallelize the work. Sounds like overkill for what you've d

DB2 to MS SQL data transfer

2016-08-10 Thread Sumanth Chinthagunta
I have same scheme in DB2 and SQL server. Is there a simple solution to transfer data with NiFi? ( one time ) Hoping for somebody have better idea to build the flow :) Thanks Sumo Sent from my iPhone

Re: ExecuteSQL generated Avro schema

2016-08-10 Thread Nabegh
Yes. Thanks for the tip! -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/ExecuteSQL-generated-Avro-schema-tp13020p13032.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.