Re: DB2 to MS SQL data transfer

2016-08-12 Thread Sumanth Chinthagunta
Thanks Matt, I already have scheme replicated. Will try this method and let you know. If first time transfer works, with QueryDatabaseTable I should be able to replicate new records automatically, which is what I am planing to have. Thanks, -Sumo Sent from my iPhone > On Aug 12, 2016, at 8:46

Re: How can we validate a data flow.?

2016-08-12 Thread James Wing
NiFi has several features to provide monitoring and verification of your data flow: 1.) Provenance Data ( https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#data-provenance) NiFi's Provenance subsystem tracks every flowfile, how it was modified, and how it exited NiFi. It is the "log of

How can we validate a data flow.?

2016-08-12 Thread saikrishnat
Hi, I need to find out if there is a way to validate the data flow end-to-end and best practises for it. lets say if i have thousands of files that i want to move to a different destinations based on some attributes and\or contents. after the job is finished i want a complete track of all files

Re: DB2 to MS SQL data transfer

2016-08-12 Thread Matt Burgess
Sumo, One-time migrations are possible with NiFi (although probably not a common use case). Are the target tables created already? Some DBs (like MySQL) support queries that return the Create Table statement, if you get those you can use PutSQL to execute them on your target system. If the