Mutiple dataflow jobs management(lots of jobs)

2016-03-05 Thread 刘岩
Hi All i39m trying to adapt Nifi to production but can not find an admin console which monitoring the dataflows The scenarios is simple, 1. we gather data from oracle database to hdfs and then to hive. 2. residules/incrementals are updated daily or monthly via Nifi.

Re: Mutiple dataflow jobs management(lots of jobs)

2016-03-10 Thread Aldrin Piri
Hi Yan, We can get more into details and particulars if needed, but have you experimented with expression language? I could see a Cron driven approach which covers your periodic efforts that feeds some number of ExecuteSQL processors (perhaps one for each database you are communicating with) each