Hello everyone, I am currently working on a dataflow that selects data from a PostgreSQL database table and inserts records into an MSSQL Server database table. Unfortunately, due to an unexpected internet disconnection, some flow files have expired randomly. Now, I need to ensure that only unique records from the source table are inserted into the destination table, specifically those that do not already exist in the destination table. However, I have encountered a limitation with the "PutDatabaseRecord" processor, as it does not support the "INSERT IGNORE" property for MSSQL Server. I would appreciate any suggestions on the best approach to achieve this, so I can insert only the desired records without duplicating all records again. I'm using Apache NiFi version 2.0.0-M4. Thank you for your help!
Best regards, Deepanshu
