Micron Confidential Harisa,
We did this in the past (sorry, not on Teradata anymore). To streamline the process we ended up building a custom processor. Initially we used FASTLOAD CSV, and that worked OK, but it was hard to handle the error cases, since FASTLOAD errors don't work the same way as a normal JDBC insert/update error. In the end, we just switched to batch based processing using staging tables. This actually worked pretty well, are you using record based batch loading? If you want to use FASTLOAD I'd suggest writing the data to a CSV file on disk and then running a script through NiFi to load that file. Without a lot of custom coding it's probably your only path to using FASTLOAD. --Peter Micron Confidential -----Original Message----- From: Otto Fowler <ottobackwa...@gmail.com> Sent: Friday, August 28, 2020 9:44 AM To: dev@nifi.apache.org Subject: [EXT] Re: Teradata and Nifi I believe this still applies: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcommunity.cloudera.com%2Ft5%2FSupport-Questions%2FTeradata-and-NIFI%2Ftd-p%2F211964&data=02%7C01%7Cpwicks%40micron.com%7Cf748a8c4f96a4502709008d84b69408f%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C637342262723373237&sdata=p7E9ikOqICbKnMaaQB0pNy5LTIeMvBvjj9w6g3CSvco%3D&reserved=0 On August 28, 2020 at 10:54:34, Urooj, Harisa (harisa.ur...@teradata.com) wrote: We’re trying to do bulk loading of data in Teradata using NIFI. Is that possible in NIFI? Currently we noticed that row by row inserts to teradata is possible but that is not scaling well when it comes to loading millions of records. Teradata has their own set of utility operators: FASTLOAD, MULTILOAD, TPTLOAD, TPTUPDATE, etc that we can use to do fast bulk loading of records into Teradata. Does NIFI support any of these operators? So far I only see the option to run SQL against teradata not utility jobs. *Harisa Urooj* EMEA Cloud Architect +44 7557 564489 [image: signature_1806873648] <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.teradata.com%2F&data=02%7C01%7Cpwicks%40micron.com%7Cf748a8c4f96a4502709008d84b69408f%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C637342262723373237&sdata=VQ7MUzAW1rBfxcAu8gSLT7my988Sh6YN8eJDM1y%2FJrA%3D&reserved=0> 3 London Bridge Street SE1 9SG, London, UK teradata.com <https://nam01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.teradata.com%2F&data=02%7C01%7Cpwicks%40micron.com%7Cf748a8c4f96a4502709008d84b69408f%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C637342262723373237&sdata=VQ7MUzAW1rBfxcAu8gSLT7my988Sh6YN8eJDM1y%2FJrA%3D&reserved=0> *Stop buying “analytics.” Invest in answers. * This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you. Please consider the environment before printing.
