Hello Team, Any update on this. We have to process 3TB records and an incremental value of 1 lakh records from source to destination. we are getting following error. LOGS: 2021-02-16 15:48:48,496 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository java.lang.OutOfMemoryError: GC overhead limit exceeded 2021-02-16 15:49:55,755 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: GC overhead limit exceeded
As an option I am trying to explore Query Record to solve problem. Is it correct? Regards Meghna ________________________________ From: Arora, Meghna Sent: Thursday, February 4, 2021 6:22 PM To: dev@nifi.apache.org <dev@nifi.apache.org>; pierre.villard...@gmail.com <pierre.villard...@gmail.com> Cc: Poddar, Rakesh Kumar <rakesh-kumar.pod...@hpe.com>; Bhattacharjee, Koushik <koushik.bhattachar...@hpe.com> Subject: RE: Connectivity issue (Nifi to postgres) Hello Pierre, Logs has been attached for same. Regards Meghna Arora [cid:image001.png@01D6FB0D.C48CB270] ________________________________ From: Pierre Villard <pierre.villard...@gmail.com<mailto:pierre.villard...@gmail.com>> Sent: 29 January 2021 23:52 To: dev@nifi.apache.org<mailto:dev@nifi.apache.org> <dev@nifi.apache.org<mailto:dev@nifi.apache.org>> Cc: iss...@nifi.apache.org<mailto:iss...@nifi.apache.org> <iss...@nifi.apache.org<mailto:iss...@nifi.apache.org>>; us...@nifi.apache.org<mailto:us...@nifi.apache.org> <us...@nifi.apache.org<mailto:us...@nifi.apache.org>>; Bhattacharjee, Koushik <koushik.bhattachar...@hpe.com<mailto:koushik.bhattachar...@hpe.com>>; Poddar, Rakesh Kumar <rakesh-kumar.pod...@hpe.com<mailto:rakesh-kumar.pod...@hpe.com>> Subject: Re: Connectivity issue (Nifi to postgres) Hi, We'll need more information like the error message, stack trace, versions you're using for NiFi / Registry / Postgres, configuration, etc. Pierre Le ven. 29 janv. 2021 à 16:48, Arora, Meghna <meghna.ar...@hpe.com<mailto:meghna.ar...@hpe.com>> a écrit : Hello Team, We are facing some issue in NIFI connection. JDBC Driver of postgres is not connecting. Please let me know how to resolve this issue. Regards Meghna