GitHub user Susmit07 edited a discussion: Memory Leak for Pekko Shardedc cluster
Hellp Team We were tying large file upoad 15-20gb using HDFS as source and S3 as sink with S3 multipartApi, but I am seeing leaking resources ``` One instance of java.util.zip.ZipFile$Source loaded by <system class loader> occupies 4,94,11,544 (55.80%) bytes. The instance is referenced by org.apache.pekko.dispatch.MonitorableThreadFactory$PekkoForkJoinWorkerThread @ 0x6c33b5548 cef-datasync-downloader-pekko.actor.default-dispatcher-6, loaded by jdk.internal.loader.ClassLoaders$AppClassLoader @ 0x6c34cda68. ``` <img width="1070" alt="image" src="https://github.com/user-attachments/assets/704ad329-00a3-4590-9ae9-782493a6e1bf";> <img width="826" alt="image" src="https://github.com/user-attachments/assets/79ec2844-a708-4d44-9dc3-b9244c381a61";> <img width="826" alt="image" src="https://github.com/user-attachments/assets/e68c3651-54d7-4528-87db-424fc1f3437e";> <img width="826" alt="image" src="https://github.com/user-attachments/assets/1ec8a728-9c53-4060-87a0-ffbcea42052c";> ZiFileSource is tha major culprit here Any suggestion elcome GitHub link: https://github.com/apache/pekko-connectors/discussions/885 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
