wangbing505 commented on issue #12456: URL: https://github.com/apache/seatunnel/issues/12456#issuecomment-6056230776
@DanielLeens I tried the new fix you submitted. As I mentioned from the
beginning, after the previously identified Path to GC Roots was cleaned up, new
references appeared.
now, after job finished, Here is the new Path to GC Roots:
```text
Class Name
| Shallow Heap | Retained Heap
----------------------------------------------------------------------------------------------------------------------------------------------
org.apache.seatunnel.engine.common.loader.SeaTunnelChildFirstClassLoader @
0x8626fd38 | 88 | 275,856
|- classloader java.security.ProtectionDomain @ 0x8555fae8
| 40 | 80
| |- [1] java.security.ProtectionDomain[5] @ 0x8555fe08
| 40 | 40
| | '- context java.security.AccessControlContext @ 0x8555fde0
| 40 | 80
| | '- inheritedAccessControlContext java.lang.Thread @ 0x862dbbc0 IPC
Parameter Sending Thread #0 Thread| 120 | 4,896
| |- [1] java.security.ProtectionDomain[5] @ 0x85561160
| 40 | 40
| '- Total: 2 entries
| |
|- classloader java.security.ProtectionDomain @ 0x862dbe58
| 40 | 72
| '- [4] java.security.ProtectionDomain[5] @ 0x8654e908
| 40 | 40
|- loader java.util.ServiceLoader @ 0x8522aa18
| 32 | 128
| '- renewers class org.apache.hadoop.security.token.Token @ 0x861e47c0
| 24 | 216
'- Total: 3 entries
| |
----------------------------------------------------------------------------------------------------------------------------------------------
```
another Path to GC Roots:
```text
Class Name
| Shallow Heap | Retained
Heap
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
org.apache.seatunnel.engine.common.loader.SeaTunnelChildFirstClassLoader @
0x8627b0e8
| 88 |
166,128
'- <classloader> class com.mongodb.internal.thread.DaemonThreadFactory @
0x86289a98
| 8 |
48
'- <class> com.mongodb.internal.thread.DaemonThreadFactory @ 0x85544978
| 24 |
136
'- threadFactory java.util.concurrent.ScheduledThreadPoolExecutor @
0x862dc2f8
| 80 |
680
'- referent java.lang.ref.Finalizer @ 0x85e98560
| 40 |
40
'- prev java.lang.ref.Finalizer @ 0x85e98538
| 40 | 728
'- discovered java.lang.ref.Finalizer @ 0x85e983a8
| 40 |
504
'- discovered java.lang.ref.Finalizer @ 0x85e98330
| 40 |
504
'- discovered java.lang.ref.Finalizer @ 0x85e982b8
| 40 |
120
'- prev, discovered java.lang.ref.Finalizer @
0x85e98290
| 40 |
120
'- discovered java.lang.ref.Finalizer @
0x85e97f20
| 40 |
7,296
'- discovered
com.sun.jna.internal.Cleaner$CleanerRef @ 0x870f8910
| 48 | 136
'- previous
com.sun.jna.internal.Cleaner$CleanerRef @ 0x85ddcdc8
| 48 | 72
'- cleanable com.sun.jna.NativeLibrary @
0x85199f48
| 56 |
288
'- nativeLibrary
com.sun.jna.Library$Handler @ 0x85199f28
|
32 | 696
'- h com.sun.proxy.$Proxy32 @
0x85199f18
| 16 |
712
'- INSTANCE class
oshi.jna.platform.linux.LinuxLibc @ 0x8621cfc0
| 16
| 96
'- [4093]
java.lang.Object[10240] @ 0x85d073a0
|
40,976 | 2,659,776
'- elementData
java.util.Vector @ 0x83ca5480
| 32 |
2,659,808
'- classes
sun.misc.Launcher$AppClassLoader @ 0x83d1f660
| 88 |
3,561,488
|- scl class
java.lang.ClassLoader @ 0x83d0fa88 System Class
| 40 |
2,152
|- scloader class
sun.launcher.LauncherHelper @ 0x83d14e98
| 80 |
816
|-
contextClassLoader org.apache.logging.log4j.core.util.Log4jThread @ 0x83d646e8
Log4j2-TF-4-Scheduled-2 Thread |
120 | 512
|-
contextClassLoader org.apache.logging.log4j.core.util.Log4jThread @ 0x83d64928
Log4j2-TF-1-AsyncLogger[AsyncContext@2626b418]-1 Thread |
120 | 30,232
|-
contextClassLoader java.lang.Thread @ 0x83d650c0 Signal Dispatcher Thread
|
120 | 256
|-
contextClassLoader java.lang.Thread @ 0x862dc580
hz.main.seaTunnel.task.thread-6 Thread
| 120 | 1,616
|-
contextClassLoader java.lang.Thread @ 0x862dc7a8
hz.main.seaTunnel.task.thread-5 Thread
| 120 | 48,824
|-
contextClassLoader java.lang.Thread @ 0x862dc970
hz.main.seaTunnel.task.thread-4 Thread
| 120 | 6,192
|-
contextClassLoader java.lang.Thread @ 0x862dcb48
hz.main.seaTunnel.task.thread-3 Thread
| 120 | 6,832
|-
contextClassLoader java.lang.Thread @ 0x862dcd08
hz.main.seaTunnel.task.thread-2 Thread
| 120 | 32,256
|-
contextClassLoader java.lang.Thread @ 0x862dcec8
hz.main.seaTunnel.task.thread-1 Thread
| 120 | 6,400
|-
contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x862dd088 hz.main.cached.thread-13 Thread | 136 | 4,896
|-
contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x862dd2a0 hz.main.cached.thread-3 Thread | 136 | 4,896
|-
contextClassLoader java.lang.Thread @ 0x862dd458 arthas-command-execute Thread
|
120 | 864
|-
contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x862dd698 arthas-NettyHttpTelnetBootstrap-3-2 Thread | 128 |
9,184
|-
contextClassLoader java.lang.Thread @ 0x862dd9b8 mcp-keep-alive-scheduler
Thread |
120 | 200
|-
contextClassLoader java.lang.Thread @ 0x862ddbf8 arthas-session-manager Thread
|
120 | 200
|-
contextClassLoader java.lang.Thread @ 0x862dde58 arthas-shell-server Thread
|
120 | 200
|-
contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x862de0b8 arthas-NettyWebsocketTtyBootstrap-4-2 Thread| 128 |
2,192
|-
contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x862de3d8 arthas-NettyWebsocketTtyBootstrap-4-1 Thread| 128 |
2,192
|-
contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x862de6f8 arthas-NettyHttpTelnetBootstrap-3-1 Thread | 128 |
2,464
|-
contextClassLoader java.util.TimerThread @ 0x862dea70 arthas-timer Thread
|
128 | 208
|-
contextClassLoader java.lang.Thread @ 0x862dec08 Attach Listener Thread
|
120 | 680
|-
contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x862ded80 hz.main.cached.thread-4 Thread | 136 | 4,896
|-
contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x862def38 hz.main.cached.thread-14 Thread | 136 | 4,896
'- Total: 25 of 30
entries; 5 more
| |
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
```
another Path to GC Roots:
```text
Class Name
| Shallow Heap | Retained Heap
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
org.apache.seatunnel.engine.common.loader.SeaTunnelChildFirstClassLoader @
0x26b541850
| 88 | 276,576
'- <classloader> class
org.apache.seatunnel.shade.connector.hive.org.apache.parquet.hadoop.codec.SnappyCompressor
@ 0x26b5474f0 | 8 |
192
'- key java.util.HashMap$Node @ 0x27c5edef8
| 32 | 248
'- [14] java.util.HashMap$Node[16] @ 0x27c5edea8
| 80 | 328
'- table java.util.HashMap @ 0x269cf7350
| 48 | 376
'- compressorPool class org.apache.hadoop.io.compress.CodecPool
@ 0x26b475c00
| 24 | 2,440
'- [8100] java.lang.Object[10240] @ 0x26b092c50
| 40,976 | 2,747,200
'- elementData java.util.Vector @ 0x83cf3990
| 32 | 2,747,232
'- classes sun.misc.Launcher$AppClassLoader @
0x84433ec8
| 88 | 3,649,904
|- scl class java.lang.ClassLoader @ 0x844242f0
System Class
| 40 | 2,152
|- scloader class sun.launcher.LauncherHelper @
0x84429700 System Class
| 80 | 816
|- contextClassLoader
org.apache.logging.log4j.core.util.Log4jThread @ 0x84479460
Log4j2-TF-4-Scheduled-2 Thread |
120 | 512
|- contextClassLoader
org.apache.logging.log4j.core.util.Log4jThread @ 0x844796c0
Log4j2-TF-1-AsyncLogger[AsyncContext@2626b418]-1 Thread |
120 | 30,232
|- contextClassLoader java.lang.Thread @ 0x84479e70
Signal Dispatcher Thread
| 120 | 256
|- contextClassLoader java.lang.Thread @ 0x26b5b8808
hz.main.seaTunnel.task.thread-6 Thread
| 120 | 5,784
|- contextClassLoader java.lang.Thread @ 0x26b5b8a30
hz.main.seaTunnel.task.thread-5 Thread
| 120 | 48,824
|- contextClassLoader java.lang.Thread @ 0x26b5b8bf8
hz.main.seaTunnel.task.thread-4 Thread
| 120 | 6,192
|- contextClassLoader java.lang.Thread @ 0x26b5b9068
hz.main.seaTunnel.task.thread-3 Thread
| 120 | 6,832
|- contextClassLoader java.lang.Thread @ 0x26b5b9338
hz.main.seaTunnel.task.thread-2 Thread
| 120 | 32,256
|- contextClassLoader java.lang.Thread @ 0x26b5b9628
hz.main.seaTunnel.task.thread-1 Thread
| 120 | 6,400
|- contextClassLoader java.lang.Thread @ 0x26b5b9918
arthas-command-execute Thread
| 120 | 864
|- contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x26b5b9b78 arthas-NettyHttpTelnetBootstrap-3-2 Thread | 128 |
9,184
|- contextClassLoader java.lang.Thread @ 0x26b5b9e98
mcp-keep-alive-scheduler Thread
| 120 | 200
|- contextClassLoader java.lang.Thread @ 0x26b5ba0f8
arthas-session-manager Thread
| 120 | 200
|- contextClassLoader java.lang.Thread @ 0x26b5ba358
arthas-shell-server Thread
| 120 | 200
|- contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x26b5ba5b8 arthas-NettyWebsocketTtyBootstrap-4-2 Thread| 128 |
2,192
|- contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x26b5ba8d8 arthas-NettyWebsocketTtyBootstrap-4-1 Thread| 128 |
2,192
|- contextClassLoader
com.alibaba.arthas.deps.io.netty.util.concurrent.FastThreadLocalThread @
0x26b5babf8 arthas-NettyHttpTelnetBootstrap-3-1 Thread | 128 |
2,464
|- contextClassLoader java.util.TimerThread @
0x26b5baf18 arthas-timer Thread
| 128 | 208
|- contextClassLoader java.lang.Thread @ 0x26b5bb0b0
Attach Listener Thread
| 120 | 680
|- contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x26b5bb228 hz.main.cached.thread-5 Thread | 136 |
4,896
|- contextClassLoader
com.hazelcast.internal.util.executor.PoolExecutorThreadFactory$ManagedThread @
0x26b5bb4a0 hz.main.cached.thread-15 Thread | 136 |
4,896
|- contextClassLoader
org.apache.logging.log4j.core.util.Log4jThread @ 0x26b5bb850
Log4j2-TF-4-Scheduled-3 Thread |
120 | 224
|- contextClassLoader java.lang.Thread @ 0x26b5bba18
main-NioNetworking-closeListenerExecutor Thread
| 120 | 392
'- Total: 25 of 30 entries; 5 more
| |
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
